CN113612858B - Multi-terminal collaboration system and collaboration method - Google Patents

Multi-terminal collaboration system and collaboration method Download PDF

Info

Publication number
CN113612858B
CN113612858B CN202111047635.3A CN202111047635A CN113612858B CN 113612858 B CN113612858 B CN 113612858B CN 202111047635 A CN202111047635 A CN 202111047635A CN 113612858 B CN113612858 B CN 113612858B
Authority
CN
China
Prior art keywords
terminal
module
video signal
audio
data information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111047635.3A
Other languages
Chinese (zh)
Other versions
CN113612858A (en
Inventor
钟毅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Lecheng Internet Co ltd
Original Assignee
Shenzhen Lecheng Internet Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Lecheng Internet Co ltd filed Critical Shenzhen Lecheng Internet Co ltd
Priority to CN202111047635.3A priority Critical patent/CN113612858B/en
Publication of CN113612858A publication Critical patent/CN113612858A/en
Application granted granted Critical
Publication of CN113612858B publication Critical patent/CN113612858B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/38Information transfer, e.g. on bus
    • G06F13/40Bus structure
    • G06F13/4063Device-to-bus coupling
    • G06F13/4068Electrical coupling
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B1/00Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
    • H04B1/02Transmitters
    • H04B1/04Circuits
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B1/00Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
    • H04B1/06Receivers
    • H04B1/16Circuits
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/26Special purpose or proprietary protocols or architectures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video stream to a specific local network, e.g. a Bluetooth® network

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

The invention relates to the technical field of communication, in particular to a multi-terminal collaboration system and a collaboration method, which can coordinate communication between offline and online, integrate and coordinate a plurality of terminal devices under the online so as to avoid mutual interference among the terminal devices, simultaneously avoid the pressure of simultaneous networking of a plurality of terminal devices on network bandwidth, reduce the high dependence on network quality and have higher practicability.

Description

Multi-terminal collaboration system and collaboration method
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a transmitting device, a receiving device, an information transmission system, an information transmission method, and a multi-terminal collaboration system and collaboration method.
Background
With the development of information technology, how to more effectively perform information transmission between devices has received widespread attention. Conventionally, people commonly adopt a data line to transmit information between devices, for example, in a conference, an HDMI interface of a notebook computer is connected with a large screen used in the conference in a wired manner, so that information on the notebook computer is projected on the screen, however, in general, the conference room space is limited, when a plurality of notebook computers and other devices all need to be connected with the large screen, wiring is very difficult, on one hand, higher wiring cost, such as the cost of wires per se and wiring cost, and on the other hand, complicated wiring is not beneficial to maintenance and repair, so that the cost of maintenance and repair is increased. In addition, most of large-screen HDMI interfaces are limited, and connection with a plurality of notebook computers cannot be realized at the same time, so that the information transmission system adopting a wired mode is inconvenient to use; for example, in a studio, a plurality of cameras are required to be adopted for shooting, content shot by the cameras is transmitted to a broadcasting guide table through HDMI data lines, the difficulty of the length and the stay wire of the data lines is limited, the camera in the studio basically adopts a fixed camera position and cannot flexibly capture an optimal shooting angle, and the plurality of cameras are required to be adopted for shooting, namely, the plurality of data lines are required to be used for content transmission, so that the mutual winding between the data lines is easy to generate, the camera position arrangement is influenced, even the shooting is required to be interrupted, and the performance is greatly influenced.
For this, an information transmission system adopting a wireless transmission mode appears on the market, which adopts a transmitting end and a receiving end wirelessly connected with the transmitting end, the transmitting end is connected with a user's device by adopting a USB interface, for example, a notebook computer of the user transmits information on the user's device to the receiving end in a wireless mode, the receiving end processes the received information and transmits the processed information to a terminal device, for example, a large screen used in a conference, etc., so as to realize the effect of sharing the information on the user's device to the large screen terminal of the conference, thereby achieving the effect of screen throwing.
In the existing wireless information transmission system, the information transmission between the transmitting end and the equipment is generally carried out by adopting the USB, and as is well known, the traditional USB cannot realize the direct transmission of audio and video signals, so that the existing wireless information transmission system can transmit the audio and video signals to the transmitting end through the USB after encoding the audio and video signals to be transmitted by means of the equipment of a user, specifically, the encoding software is arranged in the existing transmitting end, and when the existing wireless information transmission system is connected to the equipment of the user through the USB, the user needs to install the encoding software on the equipment to mobilize the CPU of the equipment to encode the audio and video signals. However, on one hand, the general CPU has limited encoding capability on audio and video signals, and when the audio and video signals are encoded, the conditions of reduced picture definition, reduced tone quality and the like can occur, and the phenomena of time delay, blocking and the like can easily occur when the dynamic video is projected, so that the user experience effect is poor; on the other hand, due to the consideration of information security protection and protection of trade secrets, the installation of unknown software may cause information leakage stored on the device by a user, and even for the coding software built in the transmitting end, absolute security cannot be ensured, that is, there is a risk of information leakage in the existing wireless information transmission system technology.
In addition, in the prior art, the receiving end can only receive the information of the transmitting end matched with the receiving end, the transmitting end is connected with the equipment of the user by adopting USB, and when the equipment of the user has no special USB interface, the screen throwing cannot be realized through the existing system. In view of this, receiving end devices supporting connection with devices such as tablet computers and mobile phones are currently available on the market, however, the existing technology cannot be compatible with two protocols simultaneously because the two main operating systems of the tablet computers and the smart phones are different in android and ios transmission protocols, so that connection with the android device or connection with the ios device can only be established, which is not practical.
That is, in the conventional information transmission system, the wired transmission system has limitations such as wiring and inconvenience in use. On the one hand, a wireless transmission system is poor in transmission quality, information distortion and blocking of transmission are easy to cause, and experience effect is poor; on the other hand, additional coding software is required to be installed on the equipment, so that the risk of information leakage exists, and the information safety cannot be ensured; and the existing wireless transmission system cannot realize compatibility of different operation system devices, cannot meet the use requirements of people, and has low practicability.
Disclosure of Invention
An object of the present invention is to provide a transmitting apparatus, a receiving apparatus, an information transmission system, an information transmission method, and a multi-terminal collaboration system and collaboration method, which can directly obtain information to be transmitted without obtaining the information to be transmitted by installing an encoding software driving processor on a user equipment terminal to encode, thereby ensuring transmission quality and information security, and being compatible with devices of different operating systems, and having higher practicability.
Another object of the present invention is to provide a transmitting device, a receiving device, an information transmission system, an information transmission method, and a multi-terminal collaboration system and collaboration method, where the transmitting device includes an audio-video signal input end, where the audio-video signal input end is connected to a device terminal with a corresponding audio-video transmission protocol built therein, so that an audio-video signal generated based on the audio-video transmission protocol built in the device terminal is directly accessed from the device terminal, without installing coding software on the device terminal to drive a processor of the device terminal to perform coding, thereby avoiding situations of degradation of definition, degradation of sound quality, etc. caused by coding processing of the audio-video signal by the processor of the device terminal, and avoiding time delay generated by the processor during coding, thereby realizing real-time acquisition of information, improving timeliness and smoothness of information transmission, and ensuring good experience of a user.
Another object of the present invention is to provide a transmitting device, a receiving device, an information transmission system, an information transmission method, and a multi-terminal collaboration system and collaboration method, in which the transmitting device is connected to a device terminal with a corresponding audio/video transmission protocol built therein through the audio/video signal input end, so as to directly access an audio/video signal generated based on the audio/video transmission protocol built in the device terminal from the device terminal, without encoding by installing a processor of an encoding software driving device terminal on the device terminal, thereby avoiding the risk of information leakage generated by installing encoding software on the device terminal, and ensuring information security.
Another object of the present invention is to provide a transmitting device, a receiving device, an information transmission system, an information transmission method, and a multi-terminal collaboration system and collaboration method, wherein the transmitting device includes a coding module, the coding module codes the video signal accessed through the video signal input end, wherein the coding module codes the video signal based on a special encoder to generate a data information, and the special encoder is designed specifically for coding, so that the transmitting device has good coding performance, so as to ensure quality and smoothness of the video signal, thereby ensuring good experience of a user.
Another object of the present invention is to provide a transmitting device, a receiving device, an information transmission system, an information transmission method, and a multi-terminal collaboration system and collaboration method, in which the transmitting device encodes the audio-visual signal through the encoding module, so as to avoid installing additional encoding software at a device terminal, and a process of generating the data information by performing software encoding on the audio-visual signal through the installed encoding software by using a processor of the device terminal, so as to avoid the risk of information leakage caused by installing the encoding software on the device terminal, and save the time consumed by installing the encoding software, thereby providing a user with a good use experience.
Another object of the present invention is to provide a transmitting apparatus, a receiving apparatus, an information transmission system, and an information transmission method, and a multi-terminal cooperation system and cooperation method, wherein the transmitting apparatus includes a communication module, wherein the communication module is communicatively connected to the encoding module and is configured to transmit the data information in a wireless manner, thereby avoiding limitations such as wiring, inconvenience in use, and the like caused by wired transmission, and improving the practicality of the transmitting apparatus.
Another object of the present invention is to provide a transmitting device, a receiving device, an information transmission system, an information transmission method, and a multi-terminal collaboration system and collaboration method, where the transmitting device includes a USB interface, where the communication module is capable of wirelessly receiving an external message, and transmitting the external message to a device terminal connected to the transmitting device through the USB interface, so as to implement intelligent feedback control on the device terminal.
Another object of the present invention is to provide a transmitting device, a receiving device, an information transmission system, an information transmission method, and a multi-terminal collaboration system and collaboration method, wherein the transmitting device includes a control module, where the control module is communicatively connected to the encoding module, and is used to control the encoding module to encode the video and audio signal, so that a user can control whether the encoding module encodes, so as to avoid encoding a signal that is not required to be transmitted, and then transmitting the encoded signal by the communication module, thereby avoiding information leakage, and ensuring information security.
Another object of the present invention is to provide a transmitting device, a receiving device, an information transmission system, an information transmission method, and a multi-terminal collaboration system and collaboration method, where the receiving device can establish wireless connection with devices of different operating systems, so as to receive data information from devices of different operating systems, where the data information is generated by encoding an audio-visual signal generated by each device based on an audio-visual transmission protocol built in the receiving device, so as to improve practicability of the receiving device.
Another object of the present invention is to provide a transmitting device, a receiving device, an information transmission system and an information transmission method, and a multi-terminal cooperative system and a cooperative method, wherein the receiving device includes at least one wireless module, wherein the wireless module is configured with two operation modes, an AP mode and a P2P mode, and when the wireless module is in the AP mode, a device using an ios operating system can be compatible and a wireless connection can be established with the ios device, so as to receive the data information generated by encoding the audiovisual signal from the ios device; when the wireless module is in a P2P mode, the wireless module can be compatible with equipment using an android operating system and can establish wireless connection with the android equipment so as to receive the data information generated by encoding the video and audio signals from the android equipment; the receiving device can establish wireless connection with devices of different operating systems, so that the receiving device can receive the data information from the devices of the different operating systems, and the practicability is improved.
Another object of the present invention is to provide a transmitting apparatus, a receiving apparatus, an information transmission system and an information transmission method, and a multi-terminal cooperative system and a cooperative method, wherein the number of wireless modules is two, wherein one of the wireless modules is set to an AP mode, and a device compatible with an ios operating system can be used to establish a wireless connection with an ios device, so as to receive the data information generated by encoding the video signal from the ios device; the other wireless module is set to be in a P2P mode and can be compatible with equipment using an android operating system, and can establish wireless connection with the android equipment so as to receive the data information generated by encoding the video and audio signals from the android equipment; the two wireless modules can work simultaneously, so that the receiving device can establish wireless connection with devices of different operating systems simultaneously, and therefore data information from the devices of different operating systems can be received, and the practicability is further improved.
Another object of the present invention is to provide a transmitting device, a receiving device, an information transmission system, an information transmission method, and a multi-terminal collaboration system and collaboration method, in which the wireless module works in an AP mode by default, and the wireless module is configured to switch the working mode to a P2P mode when identifying information from a device of an android operating system, so that the wireless module can establish a wireless connection with the android device to receive the data information generated by encoding the audio-visual signal from the android device, so that the wireless module can establish a wireless connection with the ios device and also can establish a wireless connection with the android device, and can receive the data information from devices of different operating systems, thereby further improving practicality.
Another object of the present invention is to provide a transmitting apparatus, a receiving apparatus, an information transmission system, an information transmission method, and a multi-terminal collaboration system and collaboration method, wherein the receiving apparatus includes a decoding module, and the decoding module is communicatively connected to the wireless module and configured to decode the data information received by the wireless module to obtain the audio-visual signal corresponding to the data information.
Another object of the present invention is to provide a transmitting device, a receiving device, an information transmission system, an information transmission method, and a multi-terminal collaboration system and collaboration method, wherein the receiving device includes an audio-visual signal output end, and the receiving device is connected to a device terminal for displaying an audio-visual signal through the audio-visual signal output end, and the audio-visual signal output end is communicatively connected to the decoding module, so as to transmit the audio-visual signal to the device terminal for displaying an audio-visual signal.
Another object of the present invention is to provide a transmitting device, a receiving device, an information transmission system, an information transmission method, and a multi-terminal collaboration system and collaboration method, where the information transmission system is composed of the transmitting device and the receiving device, and is used for delivering video between at least one first terminal and at least one second terminal with corresponding video transmission protocols built therein, where the transmitting device and the receiving device are connected in a wireless communication manner, so as to directly obtain information to be transmitted and transmit the information, and ensure transmission quality and information security, and are compatible with devices of different operating systems, so that the present invention can meet user requirements and good use experiences, and has high practicality.
Another object of the present invention is to provide a transmitting apparatus, a receiving apparatus, an information transmission system, and an information transmission method, and a multi-terminal cooperation system and cooperation method, in which when a plurality of transmitting apparatuses establish wireless connection with the receiving apparatus, a user can control the encoding module of one or more transmitting apparatuses to encode through the control module of the transmitting apparatus, thereby controlling one or more transmitting apparatuses to transmit the data information to the receiving apparatus, so as to avoid mutual interference between information, and to improve user experience feeling.
Another object of the present invention is to provide a transmitting device, a receiving device, an information transmission system, an information transmission method, and a multi-terminal collaboration system and collaboration method, where the receiving device includes a USB interface, where the USB interface is connected to the second terminal, and when the second terminal has a touch screen control function, touch screen control information of the second terminal is transmitted through the USB interface of the receiving device, and is sent to the transmitting device through the wireless module of the receiving device, and is transmitted to the first terminal through the USB interface of the transmitting device, so as to implement a feedback control function for the first terminal, improve practicality of the information transmission system, and correspondingly improve use experience of a user.
Another object of the present invention is to provide a transmitting device, a receiving device, an information transmission system, an information transmission method, and a multi-terminal collaboration system and collaboration method, where the multi-terminal collaboration system can coordinate communication between offline and online, and can integrate and coordinate multiple terminal devices offline, so as to avoid mutual interference between terminal devices, and simultaneously avoid pressure of simultaneous networking of multiple terminal devices on network bandwidth, reduce high dependence on network quality, and have higher practicability.
Another object of the present invention is to provide a transmitting device, a receiving device, an information transmission system, an information transmission method, and a multi-terminal collaboration system and collaboration method, where the multi-terminal collaboration system includes the transmitting device and the receiving device, and can collaborate a first terminal and a second terminal under a line and a remote terminal on the line, so as to reduce high dependence on network quality, and avoid mutual interference between terminal devices, so that the multi-terminal collaboration system can meet a user's use requirement and good use experience, and has high practicability.
According to an aspect of the present invention, there is provided a multi-terminal coordination system for coordinating at least a first terminal and a second terminal under a line and a remote terminal on the line, the multi-terminal coordination system comprising:
At least one transmitting device, wherein the transmitting device comprises an audio-video signal input end, an encoding module, a communication module and a control module, wherein the audio-video signal input end, the communication module and the control module are respectively connected with the encoding module in a communication way, the audio-video signal input end is used for being connected with the first terminal so as to access the audio-video signal of the first terminal from the first terminal, the encoding module is connected with the audio-video signal input end in a communication way and can encode the audio-video signal accessed through the audio-video signal input end to generate data information, so that the first terminal is prevented from installing additional encoding software, and the process of generating the data information by software encoding the audio-video signal through an installed encoding software by a processor of the first terminal is avoided, the control module is connected with the encoding module in a communication way so as to control the encoding module to encode the audio-video signal, the communication module is connected with the encoding module in a communication way, and the communication module is set to send the data information in a wireless way; and
The receiving device is connected with the transmitting device in a wireless communication manner, wherein the receiving device comprises at least one wireless module, a decoding module, an audio-video signal input end, a receiver coding module and a USB interface, wherein the audio-video signal input end is connected with the second terminal, the wireless module receives the data information sent by the communication module of the transmitting device, the decoding module is arranged to decode the data information received by the wireless module to obtain the audio-video signal corresponding to the data information, the audio-video signal output end transmits the audio-video signal to the second terminal, the audio-video signal is displayed by the second terminal, the receiver coding module is arranged to code the audio-video signal, the USB interface is connected to the corresponding networking terminal to transmit the data information from the receiver coding module to the networking terminal so as to avoid the bandwidth pressure caused by the networking of the first terminal and the networking interference generated by the first terminal.
In an embodiment of the present invention, the control module includes an entity control key, the coding module defaults to a sleep state, the control module is configured to control the coding module to perform coding when the entity control key is operated once, and to control the coding module to stop coding when the entity control key is operated once.
In an embodiment of the present invention, the number of the first terminals is plural, the corresponding number of the plurality of the transmission devices are connected to the first terminals, the control module of the transmission device is configured to control the encoding module to encode and occupy a channel between the transmission device and the reception device that are transmitting the data information to the reception device when the entity control key is operated once when the other transmission device is transmitting the data information to the reception device; the entity control key controls the encoding module to encode and transmit the data information to the receiving apparatus simultaneously with the transmitting apparatus which is transmitting the data information to the receiving apparatus when operated once for a long time.
In an embodiment of the invention, wherein the physical control is arranged to be operated in a pressed manner.
In an embodiment of the present invention, the number of the wireless modules is two, wherein one of the wireless modules is set to the AP mode, and wherein the other wireless module is set to the P2P mode.
In an embodiment of the invention, the wireless module is set to two operation modes, namely an AP mode and a P2P mode, wherein the wireless module works in the AP mode by default, and the wireless module is set to switch the operation mode to the P2P mode when identifying information from a device of an android operating system.
In an embodiment of the invention, the transmitting device further includes a USB interface, wherein the USB interface is connected to the first terminal, and the encoding module and the communication module are electrically connected to the USB interface to be electrically powered via the USB interface.
In an embodiment of the invention, the wireless module and the decoding module are electrically connected to the USB interface to be supplied with power via the USB interface.
In an embodiment of the present invention, the second terminal is networked, wherein the second terminal has a touch screen control function, touch screen control information of the second terminal is transmitted via the USB interface of the receiving device and sent via the wireless module, and the communication module of the transmitting device receives the touch screen control information and transmits the touch screen control information to the first terminal via the USB interface of the transmitting device.
In an embodiment of the present invention, the second terminal has a touch screen control function, touch screen control information of the second terminal is transmitted via the audio-visual signal output end of the receiving device and sent via the wireless module, and the communication module of the transmitting device receives the touch screen control information and transmits the touch screen control information to the first terminal via the audio-visual signal input end of the transmitting device.
According to another aspect of the present invention, there is provided a collaboration method for coordinating communication between a first terminal and a second terminal that are off-line and a remote terminal that is on-line, wherein the collaboration method comprises the steps of:
(a) A video signal input end of a transmission device is connected with a video signal generated based on a video transmission protocol built in the first terminal from the first terminal;
(b) A control module of the transmission device controls a coding module to code the video signal to generate data information so as to avoid the first terminal from installing additional coding software, and the process of generating the data information by performing software coding on the video signal by a processor of the first terminal through the installed coding software;
(c) A communication module of the transmission device transmits the data information in a wireless mode;
(d) A wireless module of a receiving device receives the data information;
(e) A decoding module of the receiving device decodes the data information to obtain the video-audio signal corresponding to the data information;
(f) A video signal output end of the receiving equipment transmits the video signal to the second terminal so as to display the video signal through the second terminal;
(g) A receiver encoding module of the receiving device encodes the video signal;
(h) A USB interface of the receiving device is connected to a corresponding networking terminal to transmit data information from the receiver coding module to the networking terminal so as to avoid bandwidth pressure caused by networking of the first terminal and interference generated by networking of the first terminal.
In an embodiment of the present invention, the number of the first terminals is plural, and the corresponding number of the plurality of the transmission devices is connected to the first terminals.
In an embodiment of the invention, before the step (c), the method further comprises the steps of: an entity control key of the control module is operated once, the control module controls the coding module to code, and if other transmitting equipment is transmitting the data information to the receiving equipment at the moment, a channel between the transmitting equipment and the receiving equipment which are transmitting the data information to the receiving equipment is occupied; the entity control key of the control module is operated once for a long time, the control module controls the coding module to code, and if other transmission devices are transmitting the data information to the receiving device, the data information is transmitted to the receiving device simultaneously with the transmission devices transmitting the data information to the receiving device.
In an embodiment of the invention, wherein the physical control is arranged to be operated in a pressed manner.
Further objects and advantages of the present invention will become fully apparent from the following description and the accompanying drawings.
Drawings
Fig. 1 is a schematic block diagram of a transmission apparatus according to an embodiment of the present invention.
Fig. 2 is a block diagram illustrating a receiving apparatus according to an embodiment of the present invention.
Fig. 3 is a block diagram illustrating an information transmission system according to an embodiment of the present invention.
Fig. 4 is a schematic view of a usage scenario of the information transmission system according to the above embodiment of the present invention.
Fig. 5 is a schematic diagram of another usage scenario of the information transmission system according to the above embodiment of the present invention.
Fig. 6 is a schematic block diagram of a multi-terminal collaboration system according to an embodiment of the invention.
Fig. 7 is a schematic view of a usage scenario of the multi-terminal collaboration system according to the above embodiment of the present invention.
Fig. 8 is a schematic diagram of another usage scenario of the multi-terminal collaboration system according to the above embodiment of the present invention.
Detailed Description
The following description is presented to enable one of ordinary skill in the art to make and use the invention. The preferred embodiments in the following description are by way of example only and other obvious variations will occur to those skilled in the art. The basic principles of the invention defined in the following description may be applied to other embodiments, variations, modifications, equivalents, and other technical solutions without departing from the spirit and scope of the invention.
It will be appreciated by those skilled in the art that in the present disclosure, the terms "vertical," "transverse," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," etc. refer to an orientation or positional relationship based on that shown in the drawings, which is merely for convenience of description and to simplify the description, and do not indicate or imply that the apparatus or elements referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore the above terms should not be construed as limiting the present invention.
It will be understood that the terms "a" and "an" should be interpreted as referring to "at least one" or "one or more," i.e., in one embodiment, the number of elements may be one, while in another embodiment, the number of elements may be plural, and the term "a" should not be interpreted as limiting the number.
In the description of the present invention, it should be noted that, unless explicitly specified and limited otherwise, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be either fixedly connected, detachably connected, or integrally connected, for example; can be mechanically connected, electrically connected or can be communicated with each other; can be directly connected or indirectly connected through an intermediate medium, and can be communicated with the inside of two elements or the interaction relationship of the two elements. The specific meaning of the above terms in the present invention can be understood by those of ordinary skill in the art according to the specific circumstances.
The invention provides a transmitting device, a receiving device, an information transmission system and an information transmission method, which can directly acquire information to be transmitted without acquiring the information to be transmitted in a mode of installing an encoding software driving processor on a user equipment terminal for encoding, thereby ensuring transmission quality and information safety, being compatible with devices of different operating systems and having higher practicability.
Referring to fig. 1 of the drawings, a block diagram of a transmission apparatus 10 according to an embodiment of the present invention is shown, wherein the transmission apparatus 10 is used for delivering video and audio of an apparatus terminal having a corresponding video and audio transmission protocol built therein, specifically, the transmission apparatus 10 includes a video and audio signal input terminal 101, an encoding module 102 and a communication module 103, wherein the video and audio signal input terminal 101 is used for connecting with the corresponding apparatus terminal to access video and audio signals generated based on the video and audio transmission protocol built in the apparatus terminal from the apparatus terminal, the encoding module 102 is communicatively connected with the video and audio signal input terminal 101 and is capable of encoding the video and audio signals accessed via the video and audio signal input terminal to generate a data information, so as to avoid installing additional encoding software in the apparatus terminal, and a process of generating the data information by software encoding the video and audio signals with a processor of the apparatus terminal through the installed encoding software, and the communication module 103 is communicatively connected with the encoding module 102 and is configured to wirelessly transmit the data information.
It should be noted that, the audio/video signal input terminal 101 is a port that can be directly used for transmitting the audio/video signal, for example, the audio/video signal input terminal 101 may be implemented as a high-definition multimedia interface (HDMI interface), a Type-C interface supporting audio/video signal transmission, etc., which is not limited in this invention.
Specifically, the transmitting device 10 accesses, from the device terminal, the audio-video signal generated based on the audio-video transmission protocol built in the device terminal based on the audio-video signal input terminal 101, without acquiring the data information generated after encoding the audio-video signal by installing encoding software on the device terminal to drive the processor of the device terminal, thereby avoiding the situations of reduced definition, reduced tone quality and the like of the audio-video signal after the audio-video signal is encoded by the processor of the device terminal.
Further, the transmitting device 10 may directly access the audio-video signal on the device terminal based on the audio-video signal input terminal 101 without obtaining the data information generated by encoding the audio-video signal by installing an encoding software on the device terminal to drive the device terminal processor, in other words, when the transmitting device 10 accesses the audio-video signal on the device terminal, no software is required to be installed on the device terminal, thereby avoiding the risk of information leakage caused by installing software on the device terminal, ensuring information security, saving time consumed by installing software when a user uses, and further improving timeliness of information transmission.
It should be noted that the transmitting device 10 encodes the video and audio signal by using the encoding module 102 without using a processor of a device terminal, so that the phenomena that the processor of some devices is weak and cannot perform rapid encoding processing, or the system is blocked, downtime, etc. during the encoding processing process, so that information cannot be transmitted, etc. are avoided, that is, the transmitting device 10 has no excessively high requirement on the performance of the device terminal, and has wide adaptability and higher practicability.
In particular, the encoding module 102 encodes the video and audio signals based on a dedicated encoding processor, and the encoding performance of the dedicated encoding processor on the video and/or audio signals is far superior to that of a general purpose processor, in other words, the dedicated encoding processor is superior to that of the general purpose processor in terms of encoding quality and encoding efficiency, so that the encoding module 102 can ensure the definition of the video and the image quality, and particularly ensure the fluency and definition of the dynamic video when encoding the video and audio signals, so that the transmitting device 10 can ensure the quality and fluency of the video and audio signals, thereby giving users a good experience.
And, the transmitting device 10 encodes the video signal through the encoding module 102, thereby avoiding installing additional encoding software on the device terminal, and performing software encoding on the video signal through the installed encoding software by using the processor of the device terminal to generate the data information, so as to avoid the risk of information leakage caused by installing the encoding software on the device terminal and save the time consumed by installing the encoding software, thereby giving the user a good use experience.
It should be noted that, the communication module 103 of the transmission device 10 sends the data information generated by encoding the video signal by the encoding module 102 in a wireless manner, so as to avoid the defects of difficult wiring, high wiring cost, increased maintenance and repair costs caused by being unfavorable for maintenance and repair due to the wired transmission manner, and reduce the use cost of the transmission device 10, so that a user can use the transmission device 10 conveniently and rapidly, and further improve the practicability of the transmission device 10.
Further, the transmitting device 10 further includes a control module 104, where the control module 104 is communicatively connected to the encoding module 102 to control the encoding module 102 to encode the video signal, so that a user can control whether the encoding module 102 encodes the video signal, so as to avoid encoding a signal that is not required to be transmitted and then transmitting the encoded signal to the communication module 103, so that the user can control encoding of the encoding module 102, so as to avoid transmitting information that is not required to be transmitted, so as to avoid information leakage, and further ensure information security.
It should be noted that, in some embodiments of the present invention, the control module 104 is communicatively connected to the communication module 103 to control the communication module 103 to send information, that is, the encoding module 102 encodes the audio-visual signal in real time to generate the data information, and the control module 104 controls whether the communication module 103 sends the data information, so as to achieve the control of whether the communication module 103 sends information by a user, so as to avoid information leakage and ensure information security.
Specifically, the control module 104 includes an entity control key 1041, and the user controls the encoding module 102 to perform encoding by operating the entity control key 1041, or controls the encoding module 102 to stop encoding by operating the entity control key 1041, specifically, the encoding module 102 defaults to a dormant state, i.e. a state of not performing encoding, so as to reduce the power consumption of the transmitting device 10, and controls the encoding module 102 to perform encoding by operating the entity control key 1041 once, and controls the encoding module 102 to stop encoding by operating the entity control key 1041 once again, so that the user can control the encoding of the encoding module 102, thereby avoiding sending information that is not needed to be sent, avoiding information leakage, and guaranteeing information security.
It should be noted that, in this embodiment of the present invention, the entity control key 1041 is configured to be operated in a pressing manner, that is, the encoding module 102 defaults to a dormant state, the control module 104 is configured to control the encoding module 102 to encode when the entity control key 1041 is pressed once, and control the encoding module 102 to stop encoding when the entity control key 1041 is pressed once again, so as to enable a user to control encoding of the encoding module 102, thereby avoiding sending information that would not need to be sent, avoiding information leakage, and guaranteeing information security.
In particular, in some embodiments of the present invention, the physical control key 1041 is configured to be operated in a touch manner, and the present invention is not limited thereto, wherein the encoding module 102 defaults to a dormant state, i.e. a state of not encoding, and a user controls the encoding module 102 to encode by touching the physical control key 1041 once, and controls the encoding module 102 to stop encoding by touching the physical control key 1041 once again, so that the user can control the encoding of the encoding module 102, thereby avoiding that information that will not need to be transmitted is transmitted, avoiding information leakage, and guaranteeing information security.
It should be noted that, in other embodiments of the present invention, the encoding module 102 may be configured to allow control in a wireless manner, which is not limited by the present invention, the user sends an instruction to the communication module 103 in a wireless manner, and the communication module 103 transmits an instruction to the encoding module 102 to implement control of encoding or stopping encoding of the encoding module 102, so that the user can control encoding of the encoding module 102, thereby avoiding sending information that does not need to be sent, avoiding information leakage, and thus ensuring information security.
Further, the transmitting device 10 further includes a USB interface 105, where the encoding module 102 and the communication module 103 are electrically connected to the USB interface 105, so as to be electrically connected to a device terminal based on the USB interface 105, where in a state where the USB interface 105 is connected to the device terminal, the communication module 103 is configured to allow receiving external control information, and the corresponding control information received by the communication module 103 is returned to the device terminal through the USB interface 105, so as to control the device terminal in a feedback manner, so as to implement intelligent feedback control on the device terminal, thereby further improving practicality and intelligent control level of the transmitting device 10.
It should be noted that, when the audio/video signal input terminal 101 is implemented as a Type-C interface supporting audio/video signal transmission, the encoding module 102 and the communication module 103 are further electrically connected to the audio/video signal input terminal 101, the encoding module 102 and the communication module 103 may be electrically connected to the audio/video signal input terminal 101, so as to improve the convenience of use of the transmitting device 10, in particular, the audio/video signal input terminal 101 is communicatively connected to the communication module 103, and the communication module 103 is configured to allow receiving external control information, where in a state where the audio/video signal input terminal 101 is connected to a device terminal, the corresponding control information received by the communication module 103 is returned to the device terminal via the audio/video signal input terminal 101, so as to implement intelligent control back to the device terminal, thereby further improving the practicality and intelligent control level of the transmitting device 10.
In particular, in some embodiments of the present invention, a user may control whether the encoding module 102 of the transmitting device 10 encodes the audio/video signal by transmitting a software instruction through the USB interface 105 of the transmitting device 10 via a device terminal, so that the user can control the encoding of the encoding module 102, thereby avoiding that information that will not need to be transmitted is transmitted, avoiding information leakage, and guaranteeing information security, which is not limited in the present invention.
Referring further to fig. 2 of the drawings, a block diagram of a receiving device 20 according to an embodiment of the present invention is illustrated, wherein the receiving device 20 is configured to send a corresponding audio/video signal to a device terminal connected thereto, the receiving device 20 includes at least one wireless module 201, a decoding module 202, and an audio/video signal output terminal 203, wherein the wireless module 201 is configured to receive data information generated by encoding the corresponding audio/video signal, the decoding module 202 is communicatively connected to the wireless module 201, and is configured to decode the data information received by the wireless module 201 to obtain the audio/video signal corresponding to the data information, the audio/video signal output terminal 203 is communicatively connected to the decoding module 202, the audio/video signal output terminal 203 is configured to be connected to the device terminal to transmit the audio/video signal to the device terminal, and the receiving device 20 is configured to establish a wireless connection with devices of different operating systems, so as to be able to receive the data information generated by encoding the audio/video signal of the devices of the different operating systems, so as to enhance the practicality of the receiving device 20.
It should be noted that, the wireless module 201 is configured with two working modes, i.e., an AP mode and a P2P mode, and when the wireless module 201 is in the AP mode, the wireless module is compatible with a device using the ios operating system and is capable of establishing a wireless connection with the ios device, so as to receive the data information generated by encoding the video and audio signal from the ios device; when the wireless module 201 is in the P2P mode, the device using the android operating system can be compatible, and a wireless connection can be established between the wireless module 201 and the android device, so as to receive the data information generated by encoding the video and audio signal from the android device; the receiving device 20 can establish wireless connection with devices of different operating systems, so that the data information generated by encoding the video and audio signals from the devices of different operating systems can be received, and the practicability is improved.
Specifically, the number of the wireless modules 201 is two, wherein one wireless module 201 is set to be in an AP mode, and can be compatible with a device using the ios operating system to establish a wireless connection with the ios device so as to receive the data information from the ios device; wherein the other wireless module 201 is set to P2P mode and is compatible with a device using the android operating system, and is capable of establishing a wireless connection with the android device to receive the data information from the android device; wherein two of the wireless modules 201 can work simultaneously so that the receiving device 20 can establish wireless connection with devices of different operating systems simultaneously, thereby being capable of receiving the data information from the devices of different operating systems, and further improving practicality.
In particular, in some embodiments of the present invention, the number of the wireless modules 201 is one, where the wireless modules 201 operate in the AP mode by default, and are capable of establishing a wireless connection with the ios device by being compatible with a device using the ios operating system, so as to receive the data information from the ios device, the wireless modules 201 are configured to switch the operation mode to the P2P mode when identifying the information from the device of the android operating system, so that the wireless modules 201 can establish a wireless connection with the android device to receive the data information from the android device, so that the wireless modules 201 can establish a wireless connection with both the ios device and the android device, that is, the receiving device 20 can establish a wireless connection with a device of a different operating system, so as to receive the data information from a device of a different operating system, thereby improving the practicality.
It should be noted that the wireless module 201 may simultaneously establish wireless connection with a plurality of external devices, and the wireless module 201 may simultaneously receive the data information of the plurality of external devices, so as to maintain a good user experience of the receiving device 20.
In particular, the receiving apparatus 20 further includes a network cable interface for connecting to an external network, so that when the receiving apparatus 20 establishes a wireless connection with an external apparatus, the receiving apparatus 20 can provide a network for the external apparatus, so that the external apparatus can use the network while establishing a wireless connection with the receiving apparatus 20, further improving the practicality of the receiving apparatus 20.
Further, the receiving device 20 further includes a USB interface 204, where the USB interface 204 is connected to a device terminal connected to the receiving device 20, where the wireless module 201 and the decoding module 202 are electrically connected to the USB interface 204 to be stably supplied with power via the USB interface 204, where the wireless module 201 is further communicatively connected to the USB interface 204, where in a state where the USB interface 204 is connected to the device terminal, the USB interface 204 may access control information of the device terminal, and send the control information to an external device that establishes a wireless connection with the wireless module 201 via the wireless module 201, so as to implement intelligent feedback control of the external device, further improving practicality and intelligent control level of the receiving device 20, where communication connection between the wireless module 201 and the USB interface 204 is limited to transmitting the control information of the device terminal received by the USB interface 204 in a wireless manner via the wireless module 201.
It should be noted that, the audio/video signal output terminal 203 of the receiving device 20 is a port that can be directly used for transmitting the audio/video signal, for example, the audio/video signal output terminal 203 may be implemented as a high-definition multimedia interface (HDMI interface), a Type-C interface supporting audio/video signal transmission, etc., which is not limited by the present invention.
In particular, when the audio/video signal output terminal 203 of the receiving device 20 is implemented as a Type-C interface supporting audio/video signal transmission, the wireless module 201 and the decoding module 202 are further electrically connected to the audio/video signal output terminal 203, the audio/video signal output terminal 203 is connected to the device terminal to stably supply power to the wireless module 201 and the decoding module 202, it is worth mentioning that the wireless module 201 is communicatively connected to the audio/video signal output terminal 203, the audio/video signal output terminal 203 can access control information of the device terminal and send the control information to an external device that establishes wireless connection with the wireless module 201 via the wireless module 201, so as to realize intelligent feedback control to the external device, and further improve the practicality and intelligent control level of the receiving device 20.
Further, referring to fig. 1 to 3 of the drawings, an information transmission system according to an embodiment of the present invention is illustrated, wherein the information transmission system is used for delivering audio and video between at least one first terminal 10 and at least one second terminal 10 with corresponding audio and video transmission protocols, and the information transmission system can directly acquire audio and video signals to be transmitted and encode the audio and video signals into a data message for transmission, and simultaneously ensure transmission quality and information security, and can be compatible with devices of different operating systems, thereby meeting user requirements and good use experience, and having higher practicability.
Specifically, the information transmission system includes at least one transmitting device 10 and at least one receiving device 20, where the transmitting device 10 is connected to the first terminal 30, so as to access, from the first terminal 30, the audio/video signal generated based on the audio/video transmission protocol built in the first terminal 30, encode and generate the data information, and then send the data information in a wireless manner, where the receiving device 20 is connected to the second terminal 40, the transmitting device 10 is connected to the receiving device 20 in a wireless manner and communicatively, and the receiving device 20 receives and decodes the data information to obtain the audio/video signal corresponding to the data information, and then transmits the audio/video signal to the second terminal 40, so as to implement delivery between the first terminal 30 and the second terminal 40.
Further, the transmitting device 10 is connected to the first terminal 30 through the audio-video signal input end 101 of the transmitting device 10, the receiving device 20 is connected to the second terminal 40 through the audio-video signal output end 203 of the receiving device 20, wherein the audio-video signal input end 101 of the transmitting device 10 is used to connect to the first terminal 30, so as to access the audio-video signal generated based on the audio-video transmission protocol built in the first terminal 30 from the first terminal 30, and after the data information is produced by encoding through the encoding module 102, the data information is sent in a wireless manner through the encoding module 103, so that additional encoding software is not installed in the first terminal 30, and a process of generating the data information by performing software encoding on the audio-video signal through the installed encoding software by a processor of the first terminal 30 is implemented, wherein the wireless module 201 of the receiving device 20 receives the data information sent by the communication module 103 of the transmitting device 10, decodes the data information into the audio-video signal corresponding to the audio-video signal through the decoding module 202, and sends the audio-video signal to the second terminal 40 through the second terminal 40, so as to achieve the transmission between the second terminal 40 and the receiving device 40.
In particular, the control module 104 of the transmitting device 10 is communicatively connected to the encoding module 102 to control the encoding module 102 to encode the video and audio signal, so as to enable a user to control whether the encoding module 102 encodes the video and audio signal, so as to avoid encoding a signal that is not required to be transmitted and then transmitting the encoded signal to the communication module 103, so as to enable the user to control the encoding module 102, so as to avoid transmitting the data information that is not required to be transmitted and then receiving the data information by the receiving device 20 and transmitting the data information to the second terminal 40, so as to avoid information leakage and further ensure information security.
It should be noted that the number of the first terminals 30 may be plural, and the corresponding number of the transmitting devices 10 having the number corresponding to the number of the first terminals 30 may be connected to the first terminals 30, and the receiving device 20 may simultaneously establish wireless connection with the plural transmitting devices 10, and may simultaneously acquire information transmitted by the plural transmitting devices 10, so as to implement audio-visual delivery between the second terminal 40 and the plural first terminals 30, and improve efficiency, so as to improve practicability of the information transmission system.
Particularly, the transmitting device 10 is connected with the first terminal 30 through the audio-video signal input end 101 of the transmitting device 10, the transmitting device 10 can directly access the audio-video signal on the first terminal 30 based on the audio-video signal input end 101, the data information generated after the audio-video signal is encoded is obtained without installing encoding software on the first terminal 30 to drive the processor of the first terminal 30, the situations that the audio-video signal has reduced definition and reduced tone quality after the audio-video signal is encoded by the processor of the first terminal 30 are avoided, meanwhile, the time delay generated by the processor of the first terminal 30 during encoding is avoided by directly obtaining the audio-video signal on the first terminal 30, so that the timeliness and fluency of audio-video delivery are improved, the transmitting device 10 does not need to install software on the first terminal 30 when accessing the audio-video signal on the first terminal 30, the situation that the audio-video signal is lost on the first terminal 30 is avoided, the time consumption of the audio-video signal is ensured, the user is further ensured, and the user experience is further improved.
It should be noted that, the transmitting device 10 encodes the video signal by using the encoding module 102, and does not need to encode by using the processor of the first terminal 30, so that the phenomena that the processor performance of some devices is weak and the fast encoding process cannot be performed, and the phenomena that the system is stuck and down in the encoding process cannot perform video delivery and the like are avoided, that is, even if the first terminal 30 is a older product, the processor performance is weak, the video delivery can be performed by using the information transmission system and the second terminal 40, so that the information transmission system has wide adaptability and higher practicability.
Further, the wireless module 201 of the receiving device 20 set to the AP mode establishes a wireless connection with the communication module 103 of the transmitting device 10, or the wireless module 201 of the receiving device 20 establishes a wireless connection with the communication module 103 of the transmitting device 10 in the working mode set to the AP to receive the data information sent by the transmitting device 10, so as to implement the audio-visual delivery between the first terminal 30 and the second terminal 40.
It should be noted that the conventional devices using the ios system use the AirPlay protocol, that is, the wireless module 201 or the wireless module 201 set to the AP mode can establish a wireless connection with the devices using the ios system in the operation mode set to the AP, and the wireless module 201 set to the AP mode of the receiving device 20 can establish a wireless connection with the communication module 103 of the transmitting device 10 at the same time, or the wireless module 201 of the receiving device 20 can establish a wireless connection with the communication module 103 of the transmitting device 10 in the operation mode set to the AP, and can also establish a wireless connection with the devices using the ios operation system, such as a mobile phone, a tablet computer, etc. using the ios operation system, so that the receiving device 20 can also receive the data information generated after the audio-video signal of the devices using the ios operation system is encoded, and can decode the data information of the devices using the ios operation system into the audio-video signal corresponding to the data information and transmit the audio-video signal to the second terminal 40, thereby further improving the practical transmission of the system.
In addition, it should be noted that the existing device using the android system uses miracast protocols, the wireless module 201 of the receiving device 20 set to the P2P mode can establish a wireless connection with the device using the android system, or the wireless module 201 of the receiving device 20 is set to convert the working mode into the P2P mode and can establish a wireless connection with the device using the android system, so that the receiving device 20 can also establish a wireless connection with the device using the android system, for example, a mobile phone, a tablet computer or the like using the android operating system, so that the receiving device 20 can also receive the data information generated by encoding the audio-visual signals of the mobile phone and the tablet computer using the android operating system, and decode the data information of the mobile phone and the tablet computer into the audio-visual signals corresponding to the data information to be transmitted to the second terminal 40, in other words, the receiving device 20 can establish a wireless connection with the device using the different operating system, thereby being capable of receiving the audio-visual signals from the device using the different operating system, further improving the data information transmission system and the compatibility of the device using the different operating system and the practical system.
Also, when the number of the wireless modules 201 is two, that is, one of the wireless modules 201 is set to the AP mode and the other wireless module 201 is set to the P2P mode, the two wireless modules 201 can operate simultaneously so that the receiving apparatus 20 can establish wireless connection with apparatuses of different operating systems at the same time, thereby being capable of receiving the data information from apparatuses of different operating systems, and further the practicality of the information transmission system.
Further, the transmitting device 10 and the receiving device 20 are further connected to the first terminal 30 and the second terminal 40 through the USB interface 105 of the transmitting device 10 and the USB interface 204 of the receiving device 20, respectively, so that on one hand, a power source can be obtained based on the USB interface, and on the other hand, when the second terminal 40 has a touch screen control function, touch screen control information can be transmitted through the USB interface 204 of the receiving device 20 and sent to the transmitting device 10 through the wireless module 201 of the receiving device 20, and transmitted to the first terminal 30 through the USB interface 105 of the transmitting device 10, so that a feedback function to the first terminal 30 is achieved, and the practicability of the information transmission system is improved.
For example, the second terminal 40 used in the meeting is usually a display screen with a touch screen control function, the first terminal 30 used is usually a notebook computer, when the user uses the information transmission system to transmit the video signal of the notebook computer to the display screen for display, the user is usually used to directly perform operations on the display screen, such as page changing operation, on the one hand, the direct operation on the display screen is more convenient, on the other hand, when the user stands directly near the display screen for explanation of the display content, the user does not need to often return to the position where the notebook computer is located for page changing and the like to interrupt the process, when the user performs operations on the display screen, the information of the operation is transmitted through the USB interface 204 of the receiving device 20 and is transmitted to the transmitting device 10 through the USB interface 105 of the transmitting device 10, so as to realize switching of the content on the notebook computer, such as page changing of pictures, playing of videos, suspending, and the like, that is convenient for the user to use the notebook computer, and the convenience of the user is improved.
Particularly, when the audio/video signal input terminal 101 of the transmitting device 10 is implemented as a Type-C interface supporting audio/video signal transmission, and when the audio/video signal output terminal 203 of the receiving device 20 is implemented as a Type-C interface supporting audio/video signal transmission, the second terminal 40 may further transmit touch screen control information through the audio/video signal output terminal 203 of the receiving device 20 and send the touch screen control information to the transmitting device 10 through the wireless module 201 of the receiving device 20, and transmit the touch screen control information to the first terminal 30 through the audio/video signal input terminal 101 of the transmitting device 10, so as to implement a feedback function to the first terminal 30, thereby improving the practicability of the information transmission system.
Further, when the number of the first terminals 30 is plural, the corresponding number of the transmission apparatuses 10 are connected to the first terminals 30, and a user can selectively implement the transmission of the data information by one or more of the transmission apparatuses 10 to the reception apparatus 20 by controlling the encoding of the encoding module 102 through the control module 104 of the transmission apparatus 10, specifically, the encoding module 102 defaults to a sleep state, i.e., a state of not going into encoding, the user controls the encoding module 102 to encode by operating the entity control key 1041 once, and controls the encoding module 102 to stop encoding by operating the entity control key 1041 once again, When the coding module 102 of one of the transmitting devices 10 is in a coding state, i.e. one of the transmitting devices 10 is transmitting the data information to the receiving device 20, the user controls the other of the transmitting devices 10 to transmit the data information to the receiving device 20 by controlling the physical control key 1041 of the other of the transmitting devices 10, in particular, wherein the control module 104 is arranged to control the coding module 102 to code and occupy a channel between the transmitting device 10 and the receiving device 20 that are transmitting the data information to the receiving device 20 when the user operates the physical control key 1041 once, thereby effecting a handover of the transmitting device 10 transmitting the data information to the receiving device 20; Wherein the control module 104 is configured to control the encoding module 102 to encode and transmit the data information to the receiving apparatus 20 simultaneously with the transmitting apparatus 10 transmitting the data information to the receiving apparatus 20 when the user operates the entity control key 1041 once for a long time, that is, a plurality of the transmitting apparatuses 10 simultaneously transmit the data information to the receiving apparatus 20, wherein the long time operation is a continuous uninterrupted operation of the entity control key 1041 by the user for more than 5 seconds, and the duration of the long time operation can be flexibly adjusted according to actual use requirements, Such as continuous operation once for more than 3 seconds, continuous operation once for more than 4 seconds, etc., without limitation; Such that a user can control whether the transmitting device 10 transmits the data information to the receiving device 20 via the entity control key 1041 of the control module 104, and realize how the data information is transmitted with the receiving device 20 among the plurality of transmitting devices 10, realize that one of the transmitting devices 10 among the plurality of transmitting devices 10 transmits the data information to the receiving device 20, or that several or all of the transmitting devices 10 among the plurality of transmitting devices 10 transmit the data information to the receiving device 20, realize that transmission of information is selective, That is, one or more of the transmitting devices 10 selectively transmit the data information to the receiving device 20, thereby avoiding mutual interference between the information, to give a user a good feeling of use, and further improving the practicality of the information transmission system.
Specifically, in this embodiment of the present invention, the entity control key 1041 is configured to be operated in a pressing manner, wherein the entity control key 1041 is operated once, and the entity control key 1041 is operated once for a long time, that is, the entity control key 1041 is pressed once for a long time, and in particular, in some embodiments of the present invention, the entity control key 1041 is configured to be operated in a touching manner, and a user achieves the purpose of operation by touching the entity control key 1041, which is not limited in the present invention.
Further, wherein when the number of the second terminals 40 is plural, the corresponding number of the receiving devices 20 are connected to the second terminals 40, the plurality of the receiving devices 20 can simultaneously receive the data information transmitted by the same transmitting device 10, in other words, the wireless modules 201 of the plurality of the receiving devices 20 receive the data information transmitted by the communication module 103 of the transmitting device 10 and decode the data information into the video signal corresponding to the data information through the decoding module 202, and the video signal is transmitted to the second terminals 40 through the video signal output terminal 203 of the receiving device 20, so that the video signal of the first terminal 30 is transmitted to the plurality of the second terminals 40, so that the information transmission efficiency is improved, and the practicability of the information transmission system is further improved.
That is, the information transmission system can directly access the audio-visual signal on the first terminal 30 to be transmitted to the second terminal 40 through processing, and simultaneously ensure transmission quality and information security, and can be compatible with devices of different operating systems, and can transmit the audio-visual signal of the devices of different operating systems, and simultaneously can realize touch screen feedback control on the second terminal 40 and the first terminal 30, so that the information transmission system can meet the use requirement of a user and give good use experience to the user, and has higher practicability.
Further, the present invention also provides an information transmission method for delivering audio/video between at least one first terminal 30 and at least one second terminal 40 with corresponding audio/video transmission protocols, wherein the information transmission method comprises the following steps:
(a) A video signal input terminal 101 of a transmitting device 10 accesses a video signal generated based on a video transmission protocol built in the first terminal 30 from the first terminal 30;
(b) A control module 104 of the transmitting device 10 controls an encoding module 102 to encode the video signal to generate a data message, so as to avoid installing additional encoding software on the first terminal 30, and performing software encoding on the video signal by a processor of the first terminal 30 through the installed encoding software to generate the data message;
(c) A communication module 103 of the transmitting device 10 transmits the data information in a wireless manner;
(d) A wireless module 201 of a receiving apparatus 20 receives the data information;
(e) A decoding module 202 of the receiving device 20 decodes the data information to obtain the video signal corresponding to the data information;
(f) An audio/video signal output terminal 203 of the receiving device transmits the audio/video signal to the second terminal.
In particular, in this embodiment of the present invention, in which the number of the first terminals 30 is plural, a corresponding number of the plurality of the transmission apparatuses 10 are connected to the first terminals 30.
It is worth mentioning that in this embodiment of the present invention, the following steps are further included before said step (c): the control module 104 controls the encoding of the encoding module 102 to selectively enable one or more of the transmitting devices 10 to transmit the data information to the receiving device 20.
Further, in this embodiment of the present invention, wherein the information transmission method further includes the steps of:
(g) A USB interface 204 of the receiving apparatus 20 accesses the touch screen control information of the second terminal 40;
(h) The wireless module 201 wirelessly transmits the touch screen control information;
(i) The communication module 103 of the transmitting device 10 receives the touch screen control information sent by the wireless module 201 of the receiving device 20;
(j) A USB interface 105 of the transmitting device 10 transmits the touch control information to the first terminal 30, so as to implement the feedback control of the first terminal 30.
In particular, in some embodiments of the present invention, wherein the information transmission method further comprises the steps of:
(g) The audio/video signal output terminal 203 of the receiving device 20 is connected to the touch screen control information of the second terminal 40;
(h) The wireless module 201 wirelessly transmits the touch screen control information;
(i) The communication module 103 of the transmitting device 10 receives the touch screen control information sent by the wireless module 201 of the receiving device 20;
(j) The audio/video signal input terminal 101 of the transmitting device 10 transmits the touch screen control information to the first terminal 30, so as to implement the feedback control of the first terminal 30.
As shown in fig. 4, which is a drawing of the specification of the present invention, a use scenario of the information transmission system according to the above embodiment of the present invention is illustrated, in this example, the use scenario of the information transmission system is a conference site, specifically, the first terminal 30 is implemented as a notebook 301 of a participant, the second terminal 40 is implemented as a presentation screen 401 of a conference room, the number of notebook 301 is plural, the transmitting device 10 corresponding to the number of notebook 301 is connected to the notebook 301 through the audio/video signal input terminal 101 of the transmitting device 10, the receiving device 20 is connected to the presentation screen 401 through the audio/video signal output terminal 203 of the receiving device 20, the transmitting device 10 is connected to the notebook 301 through the audio/video signal input terminal 101 of the transmitting device 10 to access the audio/video signal generated based on the audio/video transmission protocol in the notebook 301 from the notebook 301, the audio/video signal is encoded by the encoding module 102 to generate the communication data 103, the audio/video signal is shared with the audio/video signal of the receiving device 103 through the receiving device 10, the audio/video signal is decoded by the receiving device 20 through the decoding module 201 and is implemented by the audio/video signal receiving device 201 and the video signal of the receiving device 20 through the receiving device 101 to realize the video/video signal sharing module 401 at the video signal receiving device, and the video signal receiving device 401 is realized as the video signal of the receiving device.
It should be noted that, the information transmission system not only can display the information on a plurality of notebook computers 301 on the display screen 401 at the same time, but also can selectively select one or more notebook computers 301 to display the information on the display screen 401, so as to realize the transmission of the information with selectivity, thereby avoiding the mutual interference between the information, maintaining good conference order and ensuring conference effect.
Specifically, in this example, the coding module 102 defaults to a dormant state, i.e. a state in which coding is not performed, and the participant controls the coding module 102 to perform coding by operating the entity control key 1041 once and controls the coding module 102 to stop coding by operating the entity control key 1041 once again, so as to achieve control of whether the participant performs coding on the transmission device 10 and thus whether the transmission device 10 transmits the data information, when the coding module 102 of one transmission device 10 is in a coding state, i.e. when one transmission device 10 is transmitting the data information to the reception device 20, the user controls the other transmission device 10 to transmit the data information to the reception device 20 by controlling the entity control key 1041 of the other transmission device 10, specifically, wherein the control module 104 is configured to perform coding by controlling the coding module 102 and occupy the transmission device 10 transmitting the data information to the reception device 20 when the user operates the entity control key 1041 once, thereby achieving switching between the transmission device and the reception device 20; wherein the control module 104 is configured to control the encoding module 102 to encode and transmit the data information to the receiving apparatus 20 simultaneously with the transmitting apparatus 10 transmitting the data information to the receiving apparatus 20 when the user operates the entity control key 1041 once for a long time, i.e., a plurality of the transmitting apparatuses 10 transmit the data information to the receiving apparatus 20 simultaneously, so as to selectively realize one or more of the transmitting apparatuses 10 to transmit the data information to the receiving apparatus 20, on one hand, avoid that information which does not need to be displayed on the display screen 401 after being transmitted, so as to avoid information leakage, ensure information security, and on the other hand, avoid mutual interference between the information, so as to maintain good conference order and ensure conference effect.
In particular, the mobile device 302 of the participant, such as a mobile phone or a tablet computer, may also establish a wireless connection with the receiving device 20, so that information on the mobile phone or the tablet computer of the participant may also be displayed on the display screen 401 to realize sharing and displaying of content, so as to avoid that when the participant does not have the notebook 301 or needs to use the mobile phone or the tablet computer to display, information may also be displayed on the display screen 401, the receiving device 20 may establish a wireless connection with the mobile phone or the tablet computer of different operating systems, specifically, the wireless module 201 is configured with two working modes, namely an AP mode and a P2P mode, and when the wireless module 201 is in the AP mode, the wireless module 201 may be compatible with a device using the ios operating system and may establish a wireless connection with the ios device to receive the data information generated by encoding the audio/video signal from the ios device; when the wireless module 201 is in the P2P mode, the device using the android operating system can be compatible, and a wireless connection can be established between the wireless module 201 and the android device, so as to receive the data information generated by encoding the audio-visual signal from the android device; therefore, the data information on the mobile phone or the tablet personal computer from different operating systems can be received, the compatibility and the adaptability of the information transmission system to different devices are further improved, the requirements of meeting development on the devices are reduced, the meeting development is more convenient and rapid, and good meeting device experience is provided for the participants.
And, the network cable interface of the receiving device 20 enables the receiving device 20 to connect to an external network, so that when a device such as a mobile phone or a tablet computer of a participant establishes a wireless connection with the receiving device 20, the receiving device 20 can provide a network for the mobile phone or the tablet computer of the participant, so that the mobile phone or the tablet computer of the participant can use the network while establishing the wireless connection with the receiving device 20, for example, the participant can query information through the network by using the mobile phone or the tablet computer, and the queried content is transmitted to the display screen 401 through the receiving device 20 to be shared, so that a good conference device experience is given to the participant, and the practicability of the receiving device 20 is further improved.
It should be noted that, in this example scenario, the display screen 401 of the conference room has a touch screen control function, the transmitting device 10 and the receiving device 20 are further connected with the notebook 301 and the display screen 401 through the USB interface 105 of the transmitting device 10 and the USB interface 204 of the receiving device 20, respectively, so that on one hand, power supply can be realized, on the other hand, when the participant performs a touch screen control operation on the display screen 401, the touch screen control information of the operation is transmitted through the USB interface 204 of the receiving device 20, and is transmitted to the transmitting device 10 through the wireless module 201 of the receiving device 20, and is transmitted to the notebook 301 through the USB interface 105 of the transmitting device 10, so that switching of contents on the notebook 301, such as page changing of a picture, playing and suspending of a video, can be realized, that is, the operation experience and convenience of the participant are improved, and the participant can conveniently perform a display on the conference, and a good conference experience is provided for the participant.
It should be further noted that, when the video signal input terminal 101 of the transmitting device 10 is implemented as a Type-C interface supporting audio/video signal transmission, and when the video signal output terminal 203 of the receiving device 20 is implemented as a Type-C interface supporting audio/video signal transmission, when a participant performs a touch screen control operation on the display screen 401, the touch screen control information of the operation is transmitted through the video signal output terminal 203 of the receiving device 20 and is sent to the transmitting device 10 through the wireless module 201 of the receiving device 20, and is transmitted to the notebook computer 301 through the video signal input terminal 101 of the transmitting device 10, so as to realize switching of contents on the notebook computer 301, such as page changing of a picture, playing, suspending, and the like, i.e. control back to the notebook computer 301, thereby improving the operation experience and use convenience of the participant, facilitating the participant to do the display on the conference, and providing the participant with good conference device experience.
It should be noted that, in some scenarios, the conference room is a large conference room and needs multiple display screens 401, the information transmission system may use a corresponding number of multiple receiving devices 20 to connect with the display screens 401, the multiple receiving devices 20 may receive the data information sent by the same transmitting device 10 at the same time, so as to display the same display information on the multiple display screens 401, so as to adapt to the large conference room, further improve the practicability of the present invention, and when one display screen 401 or multiple display screens 401 in the conference room have a touch screen control function, a participant may select one of the display screens 401 having the touch screen control function to perform a touch screen control operation, and the touch screen control information of the operation is transmitted through the USB interface 204 of the receiving device 20 and is sent to the transmitting device 10 via the wireless module 201 of the receiving device 20 and is transmitted to the notebook computer 301 through the USB interface 105 of the transmitting device 10, so as to realize switching of the notebook computer 301, i.e. playback of the contents, i.e. pause and pause of the notebook computer 301; or when one display screen 401 or a plurality of display screens 401 in the conference room have a touch screen control function, a participant can select one of the display screens 401 having the touch screen control function to perform touch screen control operation, the operated touch screen control information is transmitted through the video/audio signal output end 203 of the receiving device 20 and is sent to the transmitting device 10 through the wireless module 201 of the receiving device 20, and is transmitted to the notebook computer 301 through the video/audio signal input end 101 of the transmitting device 10, so that switching of contents on the notebook computer 301, such as page changing of a picture, playing, suspending and the like, is realized, namely, the playback of the notebook computer 301 is realized, thereby improving the operation experience and the use convenience of the participant, facilitating the participant to perform display in the conference, giving the participant good conference device experience, and further improving the practicability of the invention.
In other scenarios, the second terminal 40 is implemented as a projector of a conference room, where the receiving device 20 receives the data information sent by the transmitting device 10, decodes the data information into the audio-visual signal corresponding to the data information, and transmits the audio-visual signal to the projector through the audio-visual signal output terminal 203 of the receiving device 20, and the projector projects the audio-visual signal to a designated area, so as to enable information on the notebook 301 to be projected, so as to enable sharing and displaying of conference content, which is not limited by the present invention.
As an example, referring specifically to fig. 5 of the drawings of the present description, another usage scenario of the information transmission system according to the above-described embodiment of the present invention is illustrated, in which the usage scenario of the information transmission system is a studio, in particular the first terminal 30 is implemented as a camera 303 of the studio, the second terminal 40 is implemented as a presenter 402a of the studio (i.e. a screen for presenting content to be watched by a viewer) and/or a computer 402b, wherein the number of cameras 303 is plural, the transmitting device 10 corresponding to the number of cameras 303 is connected to the cameras 303 through the audio-visual signal input 101 of the transmitting device 10, the receiving device 20 is connected to the presenter 402a and/or the computer 402b through the audio-visual signal output 203 of the receiving device 20, the transmitting device 10 is connected to the camera 303 through the video signal input end 101 of the transmitting device 10 to access the video signal generated based on the video transmission protocol built in the camera 303 from the camera 303, and sends the video signal through the communication module 103 after the video signal is encoded by the encoding module 102 to generate the data information, wherein the wireless module 201 of the receiving device 20 receives the data information sent by the communication module 103 of the transmitting device 10, decodes the data information into the video signal corresponding to the data information through the decoding module 202, and then sends the video signal to the presenter 402a and/or the computer 402b through the video signal output end 203 of the receiving device 20, so as to display the content shot by the camera 303 on the presenter 402a and/or the computer 402b.
It should be noted that, in most cases, the multiple cameras 303 in the studio may be turned on simultaneously to correspond to different shooting angles, and the information transmission system may not only simultaneously display the content shot by the multiple cameras 303 to be transmitted to the presenter 402a and/or the computer 402b, but also selectively select one or more of the content shot by the cameras 303 to be transmitted to the presenter 402a and/or the computer 402b, and also select the content shot by the multiple cameras 303 to be transmitted to the presenter 402a and/or the computer 402b through different display methods, for example, a multi-grid display mode, a four-grid display mode, etc., so as to realize the diversification of the content display, realize the basic functions of the studio guide station, and avoid the defects of difficult wiring caused by the traditional studio guide station adopting a wired transmission mode, which leads to the fact that the shooting angle of the camera 303 can only be fixed in a partial area, high wiring cost, complicated wiring, easy to generate data wire winding, reduce the program effect, even lead to interrupt, cause maintenance, and increase of maintenance cost, etc.
Preferably, the transmission device 10 may be miniaturized to reduce power consumption, so that the video signal input terminal 101 can be used to supply power, so as to adapt to the characteristics of limited battery capacity of the camera 303, limited interface on the camera 303, and the like, and the miniaturization design is adopted, and simultaneously, the weight of the transmission device 10 is reduced, so that the photographic effect is not affected.
Further, under the development of the internet, many offline activities evolve into online forms based on the network, such as "cloud worship year", "cloud dinner" and the like, and the internet also greatly facilitates the work and study of people, such as video conferences, and participants do not need to gather into a conference room, but can develop the conference at intervals of thousand miles, so that the timeliness of the conference and the convenience of developing the conference are greatly improved. For another example, a network course, people can select and participate in the course of interest on the network, i.e. can learn knowledge of interest without specially going to school for learning. However, in most cases, the communication of the network is generally optimized and complemented with an offline communication, for example, a company performs a video conference, typically, an offline main conference place is set in the company, and some employees who cannot reach the offline conference place participate in the conference through a network connection, so as to avoid the absence of some employees who cannot reach the offline conference place to participate in the conference or delay the conference due to the failure of some employees to participate in the conference. For example, schools generally offer offline courses, and for some special reasons, some students may not be able to participate in the learning to the schools, but participate in the learning by means of network connection.
In the prior art, people usually use video software to participate in online communication, and each participant corresponds to an account to participate in online communication, for example, in a video conference, each participant uses own video software account to enter a corresponding online conference room, and for example, in a network live course, each student uses own video software account to enter a corresponding online classroom. However, when some participants are offline, for example, some participants are offline in a main conference, some students are offline in a classroom, and the online participants are online in the offline participants through the video software account, the offline participants need to be connected to the same network port, so that the network quality is required to be high, and under the condition of poor network quality, the quality of online communication is reduced due to the conditions of blocking and disconnection; even in the case of a network of high quality sufficient to support multiple video software accounts of multiple participants while accessing on-line communications, interference can occur with devices between the participants, such as when a participant is engaged in speaking, devices of other participants can play out the participant's voice, create echoes, and the like. In this regard, people will usually use only one video software account to participate in online communication by the offline participants, i.e. the offline participants need to share one video software account to solve the problem of interference between the network and the devices, however, when the offline participants need to participate in speaking or content presentation, only the devices logged in the video software account can be used to perform the communication, which affects the communication efficiency. That is, the prior art cannot cooperate with communication between an offline device and an online device, especially cannot cooperate with communication between a plurality of offline devices to cause mutual interference between the devices, cannot meet the use requirements of people, and has low practicality.
For this, the invention also provides a multi-terminal collaboration system, wherein the multi-terminal collaboration system can collaborate communication between offline and online, and can integrate and collaborate a plurality of terminal devices under the online so as to avoid mutual interference among the terminal devices, avoid the pressure of simultaneous networking of a plurality of terminal devices on network bandwidth, reduce the high dependence on network quality, and have higher practicability.
Specifically, referring to fig. 7 of the drawings, a block diagram of a multi-terminal collaboration system according to an embodiment of the present invention is illustrated, wherein the multi-terminal collaboration system includes the transmitting device 10 and the receiving device 20, to collaborate with at least a first terminal 30 and a second terminal 40 under a line and a remote terminal on the line, wherein the transmitting device 10 is communicatively connected to the receiving device 20 in a wireless manner, the transmitting device 10 connects the first terminal 30 to access the av signal generated based on an av transmission protocol built in the first terminal 30 from the first terminal 30, and encodes and transmits the data information to the receiving device 20, and the receiving device 20 decodes to obtain the av signal corresponding to the data information after receiving the data information transmitted by the transmitting device 10, and the receiving device 20 connects the second terminal 40 and transmits the av signal to the second terminal 40, so as to integrate the av signal of the first terminal 30 to the second terminal 40.
Further, the receiving device 20 further includes a receiver encoding module, where the receiver encoding module is configured to encode the audio-visual signal decoded by the decoding module 202 to obtain the corresponding data information, and the USB interface 204 of the receiving device 20 is connected to a corresponding networking terminal to transmit the data information from the receiver encoding module to the networking terminal, specifically, in this embodiment of the present invention, the networking terminal is implemented as the second terminal 40, and the second terminal 40 is connected to an external network to connect with other remote terminals, so that the information of a plurality of the first terminals 30 is cooperatively integrated to the second terminal 40, thereby reducing a high dependency on network quality, and avoiding mutual interference between terminal devices, so as to meet a user's use requirement and a good use experience, and having a high practicality.
More specifically, the transmitting device 10 is connected to the first terminal 30 through the audio-video signal input terminal 101 of the transmitting device 10, the receiving device 20 is connected to the second terminal 40 through the audio-video signal output terminal 203 of the receiving device 20, wherein the transmitting device 10 is connected to the first terminal 30 through the audio-video signal input terminal 101 of the transmitting device 10 to access the audio-video signal generated based on the audio-video transmission protocol built in the first terminal 30 from the first terminal 30, and is transmitted by the communication module 103 in a wireless manner after the encoding module 102 encodes the data information, wherein the wireless module 201 of the receiving device 20 receives the data information transmitted by the communication module 103 of the transmitting device 10, and decodes the audio-video signal corresponding to the data information through the decoding module 202, and transmits the audio-video signal to the second terminal 40 through the audio-video signal output terminal 203 of the receiving device 20, so as to realize the co-decoding of the first terminal 30 and the data information to the second terminal 40, and the second terminal 40 is connected to the second terminal 40 through the remote network, and the second terminal is connected to the second terminal 40 through the other communication module 204, and the wireless module 201 of the wireless module 20 receives the data information transmitted by the communication module 40, for example, the second terminal 40 displays the acquired video and audio signals from the first terminal 30 to other remote terminals through a network, so as to avoid the pressure on the network bandwidth caused by that a plurality of first terminals 30 can establish contact with other remote terminals only by connecting an external network, i.e. reduce the high dependence on the network quality, and simultaneously avoid the mutual interference among a plurality of first terminals 30, such as the sound interference caused by the networking of the first terminals 30, so as to meet the use requirement of users, give good use experience to the users, and have higher practicability.
It should be noted that, in this embodiment of the present invention, the multi-terminal collaboration system further provides a camera, wherein the camera is connected to the receiving device 20 through an HDMI data line and transmits the captured audio/video signal to the receiving device 20, wherein the receiver encoding module of the receiving device 20 encodes the audio/video signal to obtain corresponding image data information, and the image data information is transmitted to the second terminal 40 through the USB interface 204 of the receiving device 20 and is transmitted to a remote terminal through the second terminal 40 in a network.
It should be noted that, besides establishing a wireless connection with the transmitting device 10 to cooperate with a plurality of the first terminals 30, the receiving device 20 may also directly establish a wireless connection with other terminal devices, such as a mobile phone, a tablet computer, etc., so that the multi-terminal cooperation system may cooperate to integrate a plurality of terminal devices, that is, other terminal devices, such as a mobile phone, a tablet computer, etc., may also contact with other remote terminals through the multi-terminal cooperation system, without going through an external network, so as to further reduce the pressure on the network bandwidth, reduce the high dependency on the network quality, and avoid the mutual interference between other terminal devices and the first terminals 30, thereby satisfying the user use requirement and giving the user a good use experience.
Specifically, the wireless module 201 of the receiving device 20 is set with two working modes, namely an AP mode and a P2P mode, when the wireless module 201 is in the AP mode, the wireless module is compatible with a device using the ios operating system and can establish a wireless connection with the ios device, so as to receive the data information generated by encoding the video and audio signal from the ios device; when the wireless module 201 is in the P2P mode, the device using the android operating system can be compatible, and a wireless connection can be established between the wireless module 201 and the android device, so as to receive the data information generated by encoding the video and audio signal from the android device; the receiving device 20 can establish wireless connection with terminal devices of different operating systems, so that the terminal devices of different operating systems can be cooperated, and the practicability of the multi-terminal cooperation system is improved.
Further, the user may selectively implement one or more of the transmission devices 10 to transmit the data information to the receiving device 20 by controlling the encoding module 102 by the control module 104 of the transmission device 10, specifically, the user controls the encoding module 102 to encode by operating the entity control key 1041 once and controls the encoding module 102 to stop encoding by operating the entity control key 1041 once again, wherein the control module 104 is configured to control the encoding module 102 to encode when the user operates the entity control key 1041 once, and if there are other transmission devices 10 already transmitting the data information to the receiving device 20 at this time, occupy a channel between the transmission device 10 and the receiving device 20 that are transmitting the data information to the receiving device 20, thereby implementing switching of the transmission device 10 transmitting the data information to the receiving device 20; wherein the control module 104 is configured to control the encoding module 102 to encode when the user operates the entity control key 1041 once for a long time, and to transmit the data information to the receiving apparatus 20 simultaneously with the transmitting apparatus 10 transmitting the data information to the receiving apparatus 20, i.e., a plurality of the transmitting apparatuses 10 simultaneously transmitting the data information to the receiving apparatus 20, if there is another transmitting apparatus 10 transmitting the data information to the receiving apparatus 20 at this time, so as to enable the second terminal 40 to selectively receive signals from one or more of the first terminals 30 and display the signals to an external terminal via a network, thereby enabling selective information transmission while reducing the network bandwidth pressure, maintaining a good order, and further improving the practicality of the multi-terminal collaborative system.
In particular, in this embodiment of the present invention, the second terminal 40 may obtain and display information of the external terminal through the network, so as to realize communication between offline and online in cooperation, avoid the pressure caused by the network bandwidth to which the first terminals 30 need to obtain information of the external terminal through networking, reduce the high dependence on the network quality, and give the user good use experience while meeting the user use requirement.
It should be noted that, the transmitting device 10 is further connected to the first terminal 30 through the USB interface 105 of the transmitting device 10, the receiving device 20 is connected to the second terminal 40 through the USB interface 204 of the receiving device 20, so that, on one hand, a power source can be obtained based on the USB interface, and on the other hand, when the second terminal 40 has a touch screen control function, touch screen control information can be transmitted through the USB interface 204 of the receiving device 20 and sent to the transmitting device 10 through the wireless module 201 of the receiving device 20, and is transmitted to the first terminal 30 through the USB interface 105 of the transmitting device 10, so as to realize a control back to the first terminal 30, and further improve the practicability of the multi-terminal collaboration system.
Particularly, when the audio/video signal input terminal 101 of the transmitting device 10 is implemented as a Type-C interface supporting audio/video signal transmission, and when the audio/video signal output terminal 203 of the receiving device 20 is implemented as a Type-C interface supporting audio/video signal transmission, when the second terminal 40 is provided with a touch screen control function, touch screen control information may also be transmitted through the audio/video signal output terminal 203 of the receiving device 20 and sent to the transmitting device 10 through the wireless module 201 of the receiving device 20, and transmitted to the first terminal 30 through the audio/video signal input terminal 101 of the transmitting device 10, so as to realize control back to the first terminal 30, thereby further improving the practicability of the multi-terminal collaborative system.
Further, the present invention provides a collaboration method for coordinating communication between the first terminal 10 and the second terminal 20 under the line and the remote terminal on the line, wherein the collaboration method comprises the following steps:
(a) A video signal input terminal 101 of a transmitting device 10 accesses a video signal generated based on a video transmission protocol built in the first terminal 10 from the first terminal 10;
(b) A control module 104 of the transmitting device 10 controls an encoding module 102 to encode the video signal to generate a data message, so as to avoid installing additional encoding software on the first terminal 10, and performing software encoding on the video signal by a processor of the first terminal 10 through the installed encoding software to generate the data message;
(c) A communication module 103 of the transmitting device 10 transmits the data information in a wireless manner;
(d) A wireless module 201 of a receiving apparatus 20 receives the data information;
(e) A decoding module 202 of the receiving device 20 decodes the data information to obtain the video signal corresponding to the data information;
(f) An audio/video signal output terminal 203 of the receiving device 20 transmits the audio/video signal to the second terminal 40 to display the audio/video signal via the second terminal 40;
(g) A receiver encoding module of the receiving apparatus 20 encodes the video signal;
(h) A USB interface 204 of the receiving device 20 is connected to a corresponding networking terminal to transmit data information from the receiver encoding module to the networking terminal, so as to avoid bandwidth pressure caused by the networking of the first terminal 10 and interference caused by the networking of the first terminal 10.
In particular, in this embodiment of the present invention, in which the number of the first terminals 30 is plural, a corresponding number of the plurality of the transmission apparatuses 10 are connected to the first terminals 30.
It is worth mentioning that in this embodiment of the present invention, the following steps are further included before said step (c): the control module 104 controls the encoding of the encoding module 102 to selectively enable one or more of the transmitting devices 10 to transmit the data information to the receiving device 20.
Specifically, when the transmitting device 10 is transmitting the data information to the second terminal 40, an entity control key 1041 of the control module 104 is operated to control the control module 104 to control the encoding module 102 to encode, and if other transmitting devices 10 are transmitting the data information to the receiving device 20, a channel between the transmitting device 10 and the receiving device 20 that are transmitting the data information to the receiving device 10 is occupied; the physical control key 1041 of the control module 104 is operated once for a long time, and the control module 104 controls the encoding module to encode, and if there is already the other transmitting device 10 transmitting the data information to the receiving device 20 at this time, transmits the data information to the receiving device 20 simultaneously with the transmitting device 10 transmitting the data information to the receiving device 20.
As an example, referring to fig. 7 of the drawings of the present specification, a use scenario of the multi-terminal collaboration system according to the above embodiment of the present invention is illustrated, in this example, the use scenario of the multi-terminal collaboration system is a conference site, and the conference site has an off-line conference site and on-line participants, that is, all of the off-line conference sites, and a part of the off-line participants participate in the conference by means of a network connection, specifically, the first terminal 30 is implemented as a notebook 301 of the participant, the second terminal 40 is implemented as a presentation screen 401 of the conference room, wherein the number of the notebook 301 is plural, the transmitting devices 10 corresponding to the notebook 301 are connected to the notebook 301 through the audio/video signal input terminal 101 of the transmitting device 10, the presentation screen 401 is established with a remote terminal through a network, the receiving device 20 is connected to the presentation screen 401 through the receiving device 203 of the receiving device 20, wherein the transmitting devices 10 are connected to the audio/video signal input terminal 301 through the receiving device 101 of the receiving device, and the audio/video signal is generated by the decoding module 103, the audio/video signal is decoded by the audio/video signal input module 301 is generated by the receiving device 101 and the audio/video signal decoding module of the receiving device 20, the audio/video signal is encoded by the audio signal decoding module of the audio/video signal receiving module 301 is transmitted by the audio signal of the audio signal processing device 301, thus, the plurality of notebook computers 301 are cooperated to one display screen 401, the receiver encoding module of the receiving device 20 encodes the video signal obtained by decoding the decoding module 202 to obtain the corresponding data information, and transmits the data information to the display screen 401 through the USB interface 204 of the receiving device 20, and a connection is established between the display screen 401 and a remote terminal through a network, so as to realize cooperation between the offline terminal and the online terminal.
In other words, the off-line participant can display the audio-video signal on the notebook computer 301 to the display screen 401 through the multi-terminal collaboration system, and the audio-video signal on the notebook computer 301 can be displayed to the remote terminal through the display screen 401 through the network, so that the on-line remote participant can also receive the information shared by the off-line participant, and the on-line participant does not need to have pressure on the line width of the network in a mode of networking the notebook computer 301, and the conference on the line is realized in a mode of video conference software, namely, each terminal device is required to participate in on-line communication, and the devices between the participants on the off-line conference site can also generate interference, for example, when the participants participate in, the devices of other participants can play the sound of the participants to generate echo, and the like, in the present schematic scene, the multi-terminal collaboration system is adopted to integrate the off-line notebook computer 301 to a display screen 401, and only needs to represent the quality of the off-line conference site participant to communicate with the network, and the off-line participant does not need to have high quality of the on-line conference participant, and the off-line participant does not need to have high quality of the on the line participant, and the off-line participant can also feel the line participant on the line participant can not need to have the off-line participant to have the line participant on the network, and the remote participant can not feel the mutual information on the line participant on the terminal 401, and the remote participant can be shared by the terminal, and the terminal on the terminal has good experience.
It should be noted that, the receiving device 20 of the multi-terminal collaboration system may also establish a wireless connection with the mobile device 302 of the offline participant, for example, a mobile phone, a tablet computer, etc. of the offline participant, so that the mobile device 302 of the offline participant may also be collaborated by the multi-terminal collaboration system, the offline participant may transmit information on the mobile device 302 to the display screen 401 to be displayed and received by an online remote participant through a network, so as to improve the device flexibility of the participant, and the receiving device 20 may establish a wireless connection with the mobile device 302 of a different operating system, so that the compatibility and adaptability of the multi-terminal collaboration system to different devices correspondingly improve the practicability of the multi-terminal collaboration system.
As an example, referring further to fig. 8 of the drawings of the present specification, another use scenario of the multi-terminal collaboration system according to the above embodiment of the present invention is illustrated, in this example, the use scenario of the multi-terminal collaboration system is a classroom, and the classroom has live broadcast on line in addition to a conventional off-line classroom, so as to correspond to a case where some students can participate in a course on line in the off-line classroom, and another part of students participate in the course remotely through a network. Specifically, in this usage scenario, the first terminal 30 is implemented as a notebook 301 of an offline student, the second terminal 40 is implemented as a presentation screen 403 of a classroom, the transmitting device 10 is connected to the notebook 301, the receiving device 20 is connected to the presentation screen 403, the transmitting device 10 is wirelessly connected to the receiving device 20, the transmitting device 10 accesses the audio-visual signal of the notebook 301, encodes the audio-visual signal to generate the data information, then sends the data information to the receiving device 20, the receiving device 20 decodes the received data information to obtain the audio-visual signal corresponding to the data information, and then sends the audio-visual signal to the presentation screen 403, and the video-audio signal is encoded to obtain the corresponding data information and transmit the data information to the demonstration screen 403, and the demonstration screen 403 can also receive the information in real time by the students remotely participating in the courses through the network, and the students remotely participating in the courses can also transmit the information to the demonstration screen 403 to perform demonstration through the network, so that the students participating in the courses in the online classrooms can also receive the information of the students remotely participating in the courses, thus realizing the cooperation between the offline terminals and the online terminals, and simultaneously avoiding the mutual interference among a plurality of notebook computers 301 in the offline classrooms and the pressure caused by the simultaneous networking to the network.
In many cases, students need to take turns to perform presentation, for example, students in a course perform homework and the like, the students in a remote participation course transmit information to a presentation screen 403 in the classroom to perform presentation through a network, however, often the situation that the students in the online classroom do not stop presentation in time after finishing the presentation of the audio-visual signals on the notebook 301 is often caused, when a user operates the entity control key 1041 for one time, the encoding module 102 is controlled, if another transmission device 10 is transmitting the data information to the receiving device 20 at this time, the students occupy the presentation screen 403 in the classroom, after finishing the presentation, the students control the encoding module 102 to stop encoding through operating the entity control key 1041 again, and then stop presentation of the audio-visual signals on the notebook 301, but often the situation that the students do not stop presentation in time after finishing the presentation of the audio-visual signals is often occurs, the control module 104 is set to control the encoding module 102 when the user operates the entity control key 1041 once, and if another transmission device 10 is transmitting the data information to the receiving device 20 at this time, the students occupy the transmission device 10 which is transmitting the data information to the receiving device 20, namely, the corresponding to the receiving device 10 can perform presentation through the corresponding to the receiving device 10 on the receiving device, and the display channel of the students on the receiving device 10; in addition, in a case where a plurality of students are simultaneously performing presentation, the control module 104 is configured to control the encoding module 102 to encode when the user operates the entity control key 1041 once for a long time, and if there is another transmitting device 10 transmitting the data information to the receiving device 20 at this time, the transmitting device 10 transmitting the data information to the receiving device 20 simultaneously transmits the data information to the receiving device 20, that is, a plurality of transmitting devices 10 simultaneously transmit the data information to the receiving device 20, that is, the students can perform presentation of contents on a plurality of notebook computers 301 by operating the entity control key 1041 of the corresponding transmitting device 10 once for a long time, so that good class order is maintained, and the practicability of the multi-terminal collaboration system is improved.
Those skilled in the art will appreciate that the embodiments of the invention described above and shown in the drawings are by way of example only and not limiting. The objects of the present invention have been fully and effectively achieved. The functional and structural principles of the present invention have been shown and described in the examples and embodiments of the invention may be modified or practiced without departing from the principles described.

Claims (12)

1. A multi-terminal collaboration system for collaborating at least a first terminal and a second terminal off-line and a remote terminal on-line, comprising:
At least one transmitting device, wherein the transmitting device comprises an audio-video signal input end, an encoding module, a communication module and a control module, wherein the audio-video signal input end, the communication module and the control module are respectively connected with the encoding module in a communication way, the audio-video signal input end is used for being connected with the first terminal so as to access the audio-video signal of the first terminal from the first terminal, the encoding module is connected with the audio-video signal input end in a communication way and can encode the audio-video signal accessed through the audio-video signal input end to generate data information, so that the first terminal is prevented from installing additional encoding software, and the process of generating the data information by software encoding the audio-video signal through an installed encoding software by a processor of the first terminal is avoided, the control module is connected with the encoding module in a communication way so as to control the encoding module to encode the audio-video signal, the communication module is connected with the encoding module in a communication way, and the communication module is set to send the data information in a wireless way; and
A receiving device, wherein the receiving device is communicatively connected to the transmitting device in a wireless manner, wherein the receiving device comprises at least a wireless module, a decoding module, a video signal input, a receiver encoding module and a USB interface, wherein the video signal input is connected to the second terminal, the wireless module receives the data information transmitted by the communication module of the transmitting device, the decoding module is arranged to decode the data information received by the wireless module to obtain the video signal corresponding to the data information, wherein the video signal output is arranged to transmit the video signal to the second terminal, the video signal is presented by the second terminal, wherein the receiver encoding module is arranged to encode the video signal, the USB interface is connected to the corresponding terminal to transmit data information from the receiver encoding module to the networking terminal to avoid the bandwidth pressure caused by the first terminal, and the first terminal generates interference, wherein the control module comprises a control entity, the control module is arranged to stop the transmission of the video signal to the first terminal, the control module is arranged to control the first terminal when the control module is arranged to operate the first terminal, the control module is arranged to perform a plurality of control keys, the control device is arranged to be operated when the first terminal is connected to the first terminal, the control module is arranged to perform a plurality of control codes, when the entity control key is operated once, the encoding module is controlled to encode and occupy a channel between the transmitting device and the receiving device which are transmitting the data information to the receiving device; the entity control key controls the encoding module to encode and transmit the data information to the receiving apparatus simultaneously with the transmitting apparatus which is transmitting the data information to the receiving apparatus when operated once for a long time.
2. The multi-terminal coordination system of claim 1 wherein the entity control is configured to be operated in a depressed manner.
3. The multi-terminal coordination system of claim 1 wherein the number of wireless modules is two, wherein one of the wireless modules is set to an AP mode and wherein the other wireless module is set to a P2P mode.
4. The multi-terminal co-system of claim 1, wherein the wireless module is set to two operation modes, an AP mode and a P2P mode, wherein the wireless module operates in the AP mode by default, and the wireless module is set to switch the operation mode to the P2P mode when information from a device of an android operating system is recognized.
5. The multi-terminal collaboration system of any of claims 1-4, wherein the transfer device further comprises a USB interface, wherein the USB interface is coupled to the first terminal, the encoding module and the communication module being electrically coupled to the USB interface to be electrically coupled via the USB interface.
6. The multi-terminal co-system of claim 5, wherein the wireless module and the decoding module of a receiving device are powered to connect to the USB interface of the receiving device to be powered via the USB interface.
7. The multi-terminal co-system of claim 6, wherein the second terminal is networked, wherein the second terminal has a touch screen control function, touch screen control information of the second terminal is transmitted via the USB interface of the receiving device and sent via the wireless module, and the communication module of the transmitting device receives the touch screen control information and transmits to the first terminal via the USB interface of the transmitting device.
8. The multi-terminal collaboration system according to any one of claims 1 to 4, wherein the second terminal has a touch screen control function, touch screen control information of the second terminal is transmitted via the audio-visual signal output end of the receiving device and sent via the wireless module, and the communication module of the transmitting device receives the touch screen control information and transmits to the first terminal via the audio-visual signal input end of the transmitting device.
9. A collaboration method of a multi-terminal collaboration system according to any of claims 1 to 8 for collaboration of communication exchanges between a first terminal and a second terminal off-line and a remote terminal on-line, wherein the collaboration method comprises the steps of:
(a) A video signal input end of a transmission device is connected with a video signal generated based on a video transmission protocol built in the first terminal from the first terminal;
(b) A control module of the transmission device controls a coding module to code the video signal to generate data information so as to avoid the first terminal from installing additional coding software, and the process of generating the data information by performing software coding on the video signal by a processor of the first terminal through the installed coding software;
(c) A communication module of the transmission device transmits the data information in a wireless mode;
(d) A wireless module of a receiving device receives the data information;
(e) A decoding module of the receiving device decodes the data information to obtain the video-audio signal corresponding to the data information;
(f) A video signal output end of the receiving equipment transmits the video signal to the second terminal so as to display the video signal through the second terminal;
(g) A receiver encoding module of the receiving device encodes the video signal;
(h) A USB interface of the receiving device is connected to a corresponding networking terminal to transmit data information from the receiver coding module to the networking terminal so as to avoid bandwidth pressure caused by networking of the first terminal and interference generated by networking of the first terminal.
10. The cooperative method of claim 9, wherein the number of the first terminals is plural, and the corresponding number of the plurality of the transmission apparatuses is connected to the first terminals.
11. The collaborative method according to claim 10, wherein prior to step (c), further comprising the steps of: an entity control key of the control module is operated once, the control module controls the coding module to code, and if other transmitting equipment is transmitting the data information to the receiving equipment at the moment, a channel between the transmitting equipment and the receiving equipment which are transmitting the data information to the receiving equipment is occupied; the entity control key of the control module is operated once for a long time, the control module controls the coding module to code, and if other transmission devices are transmitting the data information to the receiving device, the data information is transmitted to the receiving device simultaneously with the transmission devices transmitting the data information to the receiving device.
12. The collaboration method of claim 11, wherein the entity control is configured to be operated in a pressing manner.
CN202111047635.3A 2021-09-08 2021-09-08 Multi-terminal collaboration system and collaboration method Active CN113612858B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111047635.3A CN113612858B (en) 2021-09-08 2021-09-08 Multi-terminal collaboration system and collaboration method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111047635.3A CN113612858B (en) 2021-09-08 2021-09-08 Multi-terminal collaboration system and collaboration method

Publications (2)

Publication Number Publication Date
CN113612858A CN113612858A (en) 2021-11-05
CN113612858B true CN113612858B (en) 2024-08-23

Family

ID=78342818

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111047635.3A Active CN113612858B (en) 2021-09-08 2021-09-08 Multi-terminal collaboration system and collaboration method

Country Status (1)

Country Link
CN (1) CN113612858B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103931175A (en) * 2011-09-14 2014-07-16 巴科股份有限公司 Electronic tool and methods with audio for meetings
CN215646845U (en) * 2021-09-08 2022-01-25 深圳市乐橙互联有限公司 Multi-terminal collaboration system

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102868802A (en) * 2011-07-08 2013-01-09 北京龙光科技有限公司 Data processing device, data processing adapting device and communication system
CN104301774A (en) * 2014-09-25 2015-01-21 四川长虹电器股份有限公司 Video and audio transmission system based on WIMO
CN109218731B (en) * 2017-06-30 2021-06-01 腾讯科技(深圳)有限公司 Screen projection method, device and system of mobile equipment
CN209118258U (en) * 2018-03-19 2019-07-16 广州视源电子科技股份有限公司 Wireless screen transmission device
CN110874959B (en) * 2018-09-03 2021-11-05 深圳市鹰硕技术有限公司 Multi-terminal same-screen teaching system and teaching method
CN112969038A (en) * 2021-01-29 2021-06-15 北京字节跳动网络技术有限公司 Data transmission method and device, electronic equipment and computer readable storage medium

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103931175A (en) * 2011-09-14 2014-07-16 巴科股份有限公司 Electronic tool and methods with audio for meetings
CN215646845U (en) * 2021-09-08 2022-01-25 深圳市乐橙互联有限公司 Multi-terminal collaboration system

Also Published As

Publication number Publication date
CN113612858A (en) 2021-11-05

Similar Documents

Publication Publication Date Title
CN102291562B (en) Conference terminal, conference server, conference system and data processing method
US9172912B2 (en) Telepresence method, terminal and system
US7973859B2 (en) Apparatus, network device and method for video/audio data transmission
CN110290416B (en) Screen projector integrated with video conference system and conference system
WO2018006573A1 (en) Device implementing video conference screen sharing
CN100562094C (en) Camera with multiple frames at far end remote control thereof in a kind of TV conference system
CN101198008A (en) Method and system for implementing multi-screen and multi-picture
US20140139618A1 (en) Media transmission method and system based on telepresence
CA2830886A1 (en) Method and system for adapting a television for multimedia conferencing
CN113612857A (en) Transmission device, receiving device, information transmission system and information transmission method
WO2022111421A1 (en) Screen projection method and apparatus for application interface, device, and storage medium
KR20070076133A (en) Video conference system and method using white board
CN109753259B (en) Screen projection system and control method
CN103338346A (en) Method and system for realizing multimedia digital conference
CN103856809A (en) Method, system and terminal equipment for multipoint at the same screen
WO2015003532A1 (en) Multimedia conferencing establishment method, device and system
CN103841361A (en) Communication method for integrating multiple conference systems under low bandwidth
US8786631B1 (en) System and method for transferring transparency information in a video environment
CN215646847U (en) Conveying equipment
CN215646845U (en) Multi-terminal collaboration system
EP2637404B1 (en) Method and device for controlling multiple auxiliary streams, and network system
CN113612858B (en) Multi-terminal collaboration system and collaboration method
CN108989740A (en) A kind of video conferencing system and method
CN215646848U (en) Receiving device
CN215646846U (en) Miniaturized information transmission system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant