WO2016161838A1

WO2016161838A1 - Multi-path shared-screen method and apparatus

Info

Publication number: WO2016161838A1
Application number: PCT/CN2016/072329
Authority: WO
Inventors: 王福全; 刘惠梅
Original assignee: 好迪龙电子深圳有限公司
Priority date: 2015-04-08
Filing date: 2016-01-27
Publication date: 2016-10-13
Also published as: CN104754402A

Abstract

Provided in the present invention are a multi-path shared-screen method and apparatus, comprising: a processor and a receiving module, the receiving module being connected to the processor, an interface used for communicating with video apparatuses being arranged on the receiving module, the receiving module receiving different types of video data from the video apparatuses, identifying the different types of video data, and then parsing the different types of video data; and, on the basis of the identification results, sending the corresponding parsed video data to the processor; the processor, according to the various types of video data, implementing format conversion of the parsed video data, and sending same, having respectively undergone format decoding or encoding processing, to a screen in a split image, stacked image, or single image mode. The multi-path shared-screen method and apparatus set forth in the present invention can send video content from a plurality of video apparatuses to the same display screen for shared-screen display or for rapid switching after stacking.

Description

[0001] Technical Field

[0002] The present invention relates to the field of video communication technologies, and in particular, to a method and apparatus for performing multi-channel video fusion on the same screen.

BACKGROUND

[0004] The emergence of the same screen technology enables various video devices such as mobile phones, tablets, notebook computers, etc. to conveniently push the content or video displayed on the screen to the TV or the liquid crystal display wirelessly or by wire. On, the function of the wireless display is realized.

[0005] Many different specifications of the same screen technical specifications have been formed on the market, and the mainstream specifications include:

[0006] 1. WiFi Alliance (an international non-profit industry association with hundreds of leading member companies working together to promote Wi-Fi technology in equipment and various market segments)

Miracast Technology (Wi-Fi Alliance announced the launch of the Wi-Fi CERTIFIED Mimcast certification program on September 19, 2012. Mimcast devices provide simplified discovery and setup, allowing users to quickly transfer video between devices): This is a Wifi-Direct based (It refers to the same screen technology that allows devices in the wireless network to connect to each other without using a wireless router. Currently, operating systems such as Wi _n d ₀ w _S 8.1 and A _n d _r0 id 4.2 have built-in support for Mimcast technology. .

[0007] 2, Apple (Apple's Air Play (a small free audio player) Technology: Apple's devices such as iPhone (Apple), iPad (Apple Tablet), iPod (Apple's player ), Macbook (Apple laptop), etc., all support this technology.

[0008] 3, Google (Google) Chromecast (Google's new connected device released on July 25, 2013): Google's Chromebook (Google's network notebook) and Chrome (Google's browser) browser support This same-screen technology, there are now a variety of TV sticks, set-top boxes, and support for all kinds of on-screen technology. The common point of these applications is to output full-screen with HDMI (High-Definition Multimedia Interface). The screen of the screen is on the TV (TV) or LCD LCD monitor, and the peer can only accept the same screen of a single technology. It can't accept multiple video devices at the same time. Only the video that is connected can be used. The device will exit first in order to connect the new video device. The inconvenience is considerable, and the process of switching video devices is lengthy and complicated.

SUMMARY OF THE INVENTION

[0010] A primary object of the present invention is to provide a multi-channel on-screen method and apparatus capable of transmitting video content of a plurality of different video devices to the same display screen for on-screen display or stacking for fast switching.

[0011] The present invention provides a multi-channel on-screen device, including: a processor and a receiving module, wherein the receiving module is connected to the processor;

[0012] the receiving module is provided with an interface for connecting to the video device; the receiving module receives different types of video data from the video device, identifies the different types of video data, and then pairs the different types. The video data is split; and the corresponding split video data is sent to the processor according to the identified result;

[0013] after receiving the split video data, the processor converts the split video data according to the type of each video data, and performs format decoding and encoding processing, respectively, and then splits the screen, overlaps the screen, or A single screen is sent to the screen.

[0014] Preferably, the processor establishes a corresponding data stream for each user connection according to a session corresponding to each user connection, and separately decodes and encodes each video data by using a protocol corresponding to the data stream. deal with.

[0015] Preferably, the receiving module is a WiFi receiving module that implements a wireless connection.

[0016] Preferably, the manner in which the WiFi receiving module receives the video data of the video device includes a Mimcast connection, a chromecast connection, and an Air play connection.

[0017] The Miracast connection corresponds to an operating system device of Windows 8.1 and Android 4.2 or other mobile devices supporting Miracast; the chromecast connection corresponds to a Chromebook and a Google browser.

The Air play connection corresponds to an Apple device.

[0018] The present invention also provides a multi-channel on-screen method, including a multi-channel on-screen device, the multi-channel co-screen device includes: a processor and a receiving module, the receiving module is connected to the processor;

[0019] The multi-channel on-screen method includes the following steps:

[0020] Step A: The receiving module receives different types of video data from the video device, identifies the different types of video data, and then splits the different types of video data, and then according to the identified result Corresponding split video data is sent to the processor; [0021] Step B: After the processor receives the split video data, the split video data is format-converted according to the type of each video data, and respectively subjected to format decoding and encoding processing, and then through the split screen and the overlapping screen. Or send it to the screen in a single screen.

[0022] Preferably, in the step B, the processor establishes a corresponding data flow for each user connection according to a session corresponding to each user connection, and respectively, each video data is respectively determined by a protocol corresponding to the data flow. Perform format decoding and encoding processing.

[0023] Preferably, the receiving module is a WiFi receiving module that implements a wireless connection.

[0024] Preferably, the manner in which the WiFi receiving module receives the video data of the video device includes a Mimcast connection, a chromecast connection, and an Air play connection.

[0025] the Miracast connection identifies video data corresponding to operating system devices of Windows 8.1 and Android 4.2 or other mobile devices supporting Mimcast and sends them to the processor; the chromecast connection identifies the corresponding Chromebook and Google The video data of the browser is sent to the processor; the Air play connection identifies the video data corresponding to the Apple device and sends it to the processor.

[0026] The technical solution of the present invention has the following beneficial effects:

[0027] The multi-channel on-screen method and apparatus provided by the present invention can display video content of a plurality of video devices on a display screen by dividing a screen, overlapping a screen, or hiding one or several screens. Easy to use, the same multi-channel on-screen implementation can extend the application context of the same screen, and extend the same-screen technology from applications that are biased towards entertainment (such as watching mobile video/photos on TV) to commercial applications (such as conferences). Application), the invention is combined with a projector screen or a large-size LCD, and the person who is in the conference can send a picture of his video device (mobile phone/notebook/tablet) to the projector screen or It is a large size LCD for discussion.

BRIEF DESCRIPTION OF THE DRAWINGS

1 is a schematic structural diagram of a multi-channel on-screen device according to an embodiment of the present invention;

2 is a schematic flowchart of a multi-channel on-screen method according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of an application example according to an embodiment of the present invention.

[0032] The implementation, functional features, and advantages of the present invention will be further described with reference to the accompanying drawings.

DETAILED DESCRIPTION

[0034] It should be understood that the specific embodiments described herein are merely illustrative of the present invention and are not intended to limit the present invention. Bright.

[0035] Embodiments of the present invention provide a multi-channel co-screen device, which may be an independent device or integrated in other devices (such as routers, various smart devices, etc.).

[0036] Referring to FIG. 1, a multi-channel device in the embodiment of the present invention includes: a processor and a receiving module, wherein the receiving module is connected to the processor. In this embodiment, the receiving module is a WiFi receiving module that implements a wireless connection, and the processor may be an ARM processor, an intel processor, or another type of processor.

[0037] The WiFi receiving module is provided with an interface for connecting to the video device, the WiFi receiving module receives different types of video data from the video device, and the WiFi receiving module identifies the different types of video data, and then different The type of video data is split, and the corresponding split video data is sent to the processor according to the recognized result.

[0038] In this embodiment, the WiFi receiving module may receive different types of video data of the video device, and may also receive the same type of video data of the video device, and the WiFi receiving module receives the connection manner of the video data of the video device. Includes Miracast connection, chromecast connection and Air play connection.

[0039] The above Miracast connection corresponds to an operating system device of Windows 8.1 and Android 4.2 or other mobile devices supporting Miracast; the above chromecast connection corresponds to a Chromebook and a Google browser; the above Air play connection corresponds to an Apple device.

[0040] After receiving the split video data, the processor converts the split video data according to the type of each video data, and performs format decoding and encoding processing, respectively, and then splits the screen, overlaps the screen, or singles. The way the screen is sent to the screen (projector screen, large LCD screen, TV, etc.).

[0041] The processor establishes a corresponding data stream for each user connection according to a session corresponding to each user connection, and the processor performs format decoding and encoding processing on each video data by using a protocol corresponding to the data stream. Thereafter, the processor transmits the formatted and encoded video data to the screen. The manner in which the above processor sends video data to the screen may be a method of dividing a picture, an overlapping picture or a single picture, and displaying different effects on the screen by different transmission methods. among them:

[0042] Single picture output: Although there are multiple channels of the same frequency signal, only one of the signal outputs is selected, and the other is to maintain the connection but not output the picture, the user can quickly switch to select the connection to be output. Face.

[0043] Split screen output: is to divide the screen into two or four partitions by the user to arrange individual signals to be respectively placed on different divided screen areas.

[0044] The overlapping picture output is: the content of the connection is superimposed on the screen in a window manner.

The embodiment of the present invention further provides a multi-channel co-screening method, including a multi-channel co-screen device, where the multi-channel co-screen device includes: a processor and a receiving module, wherein the receiving module is connected to the processor. In this embodiment, the processor is a processor, and the receiving module is a WiFi receiving module that implements a wireless connection. The processor may be an ARM processor, an intel processor, or another type of processor.

[0046] Referring to FIG. 2, it is a schematic flowchart of a multi-channel on-screen method according to an embodiment of the present invention, which specifically includes the following steps:

[0047] Step A: The receiving module receives different types of video data from the video device, identifies the different types of video data, and then splits the different types of video data, and then correspondingly segments according to the identified results. The removed video data is sent to the processor;

[0048] In this embodiment, the receiving module is a WiFi receiving module that implements a wireless connection. The WiFi receiving module can receive different types of video data of the video device, and can also receive the same type of video data of the video device, and the connection manner of the video data received by the WiFi receiving module to the video device includes a Mimcast connection, a chromecast connection, and Air play connection.

[0049] The above Miracast connection identifies video data corresponding to operating system devices of Windows 8.1 and Android 4.2 or other mobile devices supporting Mimcast and sends them to the processor; the above chromecast connection identification corresponds to the Chromebook and the Google browser. The video data is sent to the processor; the above Air play connection identifies the video data corresponding to the Apple device and sends it to the processor.

[0050] Step B: After receiving the split video data, the processor converts the split video data according to the type of each video data, and performs format decoding and encoding processing, respectively, and then splits the screen and overlaps the screen. Or send it to the screen in a single screen (projector screen, large LCD screen, TV, etc.). Different effects are displayed on the screen by different sending methods.

[0051] In the above step B of the embodiment, more specifically, the processor establishes a corresponding data stream for each user connection according to a session corresponding to each user connection, and the protocol pair corresponding to the data flow is used. Each video data is separately subjected to format decoding and encoding processing. 3 is a schematic diagram of an application example of a multi-channel on-screen device in an embodiment of the present invention.

[0053] First, the video device of the client side is connected to the same screen device provided by the present invention through the on-screen protocol (for example, Mimcast, Airplay Chromecast) supported by the user.

[0054] In this embodiment, M1, M2, and M3 in the legend respectively represent Miracast connections corresponding to three independent independent operating systems, where M1 corresponds to an Android Tablet 4.2 or higher operating system, and M2 corresponds to an Android phone 4.2 or higher operating system. M3 corresponds to Win8.1 operating system; C1 is chromecast connection, C1 corresponds to Chromebook or Google Chrome (Chrome); Al and A2 are Air play connection, A1 corresponds to Iphone, A2 corresponds to Ipad, Air play The connection can also correspond to the iPod (the player introduced by Apple), Macbook (Apple laptop), etc.; these above-mentioned screen connection directly enters the WiFi receiving module of the multi-channel device.

[0055] The WiFi receiving module identifies the received video data, performs splitting of the same screen signal according to the result of the identification, splits into different types of video data, and sends different video data to the processor, the processor. Each line is separately processed by Miracast, Chromecast and Airplay on the same screen according to its type, for example, according to the same screen protocol corresponding to the respective video data for format decoding, encoding or patching.

[0056] In this embodiment, the Wifi receiving module is a daemon (background program) program for accepting the user's connection requirements, and processing the front-end connection operation. After receiving the connection requirements of the user terminal, Independent sessions are established according to the connection type. Different connections have different connection processing operations. For the connection of Mimcast, the connection is established based on the WiFi Direct/WPS (WiFi-Protected Setup) protocol. . Airplay is based on Bonjour, ROAP (Remote Audio Output Protocol) to establish the connection, Chromecast is based on DIAL (Discovery And Launch, YouTube and Netflix streaming protocol) to establish a connection, so this part After receiving the connection requirements of the client, the job will first identify the connection type and then process the connection according to the different protocols.

[0057] Each user connection has a separate session, so the processor maintains an independent data stream for each connection. The same data stream transmission protocol is different according to different protocols. Chromecast is based on HTTP (Hyper Text Transfer

Protocol, Hypertext Transfer Protocol), Airplay is based on HTTP/RTSP (Real Time Streaming Protocol)/RTP (Real Time Transport Protocol), issued by IETF The real transmission protocol), Miracast is based on RTSP and RTP.

[0058] The data format is different for different types of connections: Chromecast video is AAC, MP3, Ogg for H.264 audio.

Vorbis, WAV formats; Airplay video is MPEG-4, H.264, M-JPEG audio support MP3, AAC format; Mimcast uses MPEG2-TS format, so each connection will have different audio and video features.

[0059] performing multi-channel on-screen signal output after the multi-channel on-screen signal processing step: in the last output processing, the multi-channel on-screen signal is divided into overlapping screens according to settings or user operations. The screen or single screen is output to the projector screen or LCD, TV, etc. among them:

[0060] Single picture output: Although there are multiple channels of the same frequency signal, only one of the signal outputs is selected. Others maintain the connection but do not output the picture. The user can quickly switch to select the connection picture to be output.

[0061] Split screen output: The division of the screen into two or four divisions is arranged by the user to separately place individual signals on different divided screen areas.

[0062] The overlapping picture output is: The content of the connection is stacked on the screen in a window manner.

[0063] In summary, the multi-channel on-screen device and method provided by the present invention can combine video content of multiple video devices by dividing a picture, overlapping pictures, or hiding one or several pictures. Display on the display, easy to use, the same multi-channel on-screen implementation can expand the application context of the same screen, the same screen technology from the application of the entertainment-oriented application to the commercial application, the invention combined with the projector or It is a large-size LCD, and people who are attending a conference can send their video devices (mobile phones/laptops/tablets) to the projector screen or large-size LCD for discussion.

The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the invention and the drawings are used directly or indirectly. Other related technical fields are equally included in the scope of patent protection of the present invention.

technical problem

Problem solution

Advantageous effects of the invention

Claims

Claim

A multi-channel on-screen device, comprising: a processor and a receiving module, wherein the receiving module is connected to the processor;

The receiving module is provided with an interface for connecting to the video device, the receiving module receives different types of video data from the video device, identifies the different types of video data, and then pairs the different types of video data. Performing the splitting; and transmitting the corresponding split video data to the processor according to the identified result;

After the processor receives the split video data, the split video data is format-converted according to the type of each video data, and respectively subjected to format decoding and encoding processing, and then through split screen, overlapping screen or single screen. The way to send to the screen.

The multi-channel device according to claim 1, wherein the processor establishes a corresponding data stream for each user connection according to a session corresponding to each user connection, and the protocol corresponding to the data stream is used. Each video data is separately subjected to format decoding and encoding processing.

The multi-channel co-screen device according to claim 1, wherein the receiving module is a WiFi receiving module that implements a wireless connection.

The multi-channel device of claim 3, wherein the connection manner of the video data received by the WiFi receiving module to the video device comprises a Mimcast connection, a chromecast connection, and an Air play connection;

The Miracast connection corresponds to an operating system device of Windows 8.1 and Android 4.2 or other mobile devices supporting Miracast; the chromecast connection corresponds to a Chromebook and a Google browser; and the Air play connection corresponds to an Apple device.

A multi-channel on-screen method, comprising: a multi-channel on-screen device, wherein the multi-channel on-screen device comprises: a processor and a receiving module, wherein the receiving module is connected to the processor; The screen method includes the following steps:

Step A: The receiving module receives different types of video data from the video device, identifies the different types of video data, and then splits the different types of video data, and then splits the corresponding data according to the identified result. After the video data is sent to the processor; Step B: After the processor receives the split video data, the split video data is format-converted according to the type of each video data, and respectively subjected to format decoding and encoding processing, and then through split screen, overlapping screen or single screen. The way to send to the screen.

[Claim 6] The multi-channel co-screen method according to claim 5, wherein in the step B, the processor establishes a correspondence for each user connection according to a session corresponding to each user connection. A data stream is subjected to format decoding and encoding processing for each video data by a protocol corresponding to the data stream.

[Claim 7] The multi-channel device according to claim 5, wherein the receiving module is a WiFi receiving module that implements a wireless connection.

[Claim 8] The multi-channel device according to claim 7, wherein the connection manner of the video data received by the WiFi receiving module to the video device includes a Mimcast connection, a chromecast connection, and an Air play connection. ;

The Miracast connection identifies video data corresponding to operating system devices of Windows 8.1 and Android 4.2 or other mobile devices supporting Mimcast and transmits them to the processor; the chromecast connection identifies the corresponding Chromebook and Google Chrome. The video data is sent to the processor; the Air play connection identifies the video data corresponding to the Apple device and sends it to the processor.