CN109327728B - One-to-many same-screen method, device and system, same-screen equipment and storage medium - Google Patents

One-to-many same-screen method, device and system, same-screen equipment and storage medium Download PDF

Info

Publication number
CN109327728B
CN109327728B CN201811407866.9A CN201811407866A CN109327728B CN 109327728 B CN109327728 B CN 109327728B CN 201811407866 A CN201811407866 A CN 201811407866A CN 109327728 B CN109327728 B CN 109327728B
Authority
CN
China
Prior art keywords
screen
content
terminal
split
same
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811407866.9A
Other languages
Chinese (zh)
Other versions
CN109327728A (en
Inventor
卢启伟
卢炀
刘胜强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Eaglesoul Technology Co Ltd
Original Assignee
Shenzhen Eaglesoul Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Eaglesoul Technology Co Ltd filed Critical Shenzhen Eaglesoul Technology Co Ltd
Priority to CN201811407866.9A priority Critical patent/CN109327728B/en
Priority to PCT/CN2019/071663 priority patent/WO2020103326A1/en
Publication of CN109327728A publication Critical patent/CN109327728A/en
Application granted granted Critical
Publication of CN109327728B publication Critical patent/CN109327728B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43632Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wired protocol, e.g. IEEE 1394
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses a one-to-many same-screen method, a one-to-many same-screen device, a one-to-many same-screen system, a same-screen device and a storage medium, wherein the method comprises the following steps: acquiring screen projection content sent by a first terminal, wherein the screen projection content is an audio-video data stream generated by recording and coding a screen of the first terminal; decoding the screen projection content and displaying the decoded screen projection content in a screen projection window; recording and coding a self screen to generate split screen content; and respectively sending the split screen content to a plurality of second terminals. The invention generates split screen content by re-recording and encoding after decoding and outputting the screen projection content, and then respectively sends the split screen content to the plurality of second terminals, thereby realizing one-to-many same screen.

Description

One-to-many same-screen method, device and system, same-screen equipment and storage medium
Technical Field
The invention relates to the technical field of multimedia, in particular to a one-to-many same-screen method, device and system, same-screen equipment and a storage medium.
Background
In the prior art, the computer and the mobile phone are connected under the same wifi, so that the mobile phone and the computer can be displayed on the same screen. Currently, there are three main wireless on-screen technologies for transmitting screen contents of one terminal to another terminal via wifi: DLNA, AirPlay, Miracast. The DLNA is based on UPNP networking, can wirelessly play the existing multimedia resources or files, and does not support screen projection. Miracast, namely wifi display, is a wireless display standard based on wifi direct, and can realize wireless screen projection, but the connection process is relatively slow, and the wireless screen projection is not easy to operate and has poor experience. AirPlay, supports file playback and screen projection, but more is applicable only to certified apple devices and some apple-authorized partners.
The technical scheme is mainly applied to one-to-one screen projection scenes, and can not adapt to the same screen of dozens or even hundreds of terminals in the teaching field.
Disclosure of Invention
The present invention is directed to a one-to-many same-screen method, apparatus, device and system, so as to solve the problems in the background art.
According to an aspect of the present invention, there is provided a one-to-many same-screen method, including:
acquiring screen projection content sent by a first terminal, wherein the screen projection content is an audio-video data stream generated by recording and coding a screen of the first terminal;
decoding the screen projection content and displaying the decoded screen projection content in a screen projection window;
recording and coding a self screen to generate split screen content;
and respectively sending the split screen content to a plurality of second terminals.
In one embodiment of the invention, the screen projection content is encoded with a first encoding quality, and the split screen content is encoded with a second encoding quality, wherein the first encoding quality is higher than the second encoding quality.
In one embodiment of the invention, the second coding quality is determined based on the number of second terminals and the performance of the network in which the second terminals are currently located.
In one embodiment of the present invention, the first encoding quality and the second encoding quality include: bit rate, resolution and frame rate.
In an embodiment of the present invention, before acquiring the screen-shot content sent by the first terminal, the method includes:
monitoring a screen-casting service port, and establishing screen-casting session connection with a first terminal;
the step of respectively sending the split screen content to a plurality of second terminals comprises:
and monitoring the split screen service port, and respectively establishing split screen session connection with each second terminal.
In an embodiment of the present invention, the obtaining of the screen-casting content sent by the first terminal, and displaying the screen-casting content on the screen-casting window after decoding the screen-casting content specifically includes:
receiving a first transmission starting instruction sent by a first terminal, and initializing a decoder and a screen projection window;
receiving screen projection content data sent by a first terminal, decoding the screen projection content data, and displaying the decoded screen projection content data on a screen projection window;
and receiving a first transmission ending instruction sent by the first terminal, releasing the decoder and closing the screen projection window.
In one embodiment of the invention, the method further comprises:
receiving an interested area display instruction sent by a first terminal, wherein the interested area display instruction comprises the size and the position of an interested area;
and intercepting the decoded image of the screen projection content data according to the size and the position of the region of interest, and converting the intercepted image to be displayed in a screen projection window.
In an embodiment of the present invention, before sending the split-screen content to the plurality of second terminals, respectively, the sending includes:
setting a write buffer for each split screen session connection, the write buffer having a high water level threshold and a low water level threshold;
stopping writing the split screen content data when the write buffer reaches the high water level threshold;
when the write buffer falls to the low level threshold, the writing of the split-screen content data is resumed.
According to an aspect of the present invention, there is provided a one-to-many same-screen apparatus including:
the screen projection content acquisition module is used for acquiring screen projection content sent by a first terminal, wherein the screen projection content is an audio-video data stream generated by recording and coding a screen of the first terminal;
the screen projection output module decodes the screen projection content and displays the screen projection content on a screen projection window;
the split screen content generation module is used for recording and coding the screen of the user to generate split screen content;
and the split screen content sending module is used for respectively sending the split screen content to the plurality of second terminals.
In one embodiment of the invention, the screen projection content is encoded with a first encoding quality, and the split screen content is encoded with a second encoding quality, wherein the first encoding quality is higher than the second encoding quality.
In an embodiment of the present invention, the on-screen device is configured to perform an operation of implementing the on-screen method according to any one of the above descriptions.
According to an aspect of the present invention, there is provided a one-to-many same-screen device including a memory and a processor, wherein:
a memory to store instructions;
and the processor is used for executing the instructions to enable the on-screen device to execute the operation of realizing the on-screen method.
According to an aspect of the invention, there is provided a same-screen device comprising any one of the above-mentioned same-screen devices.
According to an aspect of the invention, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, carries out the steps of the method of any one of the above.
According to an aspect of the present invention, there is provided a one-to-many on-screen system comprising a first terminal, an on-screen device as described above, and a plurality of second terminals, wherein,
the first terminal is used for recording and coding a screen of the first terminal to generate screen projection content and sending the screen projection content to the same-screen equipment;
the same-screen device is used for acquiring screen projection contents sent by the first terminal, decoding the screen projection contents, displaying the screen projection contents on a screen projection window, recording and coding a screen of the same-screen device to generate split screen contents, and sending the split screen contents to the plurality of second terminals respectively;
and the second terminal is used for receiving the split screen content sent by the same-screen equipment, decoding the split screen content and displaying the decoded split screen content.
In an embodiment of the invention, the on-screen system further includes an AP, the first terminal and the plurality of second terminals are connected to the AP through wifi, and the on-screen device is connected to the AP through a network cable or wifi.
In an embodiment of the present invention, the on-screen system further includes a display device connected to the on-screen device, and the on-screen device is further configured to display the screen-projecting window and the desktop thereof through the display device.
In one embodiment of the invention, the screen projection content is encoded with a first encoding quality, and the split screen content is encoded with a second encoding quality, wherein the first encoding quality is higher than the second encoding quality.
In an embodiment of the present invention, the same-screen device is further configured to generate a two-dimensional code according to its own IP address for display; the first terminal is further used for scanning the two-dimensional code to establish screen-casting session connection with the same-screen equipment and sending the IP address of the same-screen equipment to a plurality of second terminals; and the second terminal establishes split screen conversation connection with the same-screen equipment according to the IP address of the same-screen equipment.
The embodiment of the invention has the following beneficial effects:
the embodiment of the invention generates the split screen content by re-recording and encoding the output decoded split screen content and then respectively sends the split screen content to the plurality of second terminals, thereby realizing one-to-many same screen. The screen projection content and the split screen content are recorded and coded by adopting different coding qualities, so that the high quality of a large-screen output picture is ensured, and the second terminals can share the same screen with low delay. In addition, the re-recording and encoding at the same-screen equipment end can be used for simultaneously displaying the screen projection content of the first terminal to each second terminal, and can also be used for simultaneously displaying the desktop of the same-screen equipment to each second terminal, so that the flexibility of the same screen is enhanced.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Wherein:
FIG. 1 is a flow chart of a one-to-many same screen method in one embodiment of the invention;
figure 2 is a flow chart of a one-to-many same-screen method in another embodiment of the invention,
FIG. 3 is a block diagram of a one-to-many same screen device in accordance with one embodiment of the present invention;
FIG. 4 is a block diagram of a one-to-many same screen device in accordance with another embodiment of the present invention;
fig. 5 is a block diagram of a one-to-many one-screen system in accordance with an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a flow chart of a one-to-many same-screen method according to an embodiment of the present invention. Preferably, this embodiment can be performed by a one-screen device. The method comprises the following steps:
step S102, screen projection content sent by the first terminal is obtained, and the screen projection content is audio and video data streams generated by recording and coding a screen of the first terminal.
In an embodiment of the present invention, a first terminal, a plurality of second terminals, and a same-screen device all establish network connection with a same AP (Access Point, wireless Access node), wherein the first terminal, the plurality of second terminals and the AP establish wireless network connection through wifi, and the same-screen device and the AP establish wireless network connection through wifi and also establish wired network connection through a network cable. In order to guarantee the transmission quality, preferably, the on-screen device and the AP establish a wired network connection through a network cable.
And after the same-screen device is started, acquiring the IP address of the same-screen device to generate a two-dimensional code for displaying. The first terminal scans the two-dimensional code and can establish communication connection with the same-screen device. In an embodiment of the present invention, the IP address of the on-screen device is stored in the first terminal, and the user can establish a communication connection with the on-screen device by clicking or touching the corresponding key. The first terminal records a self screen, the recorded content comprises audio and video, and the audio and video coding mode can adopt H.264 and AAC. When the dynamic rate of the picture is high, the frame rate can reach more than 40 frames at most, which causes great pressure on the bandwidth and can not meet the requirement of real-time transmission and playing. In order to realize effective frame rate control, the aim of improving image quality and fluency under the condition of the same bandwidth can be achieved by setting two-stage conversion storage and adjusting the frame rate within the allowable range of hardware performance.
In one embodiment of the invention, the screen projection content is encoded with a first encoding quality, and the first encoding quality can be preset or dynamically determined by a program according to the performance of the first terminal and the current network state. The first encoding quality includes a bit rate, a resolution, and a frame rate.
And step S104, decoding the screen projection content and displaying the screen projection content in a screen projection window.
The screen projection window is a virtual window set by software and is similar to a playing window of a video player. After the same-screen device is connected with the display device, screen projection contents are output to the display device through the screen projection window.
And step S106, recording and coding the screen of the user to generate split screen content.
In one embodiment of the invention, the same-screen device records and encodes the screen of the same device to generate split-screen content, and the split-screen content is encoded by adopting the second encoding quality. Because the split screen content needs to be synchronized to dozens of hundreds of second terminals, in order to ensure that the low delay is on the same screen, the second coding quality is lower than the first coding quality, and the split screen content can be dynamically set according to the number of the second terminals and the performance of the current network. As above, the second encoding quality also includes bit rate, resolution, and frame rate. In the step, the same-screen device records and encodes the screen content of the same-screen device again, so that the screen projection content of the first terminal can be displayed to the second terminals in the same screen mode, the desktop of the same-screen device can be displayed to the second terminals in the same screen mode, and the flexibility of the same screen is improved.
And step S108, respectively sending the split screen content to a plurality of second terminals.
In one embodiment of the invention, the first terminal sends the IP address of the same-screen device to each second terminal so that the second terminals establish communication connection with the same-screen device; or the second terminal establishes communication connection with the same-screen device by scanning the IP address two-dimensional code of the same-screen device.
Fig. 2 is a flow chart of a one-to-many same-screen method according to another embodiment of the present invention. Preferably, this embodiment can be performed by a one-screen device. The method comprises the following steps:
step S202, a screen-casting service port is monitored, and screen-casting session connection is established with a first terminal; and monitoring the split screen service port, and respectively establishing split screen session connection with each second terminal.
In an embodiment of the present invention, after the same-screen device is started, two service ports (a screen-casting service port and a screen-splitting service port) are fixedly monitored, and a communication connection between the first terminal and the second terminal is waited to be established.
In an embodiment of the present invention, the on-screen device is further configured to generate a two-dimensional code according to its own IP address, and display the two-dimensional code through the display device. The method comprises the steps that a first terminal initiates a screen-casting session connection request to a same-screen device according to an IP address of the same-screen device, and the same-screen device acquires information of the first terminal, registers the information and receives the screen-casting session connection request of the first terminal.
In an embodiment of the present invention, each second terminal respectively initiates a split-screen session connection request to the same-screen device according to the IP address of the same-screen device, and the same-screen device obtains information of the second terminal, registers the information, and then receives the split-screen session connection request of the second terminal.
Step S204, a first transmission starting instruction sent by the first terminal is received, and the decoder and the screen projection window are initialized.
In one embodiment of the invention, the first start transmission instruction includes first encoding quality information such as a bit rate, a resolution, and a frame rate. And the on-screen device initializes the decoder and the screen projection window according to the first transmission starting instruction.
And step S206, receiving the screen projection content data sent by the first terminal, decoding the screen projection content data, and displaying the decoded screen projection content data on a screen projection window.
In one embodiment of the invention, the screen shot content data comprises key frame identification, time stamp, data content and data length.
When the screen content of the first terminal is recorded, the system toolbar is also recorded, and in order to enlarge the display area of the information, an ROI (region of interest) area can be set to remove the unnecessary system toolbar area. In addition, the user can also set the size and the position of the ROI area at the first terminal according to the requirement of the user, so that the same-screen device only displays the ROI area.
In an embodiment of the present invention, the on-screen device is further configured to receive an interested area display instruction sent by the first terminal, where the interested area display instruction includes a size and a position of an interested area; and intercepting the decoded image of the screen projection content data according to the size and the position of the region of interest, and converting the intercepted image to be displayed in a screen projection window.
Step S202 to step S206 realize the screen projection process of the first terminal screen content to the same screen device. Further, the screen projection content needs to be displayed on the same screen to each second terminal which establishes communication connection with the same screen device.
And step S208, recording and coding the screen of the user to generate split screen content.
This step is the same as the embodiment of fig. 1, and is not described herein again.
Step S210, sending a second transmission start instruction to the second terminal.
Before transmitting the divided content data, the on-screen device transmits a second start transmission instruction containing the bit rate, resolution, and frame rate to the second terminal.
Step S212, the split screen content data is sent to the second terminal.
In one embodiment of the invention, the split screen content data includes a key frame identification, a timestamp, data content, and a data length.
In an embodiment of the present invention, before step S212, the method further includes:
setting a write buffer for each split screen session connection, the write buffer having a high water level threshold and a low water level threshold;
stopping writing the split screen content data when the write buffer reaches the high water level threshold;
when the write buffer falls to the low level threshold, the writing of the split-screen content data is resumed.
Step S214, receiving a first end transmission command sent by the first terminal, releasing the decoder and closing the screen-projecting window.
Step S216, receiving a disconnection request sent by the second terminal, stopping sending the split screen content data to the second terminal, and canceling the device information of the second terminal.
It should be noted that step S214 and step S216 are initiated by the first terminal and the second terminal, respectively, and are not limited to being executed last.
In an embodiment of the present invention, the on-screen device is further configured to receive a disconnection request sent by the first terminal, and cancel the device information of the first terminal.
The one-to-many same-screen method provided by the embodiment generates split-screen contents by decoding and outputting the screen-projected contents and re-recording and encoding the decoded split-screen contents, and then respectively sends the split-screen contents to the plurality of second terminals, thereby realizing one-to-many same-screen. The screen projection content and the split screen content are recorded and coded by adopting different coding qualities, so that the high quality of a large-screen output picture is ensured, and the second terminals can share the same screen with low delay.
Fig. 3 is a structural diagram of a one-to-many same-screen device in an embodiment of the present invention, which includes a screen-projection content obtaining module 31, a screen-projection output module 32, a screen-division content generating module 33, and a screen-division content sending module 34, where:
the screen projection content acquiring module 31 is configured to acquire screen projection content sent by a first terminal, where the screen projection content is an audio-video data stream generated by recording and encoding a screen of the first terminal.
In an embodiment of the invention, a first terminal, a plurality of second terminals and a same-screen device all establish network connection with a same AP, wherein the first terminal, the plurality of second terminals and the AP establish wireless network connection through wifi, and the same-screen device and the AP can establish wireless network connection through wifi and wired network connection through a network cable. In order to guarantee the transmission quality, preferably, the on-screen device and the AP establish a wired network connection through a network cable.
And after the same-screen device is started, acquiring the IP address of the same-screen device to generate a two-dimensional code for displaying. The first terminal scans the two-dimensional code and can establish communication connection with the same-screen device. The first terminal records a self screen, the recorded content comprises audio and video, and the audio and video coding mode can adopt H.264 and AAC.
In one embodiment of the present invention, the screen-shot content is encoded with a first encoding quality, which may be preset or dynamically set according to the performance of the first terminal and the current network status. The first encoding quality includes a bit rate, a resolution, and a frame rate.
And the screen projection output module 32 decodes the screen projection content and displays the screen projection content on the screen projection window.
The screen projection window is a virtual window set by software and is similar to a playing window of a video player. After the same-screen device is connected with the display device, screen projection contents are output to the display device through the screen projection window.
And a split screen content generating module 33 for recording and encoding the screen of the user to generate split screen content.
In an embodiment of the present invention, the split-screen content generating module 33 records and encodes the screen of the same-screen device to generate the split-screen content, and the split-screen content is encoded with a second encoding quality, where the second encoding quality is lower than the first encoding quality. The on-screen device is further used for dynamically setting the second coding quality according to the number of the second terminals and the performance of the current network. The second encoding quality includes a bit rate, a resolution, and a frame rate. In the step, the same-screen device can be used for recording and coding the screen content of the same-screen device again, so that the screen projection content of the first terminal can be displayed to the second terminals in the same screen mode, the desktop of the same-screen device can be displayed to the second terminals in the same screen mode, and the flexibility of the same screen is improved.
And a split screen content sending module 34, which sends the split screen content to the plurality of second terminals respectively.
In one embodiment of the invention, the first terminal sends the IP address of the same-screen device to each second terminal so that the second terminals establish split-screen session connection with the same-screen device; or the second terminal establishes split-screen session connection with the same-screen device by scanning the IP address two-dimensional code of the same-screen device.
In an embodiment of the present invention, the same-screen device is configured to perform an operation for implementing the same-screen method according to any one of the above-described embodiments (fig. 1 or fig. 2 embodiments).
The one-to-many same-screen device provided by the embodiment generates split-screen content by decoding and outputting the screen-casting content and re-recording and encoding the decoded output, and then respectively sends the split-screen content to the plurality of second terminals, thereby realizing one-to-many same-screen. The screen projection content and the split screen content are recorded and coded by adopting different coding qualities, so that the high quality of a large-screen output picture is ensured, and the second terminals can share the same screen with low delay.
Fig. 4 is a block diagram of a one-to-many same-screen device according to another embodiment of the present invention, the screen projection device includes a memory 41 and a processor 42, wherein:
a memory 41 for storing a computer program operable on the processor 42.
A processor 42, configured to execute a computer program, so that the screen projection apparatus performs operations for implementing the same-screen method as described in any of the above embodiments (fig. 1 or fig. 2 embodiments).
The one-to-many same-screen device provided by the embodiment generates split-screen content by decoding and outputting the screen-casting content and re-recording and encoding the decoded output, and then respectively sends the split-screen content to the plurality of second terminals, thereby realizing one-to-many same-screen. The screen projection content and the split screen content are recorded and coded by adopting different coding qualities, so that the high quality of a large-screen output picture is ensured, and the second terminals can share the same screen with low delay.
According to another aspect of the present invention, there is provided an apparatus for simultaneous shielding, comprising a device for simultaneous shielding as described in any one of the above embodiments (fig. 3 or fig. 4 embodiments).
The one-to-many same-screen device provided by the embodiment decodes and outputs the screen projection content, records and encodes the decoded screen projection content again to generate the split screen content, and then sends the split screen content to the plurality of second terminals respectively, so that one-to-many same-screen is realized. The screen projection content and the split screen content are recorded and coded by adopting different coding qualities, so that the high quality of a large-screen output picture is ensured, and the second terminals can share the same screen with low delay.
According to another aspect of the present invention, there is provided a computer-readable storage medium, a computer-readable storage medium storing a computer program, which when executed by a memory implements the same-screen method as described in any of the above embodiments (for example, the embodiment of fig. 1 or fig. 2), and can be applied to a smart device; the technical solutions of the foregoing embodiments substantially or partly contribute to the prior art, or all or part of the technical solutions may be embodied in the form of a software product stored in a storage medium, and including several instructions for causing a computer device (which may be a personal computer, a server, a mobile device, a network device, or the like) or a processor (processor) to execute all or part of the steps of the method described in this embodiment. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Based on the computer-readable storage medium provided by the above embodiment of the present invention, the split-screen content is generated by decoding and outputting the screen-casting content and re-recording and encoding the decoded output, and then the split-screen content is respectively sent to the plurality of second terminals, so that one-to-many same-screen is realized. The screen projection content and the split screen content are recorded and coded by adopting different coding qualities, so that the high quality of a large-screen output picture is ensured, and the second terminals can share the same screen with low delay.
Fig. 5 is a block diagram of a one-to-many same-screen system according to an embodiment of the present invention, including: a first terminal 51, the above-mentioned on-screen device 52, a plurality of second terminals 53, wherein,
the first terminal 51 is used for recording and coding a screen of the first terminal to generate screen projection content, and sending the screen projection content to the same-screen equipment 52;
the on-screen device 52 is configured to acquire screen projection content sent by the first terminal 51, decode the screen projection content, display the decoded screen projection content on a screen projection window, record and encode a screen of the on-screen device to generate split screen content, and send the split screen content to the plurality of second terminals 53 respectively;
and the second terminal 53 is configured to receive the split-screen content sent by the same-screen device 52, decode the split-screen content, and display the decoded split-screen content.
In one embodiment of the present invention, the on-screen device 52 supports both wifi and ethernet, the on-screen system further includes an AP54, the first terminal 51 and the plurality of second terminals 53 are connected to the AP54 through wifi, and the on-screen device 52 is connected to the AP54 through network cable or wifi.
In an embodiment of the present invention, the AP supports a 5G frequency band, and may also support a 2.4G frequency band, where the maximum number of supported users is greater than 50.
In one embodiment of the present invention, the on-screen system further includes a display device 55 interfaced with the on-screen device 52, and the on-screen device 52 is further configured to display the screen-shot window and the desktop thereof through the display device. The display device 55 may be a high definition television, a large screen display, an all-in-one machine, a projector, a computer, etc., and the same screen device 52 and the display device 55 may be wired through an HDMI cable, a VGA cable, etc., or may be wirelessly connected through wifi.
In one embodiment of the invention, the screen projection content is encoded with a first encoding quality, and the split screen content is encoded with a second encoding quality, the first encoding quality being higher than the second encoding quality.
In an embodiment of the present invention, the same-screen device 52 is further configured to generate a two-dimensional code according to its own IP address for displaying; the first terminal 51 is further configured to scan the two-dimensional code, establish a screen-casting session connection with the on-screen device 52, and send an IP address of the on-screen device 52 to the plurality of second terminals 53; the second terminal 53 establishes a split screen session connection with the on-screen device 52 according to the IP address of the on-screen device 52.
Based on the one-screen system provided by the embodiment of the invention, the split screen content is generated by decoding and outputting the screen projection content and re-recording and encoding the decoded output screen projection content, and then the split screen content is respectively sent to the plurality of second terminals, so that one-to-many one-screen is realized. The screen projection content and the split screen content are recorded and coded by adopting different coding qualities, so that the high quality of a large-screen output picture is ensured, and the second terminals can share the same screen with low delay.
The on-screen devices described above may be implemented as a general purpose processor, a Programmable Logic Controller (PLC), a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any suitable combination thereof, for performing the functions described herein.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
The above disclosure is only for the purpose of illustrating the preferred embodiments of the present invention, and it is therefore to be understood that the invention is not limited by the scope of the appended claims.

Claims (15)

1. A one-to-many same screen method, the method comprising:
monitoring a screen-casting service port, and establishing screen-casting session connection with a first terminal;
acquiring screen projection content sent by a first terminal, wherein the screen projection content is an audio-video data stream generated by recording and coding a screen of the first terminal;
decoding the screen projection content and displaying the decoded screen projection content in a screen projection window;
recording and coding a self screen to generate split screen content, wherein the split screen content comprises screen projection content of a first terminal and/or desktop display content of a same screen device;
monitoring the split screen service port, and respectively establishing split screen session connection with each second terminal;
respectively sending the split screen content to a plurality of second terminals;
the screen projection content is coded by adopting a first coding quality, the split screen content is coded by adopting a second coding quality, and the first coding quality is higher than the second coding quality.
2. The on-screen method of claim 1, wherein the method further comprises:
and determining the second coding quality according to the number of the second terminals and the performance of the current network.
3. The on-screen method of claim 2, wherein the first encoding quality and the second encoding quality comprise: bit rate, resolution and frame rate.
4. The on-screen method according to claim 1, wherein the acquiring the screen-shot content sent by the first terminal, and the displaying the screen-shot content in the screen-shot window after decoding the screen-shot content specifically comprises:
receiving a first transmission starting instruction sent by a first terminal, and initializing a decoder and a screen projection window;
receiving screen projection content data sent by a first terminal, decoding the screen projection content data, and displaying the decoded screen projection content data on a screen projection window;
and receiving a first transmission ending instruction sent by the first terminal, releasing the decoder and closing the screen projection window.
5. The on-screen method of claim 4, wherein the method further comprises:
receiving an interested area display instruction sent by a first terminal, wherein the interested area display instruction comprises the size and the position of an interested area;
and intercepting the decoded image of the screen projection content data according to the size and the position of the region of interest, and converting the intercepted image to be displayed in a screen projection window.
6. The on-screen method of claim 1, wherein transmitting the split-screen content to a plurality of second terminals respectively comprises:
setting a write buffer for each split screen session connection, the write buffer having a high water level threshold and a low water level threshold;
stopping writing the split screen content data when the write buffer reaches the high water level threshold;
when the write buffer falls to the low level threshold, the writing of the split-screen content data is resumed.
7. A one-to-many same screen apparatus, comprising:
the screen-casting content acquisition module is used for monitoring a screen-casting service port, establishing screen-casting session connection with a first terminal and acquiring screen-casting content sent by the first terminal, wherein the screen-casting content is an audio-video data stream generated by recording and coding a screen of the first terminal;
the screen projection output module decodes the screen projection content and displays the screen projection content on a screen projection window;
the split screen content generating module is used for recording and coding a self screen to generate split screen content, wherein the split screen content comprises screen projection content of the first terminal and/or desktop display content of the same screen device;
the split-screen content sending module monitors the split-screen service ports, establishes split-screen session connection with each second terminal respectively, and sends the split-screen content to the plurality of second terminals respectively;
the screen projection content is coded by adopting a first coding quality, the split screen content is coded by adopting a second coding quality, and the first coding quality is higher than the second coding quality.
8. The on-screen apparatus of claim 7, wherein the on-screen apparatus is configured to perform operations to implement the on-screen method of any one of claims 1-6.
9. A one-to-many same-screen device, comprising a memory and a processor, wherein:
a memory to store instructions;
a processor configured to execute the instructions to cause the on-screen device to perform operations to implement the on-screen method of any of claims 1-6.
10. A device for simultaneous shielding, comprising the device for simultaneous shielding according to any one of claims 7 to 9.
11. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 6.
12. A one-to-many on-screen system comprising a first terminal, the on-screen device of claim 10, a plurality of second terminals, wherein,
the first terminal is used for recording and coding a screen of the first terminal to generate screen projection content and sending the screen projection content to the same-screen equipment;
the on-screen device is used for monitoring the screen-casting service port, establishing screen-casting session connection with the first terminal, acquiring screen-casting content sent by the first terminal, decoding the screen-casting content, displaying the screen-casting content in the screen-casting window, recording and coding a screen of the on-screen device to generate split-screen content, monitoring the split-screen service port, respectively establishing split-screen session connection with each second terminal, and respectively sending the split-screen content to the plurality of second terminals;
the second terminal is used for receiving the split screen content sent by the same-screen equipment, decoding the split screen content and displaying the decoded split screen content;
the screen projection content is coded by adopting a first coding quality, the split screen content is coded by adopting a second coding quality, and the first coding quality is higher than the second coding quality.
13. The on-screen system of claim 12, further comprising an AP, wherein the first terminal and the plurality of second terminals are connected to the AP through wifi, and the on-screen device is connected to the AP through a network cable or wifi.
14. The on-screen system of claim 12 or 13, further comprising a display device interfacing with the on-screen device, wherein the on-screen device is further configured to display the screen-projecting window and its desktop through the display device.
15. The on-screen system of claim 12, wherein the on-screen device is further configured to generate a two-dimensional code for presentation according to its own IP address; the first terminal is further used for scanning the two-dimensional code to establish screen-casting session connection with the same-screen equipment and sending the IP address of the same-screen equipment to a plurality of second terminals; and the second terminal establishes split screen conversation connection with the same-screen equipment according to the IP address of the same-screen equipment.
CN201811407866.9A 2018-11-23 2018-11-23 One-to-many same-screen method, device and system, same-screen equipment and storage medium Active CN109327728B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201811407866.9A CN109327728B (en) 2018-11-23 2018-11-23 One-to-many same-screen method, device and system, same-screen equipment and storage medium
PCT/CN2019/071663 WO2020103326A1 (en) 2018-11-23 2019-01-14 One-to-many screen mirroring method, apparatus, and system, screen mirroring device, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811407866.9A CN109327728B (en) 2018-11-23 2018-11-23 One-to-many same-screen method, device and system, same-screen equipment and storage medium

Publications (2)

Publication Number Publication Date
CN109327728A CN109327728A (en) 2019-02-12
CN109327728B true CN109327728B (en) 2021-10-15

Family

ID=65257943

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811407866.9A Active CN109327728B (en) 2018-11-23 2018-11-23 One-to-many same-screen method, device and system, same-screen equipment and storage medium

Country Status (2)

Country Link
CN (1) CN109327728B (en)
WO (1) WO2020103326A1 (en)

Families Citing this family (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020168498A1 (en) * 2019-02-20 2020-08-27 深圳市鹰硕技术有限公司 Screen projection method, apparatus and system, and intelligent terminal and storage medium
WO2020168499A1 (en) * 2019-02-20 2020-08-27 深圳市鹰硕技术有限公司 Screen-sharing teaching method, apparatus and system, and smart device and storage medium
CN110177399A (en) * 2019-04-30 2019-08-27 深圳市鹰硕技术有限公司 One kind is the same as screen method for connecting network, device, smart machine and storage medium
CN110582749B (en) * 2019-07-11 2022-06-24 深圳市鹰硕技术有限公司 Remote desktop control method, device and system, equipment and storage medium
CN112394892A (en) * 2019-08-15 2021-02-23 北京字节跳动网络技术有限公司 Screen projection method, screen projection equipment, mobile terminal and storage medium
CN111066075A (en) * 2019-09-03 2020-04-24 深圳市鹰硕技术有限公司 Classroom teaching interaction method, terminal and system
CN112631533A (en) * 2019-10-09 2021-04-09 上海博泰悦臻电子设备制造有限公司 Information sharing method, information sharing device, in-vehicle terminal, and storage medium
CN111263217A (en) * 2020-02-18 2020-06-09 深圳市炬力北方微电子有限公司 Wireless screen projection method, wireless screen projection system and computer readable storage medium thereof
CN111405351A (en) * 2020-04-20 2020-07-10 深圳市炬力北方微电子有限公司 Multi-party display method and multi-party display system
CN111417006A (en) * 2020-04-28 2020-07-14 广州酷狗计算机科技有限公司 Video screen projection method, device, terminal and storage medium
CN112383500B (en) * 2020-06-15 2022-09-06 岭博科技(北京)有限公司 Method and system for controlling access request related to screen projection equipment
CN111897504B (en) * 2020-07-14 2024-03-12 西安万像电子科技有限公司 Data display method and device, computer readable storage medium and processor
CN113485605A (en) * 2020-08-24 2021-10-08 青岛海信电子产业控股股份有限公司 Display device, terminal device and screen projection method
CN111966316B (en) * 2020-08-25 2023-08-25 西安万像电子科技有限公司 Image data display method and device and image data display system
CN111988653A (en) 2020-08-25 2020-11-24 京东方科技集团股份有限公司 Interaction method, device, equipment and storage medium for multi-video screen projection information
CN112153457A (en) * 2020-09-10 2020-12-29 Oppo(重庆)智能科技有限公司 Wireless screen projection connection method and device, computer storage medium and electronic equipment
CN112243219A (en) * 2020-10-15 2021-01-19 北京字节跳动网络技术有限公司 Display device, terminal control method and device, terminal and storage medium
CN112367545A (en) * 2020-11-10 2021-02-12 上海明我信息技术有限公司 Screen projection method and device and screen projection equipment
CN112637671B (en) * 2020-12-11 2023-04-28 深圳乐播科技有限公司 Screen sharing method and system
CN112770151A (en) * 2020-12-22 2021-05-07 深圳创维-Rgb电子有限公司 Method, device and storage medium for supporting multi-person interception of screen-projected playing picture
CN114697876B (en) * 2020-12-30 2023-08-22 华为技术有限公司 Local area network screen projection method and device and electronic equipment
CN116848846A (en) * 2021-02-08 2023-10-03 聚好看科技股份有限公司 Media resource pushing method and intelligent terminal
CN113190196B (en) * 2021-04-27 2023-09-05 北京京东振世信息技术有限公司 Multi-device linkage realization method and device, medium and electronic device
CN113316013B (en) * 2021-05-31 2022-04-26 烽火通信科技股份有限公司 Video screen projection method and system
CN115442777A (en) * 2021-06-03 2022-12-06 Oppo广东移动通信有限公司 Screen projection method and device in wireless terminal, wireless terminal and storage medium
CN115442643B (en) * 2021-06-03 2024-09-13 Oppo广东移动通信有限公司 Screen projection method and device, wireless terminal, screen projection equipment and storage medium
CN113282260B (en) * 2021-06-09 2024-04-23 深圳康佳电子科技有限公司 Screen projection control method and device, intelligent terminal and computer readable storage medium
CN113608710A (en) * 2021-07-19 2021-11-05 深圳市炬力北方微电子有限公司 Screen projection method and related equipment
CN113590067A (en) * 2021-07-28 2021-11-02 深圳创维-Rgb电子有限公司 Screen projection control method, system, device and computer readable storage medium
CN113727181B (en) * 2021-08-30 2024-05-17 努比亚技术有限公司 Screen-throwing time delay dynamic configuration method, equipment and computer readable storage medium
CN113934396B (en) * 2021-11-03 2024-08-30 上海商米科技集团股份有限公司 Same-screen display method, device and system
CN114035728B (en) * 2021-11-10 2024-07-02 京东方科技集团股份有限公司 Method for intercepting and pushing page and related equipment
CN114845144B (en) * 2022-04-26 2023-12-15 长沙朗源电子科技有限公司 Screen projection method, auxiliary screen projection device and storage medium
CN117061717B (en) * 2023-10-12 2024-01-09 杭州罗莱迪思科技股份有限公司 Projection spliced video effective control method, system and application thereof

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102457544A (en) * 2010-10-26 2012-05-16 深圳市誉融科技有限公司 Method and system for acquiring screen image in screen sharing system based on Internet
CN103312804A (en) * 2013-06-17 2013-09-18 华为技术有限公司 Screen sharing method, associated equipment and communication system
CN103338221A (en) * 2013-05-20 2013-10-02 珠海市魅族科技有限公司 Data transmission method, data reception method, and terminal
CN104796455A (en) * 2015-03-12 2015-07-22 安徽讯飞皆成软件技术有限公司 Cross-platform multi-screen interacting method, device and system
CN105939539A (en) * 2015-03-05 2016-09-14 思科技术公司 System and method for dynamic bandwidth adjustments for cellular interfaces in a network environment
CN107493484A (en) * 2017-08-18 2017-12-19 三星电子(中国)研发中心 System, method and apparatus for projection screen
CN108521591A (en) * 2018-03-30 2018-09-11 广东工业大学 A kind of throwing screen method, apparatus and system

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1455372A (en) * 2003-05-29 2003-11-12 上海交通大学 Screen sharing and synchronous recording method based on IP network
CN101588252B (en) * 2008-05-23 2011-07-20 华为技术有限公司 Control method and control device of multipoint conference
CN102547248B (en) * 2012-02-03 2014-03-26 深圳锐取信息技术股份有限公司 Multi-channel real-time monitoring single-video-file recording method
CN103414751B (en) * 2013-07-16 2016-08-17 广东工业大学 A kind of PC screen content sharing/interaction control method
JP6303324B2 (en) * 2013-08-09 2018-04-04 株式会社リコー COMMUNICATION SYSTEM, MANAGEMENT DEVICE, COMMUNICATION METHOD, AND PROGRAM
CN104426870B (en) * 2013-08-29 2019-03-15 中兴通讯股份有限公司 Long distance wireless screen sharing method, apparatus and system
CN105898365A (en) * 2015-11-16 2016-08-24 乐视网信息技术(北京)股份有限公司 Cross screen interaction method, device, server and terminal device
CN107040498B (en) * 2016-02-03 2020-09-25 中国移动通信集团公司 Same-screen method and terminal
CN107102694A (en) * 2017-06-06 2017-08-29 南京巨鲨显示科技有限公司 A kind of display with kinescope recording function
CN107659827A (en) * 2017-09-25 2018-02-02 北京小鱼易连科技有限公司 Desktop video code control system based on content analysis

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102457544A (en) * 2010-10-26 2012-05-16 深圳市誉融科技有限公司 Method and system for acquiring screen image in screen sharing system based on Internet
CN103338221A (en) * 2013-05-20 2013-10-02 珠海市魅族科技有限公司 Data transmission method, data reception method, and terminal
CN103312804A (en) * 2013-06-17 2013-09-18 华为技术有限公司 Screen sharing method, associated equipment and communication system
CN105939539A (en) * 2015-03-05 2016-09-14 思科技术公司 System and method for dynamic bandwidth adjustments for cellular interfaces in a network environment
CN104796455A (en) * 2015-03-12 2015-07-22 安徽讯飞皆成软件技术有限公司 Cross-platform multi-screen interacting method, device and system
CN107493484A (en) * 2017-08-18 2017-12-19 三星电子(中国)研发中心 System, method and apparatus for projection screen
CN108521591A (en) * 2018-03-30 2018-09-11 广东工业大学 A kind of throwing screen method, apparatus and system

Also Published As

Publication number Publication date
WO2020103326A1 (en) 2020-05-28
CN109327728A (en) 2019-02-12

Similar Documents

Publication Publication Date Title
CN109327728B (en) One-to-many same-screen method, device and system, same-screen equipment and storage medium
US9665336B2 (en) Direct streaming for wireless display
TWI565310B (en) Video streaming in a wireless communication system
JP4585479B2 (en) Server apparatus and video distribution method
WO2016138844A1 (en) Multimedia file live broadcast method, system and server
US10454986B2 (en) Video synchronous playback method, apparatus, and system
CN110662114B (en) Video processing method and device, electronic equipment and storage medium
CN112752115B (en) Live broadcast data transmission method, device, equipment and medium
US20140139735A1 (en) Online Media Data Conversion Method, Online Video Playing Method and Corresponding Device
TWI513315B (en) Method, system, and tv with picture re-producing function
JP2008523738A (en) Media player having high resolution image frame buffer and low resolution image frame buffer
WO2017084309A1 (en) Device for wirelessly transmitting video, video playing device, method, and system
JP2016530793A (en) Method and apparatus for resource utilization in a source device for wireless display
US20220021872A1 (en) Video encoding method and apparatus, video decoding method and apparatus, storage medium, and electronic device
WO2010114092A1 (en) Distribution system and method, conversion device, and program
CN113938470A (en) Method and device for playing RTSP data source by browser and streaming media server
CN114554277A (en) Multimedia processing method, device, server and computer readable storage medium
CN113014950A (en) Live broadcast synchronization method and system and electronic equipment
WO2018054349A1 (en) Data sending and receiving methods, and apparatuses and systems thereof
CN212137851U (en) Video output device supporting HEVC decoding
KR101678388B1 (en) Video processing method be considered latency, apparatus and cloud streaming service system therefor
JP2018074349A (en) Video processing device, video processing method and video processing program
CN111885403B (en) Wireless screen transmission method supporting double signals and wireless screen transmitter
CN211831022U (en) IPTV set-top box based on 5G communication
CN105898458A (en) DP (Display Port) based video output wireless adaption method, device and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: Room 301, building D, Hongwei Industrial Zone, No.6 Liuxian 3rd road, Xingdong community, Xin'an street, Bao'an District, Shenzhen City, Guangdong Province

Applicant after: SHENZHEN EAGLESOUL TECHNOLOGY Co.,Ltd.

Address before: 518000 Room 202, 2nd floor, building 1, Jianda Industrial Zone, Xin'an Third Road, Bao'an District, Shenzhen City, Guangdong Province

Applicant before: SHENZHEN EAGLESOUL TECHNOLOGY Co.,Ltd.

GR01 Patent grant
GR01 Patent grant