CN108124172B - Cloud projection method, device and system - Google Patents
Cloud projection method, device and system Download PDFInfo
- Publication number
- CN108124172B CN108124172B CN201711292228.2A CN201711292228A CN108124172B CN 108124172 B CN108124172 B CN 108124172B CN 201711292228 A CN201711292228 A CN 201711292228A CN 108124172 B CN108124172 B CN 108124172B
- Authority
- CN
- China
- Prior art keywords
- projection
- audio data
- image data
- sending
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1446—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
- H04N21/43632—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wired protocol, e.g. IEEE 1394
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
- H04N21/43637—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
Abstract
The embodiment of the invention provides a cloud projection method, a cloud projection device and a cloud projection system, wherein the method comprises the following steps: recording image data of a screen of the projection sending end; collecting audio data of the projection sending end; and sending the image data and the audio data to a projection display end through a WebRTC standard so as to enable the projection display end to project the image data and play the audio data. The projection sending end and the projection display end transmit image data and audio data uniformly through the WebRTC standard without using data adaptation lines of respective corresponding protocols, so that a point-to-point projection mode is realized, the thread deployment and management difficulty can be reduced, the simultaneous display of the image data and the audio data is realized, and the user experience is good.
Description
Technical Field
The invention relates to the technical field of information display, in particular to a cloud projection method, device and system.
Background
With the development of multimedia technology, the projection function has become a necessary function for office meetings and life entertainment. As shown in fig. 1, the projection sending end device includes, for example, a Notebook PC (Notebook computer), a Tablet PC (Tablet PC), a Mobile Phone (smart Phone), a PC (desktop motor), a DVD Player (digital versatile disc Player), a KTV (karaoke Player), a Game Console, etc., and is connected to the projection display end device (e.g., a projector) through a data cable to implement projection display.
However, the inventor finds that the prior art has at least the following problems in the process of implementing the invention:
along with the diversification of projection sending end equipment, the projection display end equipment needs to communicate under multiple data protocols in order to receive data signals of different types of projection sending end equipment, but the communication ports of different types of data protocols are different, including as follows: VGA (Video Graphics Array, Video Graphics Interface), DVI (Digital Video Interface), HDMI (High Definition multimedia Interface ), USB (Universal Serial Bus), DP (Display Port), and other multiple ports, so that the projection Display end equipment needs to be equipped with multiple types of data adaptation wires, resulting in complex line deployment and increased management difficulty of the lines.
Disclosure of Invention
The embodiment of the invention aims to provide a cloud projection method, a cloud projection device and a cloud projection system, so that the thread deployment and management difficulty is reduced, and the user experience is improved. The specific technical scheme is as follows:
in a first aspect, an embodiment of the present invention provides a cloud projection method, which is applied to a projection sending end, and the method includes:
recording image data of a screen of the projection sending end;
collecting audio data of the projection sending end;
and sending the image data and the audio data to a projection display end through a WebRTC standard so as to enable the projection display end to project the image data and play the audio data.
Optionally, the recording of the image data of the screen of the projection sending end includes:
selecting a designated area on a screen of the projection sending end according to a position selection instruction input by a user;
and recording the image data of the designated area.
Optionally, the acquiring the audio data of the projection sending end includes:
collecting first audio data played by the projection sending end;
acquiring second audio data recorded by a microphone of the projection sending end;
and synchronizing and mixing the first audio data and the second audio data to obtain the audio data.
In a second aspect, an embodiment of the present invention provides a cloud projection method, which is applied to a projection display end, and the method includes:
receiving image data and audio data transmitted by a projection transmitting terminal through a WebRTC standard;
projecting and displaying the image data;
and playing the audio data.
Optionally, the projecting displays the image data, including:
combining the image data transmitted by the plurality of projection transmitting terminals;
and projecting and displaying the combined image data.
Optionally, the projecting displays the image data, including:
and respectively carrying out projection display on the image data sent by the plurality of projection sending ends according to a preset display sequence.
Optionally, the playing the audio data includes:
acquiring a sound removing instruction input by a user, wherein the sound removing instruction identifies audio data to be removed;
in each audio data sent by a plurality of projection sending ends, eliminating the audio data to be eliminated to obtain residual audio data;
and mixing the residual audio data, and playing the mixed residual audio data.
In a third aspect, an embodiment of the present invention provides a cloud projection apparatus, which is applied to a projection transmitting end, and the apparatus includes:
the desktop stream collection module is used for recording image data of a screen of the projection sending end;
the sound collecting and mixing module is used for collecting audio data of the projection transmitting end;
and the WebRTC sending module is used for sending the image data and the audio data to a projection display end through a WebRTC standard so as to enable the projection display end to project the image data and play the audio data.
Optionally, the desktop flow collecting module includes:
the area selection submodule is used for selecting a designated area on a screen of the projection sending end according to a position selection instruction input by a user;
and the recording submodule is used for recording the image data of the specified area.
Optionally, the sound collection and mixing module includes:
the first acquisition submodule is used for acquiring first audio data played by the projection sending end;
the second acquisition submodule is used for acquiring second audio data recorded by the microphone of the projection sending end;
and the audio mixing sub-module is used for synchronizing and mixing the first audio data and the second audio data to obtain the audio data.
In a fourth aspect, an embodiment of the present invention provides a cloud projection apparatus, which is applied to a projection display end, and includes:
the WebRTC receiving module is used for receiving the image data and the audio data which are sent by the projection sending end through the WebRTC standard;
the desktop stream display module is used for displaying the image data in a projection mode;
and the sound playing module is used for playing the audio data.
Optionally, the desktop stream display module includes:
an image combination submodule, configured to combine the image data sent by the plurality of projection sending terminals;
and the projection display submodule is used for projecting and displaying the combined image data.
Optionally, the desktop stream display module is specifically configured to:
and respectively carrying out projection display on the image data sent by the plurality of projection sending ends according to a preset display sequence.
Optionally, the sound playing module includes:
the instruction acquisition submodule is used for acquiring a sound removing instruction input by a user, wherein the sound removing instruction identifies audio data to be removed;
the audio eliminating submodule is used for eliminating the audio data to be eliminated in the audio data sent by the plurality of projection sending ends to obtain residual audio data;
and the audio display sub-module is used for mixing the residual audio data and playing the mixed residual audio data.
In a fifth aspect, an embodiment of the present invention provides an electronic device, which is applied to a projection transmitting end, and includes a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete mutual communication through the communication bus;
the memory is used for storing a computer program;
the processor, when executing the program stored in the memory, implementing the method steps of any of claims 1-3.
In a sixth aspect, an embodiment of the present invention provides an electronic device, which is applied to a projection display end, and includes a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete mutual communication through the communication bus;
the memory is used for storing a computer program;
the processor, when executing the program stored in the memory, is adapted to perform the method steps of any of claims 4-7.
In a seventh aspect, an embodiment of the present invention provides a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the instructions are executed on a computer, the computer is caused to execute any one of the methods, applied to the cloud projection of the projection sending end, of the first aspect.
In an eighth aspect, an embodiment of the present invention provides a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the instructions are executed on a computer, the computer is caused to execute any one of the methods of the second aspect, which is applied to cloud projection of a projection display.
In a ninth aspect, an embodiment of the present invention provides a computer program product containing instructions, which when run on a computer, causes the computer to execute any one of the above methods applied to cloud projection at a projection transmitting end.
In a tenth aspect, an embodiment of the present invention provides a computer program product containing instructions, which when run on a computer, causes the computer to perform any one of the above methods applied to cloud projection of a projection display.
In an eleventh aspect, an embodiment of the present invention provides a cloud projection system, where the system includes:
a projection sending end and a projection display end;
the projection sending terminal is used for recording image data of a screen of the projection sending terminal; collecting audio data of the projection sending end; sending the image data and the audio data to the projection display terminal through a WebRTC standard;
the projection display end is used for receiving the image data and the audio data which are sent by the projection sending end through the WebRTC standard; projecting and displaying the image data; and playing the audio data.
Optionally, the projection transmitting end is specifically configured to: selecting a designated area on a screen of the projection sending end according to a position selection instruction input by a user; recording the image data of the appointed area; collecting audio data of the projection sending end; and sending the image data and the audio data to the projection display terminal through a WebRTC standard.
Optionally, the projection display end is specifically configured to: receiving image data and audio data transmitted by the projection transmitting terminal through a WebRTC standard; respectively carrying out projection display on the image data sent by the plurality of projection sending ends according to a preset display sequence; and playing the audio data.
The cloud projection method, the cloud projection device and the cloud projection system provided by the embodiment of the invention record the image data of the screen of the projection sending end; collecting audio data of the projection sending end; and sending the image data and the audio data to a projection display end through a WebRTC standard so as to enable the projection display end to project the image data and play the audio data. The projection sending end and the projection display end transmit image data and audio data uniformly through the WebRTC standard without using data adaptation lines of respective corresponding protocols, so that a point-to-point projection mode is realized, the thread deployment and management difficulty can be reduced, the simultaneous display of the image data and the audio data is realized, and the user experience is good. Of course, it is not necessary for any product or method of practicing the invention to achieve all of the above-described advantages at the same time.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.
FIG. 1 is a schematic diagram of a projection related apparatus in the prior art;
FIG. 2 is another schematic diagram of a projection related apparatus in the prior art;
fig. 3 is a schematic flowchart of a method for cloud projection applied to a projection transmitting end according to an embodiment of the present invention;
fig. 4 is a flowchart illustrating a method for cloud projection applied to a projection display end according to an embodiment of the present invention;
FIG. 5a is a schematic diagram of a projection display of multiple sets of image data according to an embodiment of the present invention;
FIG. 5b is another illustration of a projection display of multiple sets of image data according to an embodiment of the invention;
FIG. 6 is a schematic diagram of a cloud projection system according to an embodiment of the present invention;
fig. 7 is a schematic diagram of an apparatus for cloud projection applied to a projection transmitting end according to an embodiment of the present invention;
FIG. 8 is a schematic diagram of an apparatus for cloud projection applied to a projection display according to an embodiment of the present invention;
fig. 9 is a schematic diagram of an electronic device applied to a projection transmitting end according to an embodiment of the present invention;
FIG. 10 is a diagram of an electronic device applied to a projection display end according to an embodiment of the invention;
fig. 11 is a schematic diagram of a cloud projection system according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention.
In the related cloud projection technology, a network is uniformly adopted as a data channel, as shown in fig. 2, a server is provided, and a user equipment projects a desktop of the user equipment as a stream onto the server through a router, and then the stream is forwarded to an external projection device through the server, so that projection display is realized. However, the stability and robustness of such a centrally deployed system depend on the server.
In order to overcome the dependence of cloud projection on a server, an embodiment of the present invention provides a cloud projection method, which is applied to a projection sending end, and referring to fig. 3, the method includes:
s301, recording and projecting image data of a screen of a sending end.
The method applied to the cloud projection of the projection sending end can be realized through the collection system.
The collecting system is any system capable of realizing the cloud projection method applied to the projection transmitting end in the embodiment of the invention. For example:
the collection system may be an apparatus comprising: a processor, a memory, a communication interface, and a bus; the processor, the memory and the communication interface are connected through a bus and complete mutual communication; the memory stores executable program code; the processor runs a program corresponding to the executable program code by reading the executable program code stored in the memory, so as to execute the method applied to the cloud projection of the projection transmitting end of the embodiment of the invention.
The collection system may also be an application program, configured to execute the method applied to the cloud projection of the projection sending end in the embodiment of the present invention during running.
The collection system may also be a storage medium for storing executable code for executing the method applied to the cloud projection of the projection transmitting end according to the embodiment of the present invention.
After acquiring a projection start instruction input by a user, the collection system records image data of a screen of the projection sending end, for example, when the collection system is an application installed in the projection sending end, the collection system calls preset screen recording software to record image data of the screen of the projection sending end, or when the collection system is an electronic device, the collection system is connected to a screen output interface of the projection sending end to directly record image data of the screen of the projection sending end, and the collection system encodes the image data, because the transmission of the image data is performed according to a WebRTC (Web Real-Time Communication) standard in the embodiment of the present invention, encoding standards such as VP8 or VP9(VP8 and VP9 are video compression standards issued by google corporation) can be used for encoding. The projection transmitting end is any electronic device, such as a notebook computer, a tablet computer, a smart phone, a desktop motor, a digital versatile disc player, a karaoke player, a game machine and the like.
And S302, collecting the audio data of the projection sending end.
The collecting system collects sound of the projection sending end as audio data, for example, when the collecting system is an application installed in the projection sending end, the collecting system calls preset audio recording software to record the sound of the projection sending end, or when the collecting system is an electronic device, the collecting system is connected with an audio output interface of the projection sending end to directly record the sound of a screen of the projection sending end.
In the embodiment of the present invention, the execution sequence of S301 and S302 is not limited, S301 and then S302 may be executed first, or S302 and then S303 may be executed first, and generally, S301 and S302 are executed simultaneously.
And S303, sending the image data and the audio data to a projection display end through a WebRTC standard so as to enable the projection display end to project the image data and play the audio data.
The collecting system directly sends the image data and the audio data to a projection display terminal, such as a projector, by using a communication technology based on a WebRTC standard, so that the projection display terminal displays the image data and the audio data after receiving the image data and the audio data.
In the embodiment of the invention, by collecting and sending the image data and the audio data, the projection display end can play the sound while projecting the picture, thereby realizing that the sound is projected to the projection display end at the same time. Data are sent to the projection display end through the WebRTC standard, a P2P (Peer-to-Peer) mode is adopted, adaptation of an entity data line is reduced, a server is not needed to be relied on, communication between the projection sending end and the projection display end point is achieved, and the problem of poor stability and robustness caused by server abnormity can be solved.
Optionally, the recording image data of the screen of the projection sending end includes:
step one, selecting a designated area on a screen of the projection sending end according to a position selection instruction input by a user.
The position selection instruction comprises position information of the area to be selected, and the collection system takes the position on the screen of the projection sending end, which corresponds to the area to be selected in the selection instruction, as a designated area.
And step two, recording the image data of the appointed area.
The collecting system records and projects the image data in the designated area of the screen of the sending end and encodes the image data.
In the embodiment of the invention, a user can freely determine the projection area on the screen of the projection sending end through the position selection instruction, and the projection mode is more flexible.
Optionally, the acquiring the audio data of the projection transmitting end includes:
step one, collecting first audio data played by the projection sending end.
Collecting first audio data played by a projection sending end, wherein the first audio data can be collected from a loudspeaker of the projection sending end; the method comprises the steps of collecting first audio data played by a projection sending end, and also can collect first audio data played by any playing software in the projection sending end.
And step two, collecting second audio data recorded by the microphone at the projection transmitting end.
And the collecting system calls a microphone of the projection transmitting end to collect second audio data.
And step three, synchronizing and mixing the first audio data and the second audio data to obtain the audio data.
And the collecting system synchronizes the first audio data and the second audio data according to the time sequence, and performs sound mixing on the time-synchronized first audio data and the time-synchronized second audio data to obtain audio data to be sent to the projection display end.
In the embodiment of the invention, the sound played by the projection sending end and the sound recorded by the projection sending end microphone are collected simultaneously, so that the sound yield of the projection sending end is more comprehensive, and the requirements of users in various aspects can be met.
Optionally, the sending the image data and the audio data to a projection display end through a WebRTC standard to enable the projection display end to project the image data and play the audio data includes:
and sending the image data and the audio data to a plurality of projection display terminals through a WebRTC standard so as to enable the plurality of projection display terminals to project the image data and play the audio data.
In the embodiment of the invention, one projection sending end sends the image data and the audio data to a plurality of projection display ends, so that the plurality of projection display ends can simultaneously display the data of one projection sending end, and various user requirements can be met.
Optionally, the sending the image data and the audio data to a projection display end through a WebRTC standard to enable the projection display end to project the image data and play the audio data includes:
step one, sending the image data and the audio data to the projection display end through a WebRTC standard;
and step two, sending a talkback instruction to the projection display end through a WebRTC standard so that the projection display end can display the image data and/or the audio data in a highlighting mode according to the talkback instruction.
When transmitting the image data and the audio data to the projection display end, if a user wants to highlight the image data and/or the audio data sent by the projection sending end of the user, a talkback instruction can be sent to the projection display end. The spoken instructions identify the highlighted image data and/or audio data. And the projection display end highlights corresponding image data and/or audio data after receiving the talkback instruction.
In the embodiment of the invention, the image data and/or the audio data are/is highlighted by the projection display end by sending the main speaking instruction, so that various user requirements can be met.
The embodiment of the invention provides a cloud projection method, which is applied to a projection display end and is shown in a figure 4, and the method comprises the following steps:
s401, receiving image data and audio data transmitted by a projection transmitting end through a WebRTC standard.
The projection display end is any projection display equipment, such as a projector and the like.
The cloud projection method applied to the projection display end can be realized through the display system.
The display system is any system capable of realizing the cloud projection method applied to the projection transmitting end in the embodiment of the invention. For example:
the display system may be an apparatus comprising: a processor, a memory, a communication interface, and a bus; the processor, the memory and the communication interface are connected through a bus and complete mutual communication; the memory stores executable program code; the processor runs the program corresponding to the executable program code by reading the executable program code stored in the memory, so as to execute the method applied to the cloud projection of the projection exhibition end of the embodiment of the invention.
The display system may also be an application program, configured to execute the method applied to the cloud projection of the projection display end in the embodiment of the present invention during running.
The display system can also be a storage medium for storing executable codes, and the executable codes are used for executing the method applied to the cloud projection of the projection display terminal.
The display system receives the image data and the audio data sent by the projection sending end through the WebRTC standard and decodes the image data and the audio data.
And S402, projecting and displaying the image data.
The display system can independently display the image data transmitted by one projection transmitting terminal and can also display the image data transmitted by a plurality of projection transmitting terminals in a mixed mode.
S403, playing the audio data.
The display system can play the audio data transmitted by one projection transmitting end independently and can also play the audio data transmitted by a plurality of projection transmitting ends in a mixed manner.
In the embodiment of the present invention, the execution sequence of S402 and S403 is not limited, S402 and then S403 may be executed first, or S403 and then S402 may be executed first, and generally, S402 and S403 are executed simultaneously.
In the embodiment of the invention, by displaying the image data and the audio data, the projection display end can play the sound while projecting the picture, thereby realizing that the sound is projected to the projection display end at the same time. Data are received and transmitted through the WebRTC standard, a P2P mode is adopted, adaptation of an entity data line is reduced, a server is not needed, communication between a projection sending end and a projection display end point to point is achieved, and the problems of poor stability and robustness caused by server abnormity can be solved.
Optionally, the projecting and displaying the image data includes:
the first step is to combine the image data transmitted from the plurality of projection transmitting terminals.
And step two, projecting and displaying the combined image data.
The display system correspondingly combines the image data according to the display parameters of the projection display end (for example, the display parameters may be the resolution of the image projected by the projection display end) and the number of projection sending ends, or divides the image displayed by the projection display end into areas with corresponding number, and displays a group of image data in each area by projection.
For example, the resolution of the image projected to the presentation end is 1600 × 1200. The resolutions of four sets of image data transmitted by four projection transmitting ends are 1024 × 768, 800 × 600, and 640 × 480, respectively. The four sets of image data can be converted to 800 × 600 resolution and combined into one 1600 × 1200 image data for presentation.
For example, the resolution of the image projected to the presentation end is 1600 × 1200. The resolutions of two sets of image data transmitted by two projection transmitting ends are 1024 × 768 and 800 × 600, respectively. The resolution of both sets of image data can be converted to 800 × 600 and combined into one 1600 × 600 or 800 × 1200 image data for presentation accordingly.
In the embodiment of the invention, the image data sent by the plurality of projection sending ends are combined and displayed, so that the simultaneous display of the image data of the projection sending ends is realized, and various user requirements can be met.
Optionally, the projecting and displaying the image data includes:
and respectively carrying out projection display on the image data sent by the plurality of projection sending ends according to a preset display sequence.
The preset display order is any display order, for example, display is performed according to the image data receiving order, or display is performed according to the order designated by the user.
In the embodiment of the invention, the sequential display of the image data of each projection sending end is realized, and various user requirements can be met.
Optionally, playing the audio data includes:
step one, a sound removing instruction input by a user is obtained, wherein the sound removing instruction identifies audio data to be removed.
And step two, eliminating the audio data to be eliminated in the audio data sent by the plurality of projection sending ends to obtain residual audio data.
And step three, mixing the residual audio data and playing the mixed residual audio data.
When playing the audio data, the display system can play the designated audio data according to the instruction of the user. For example, the projection display end receives three sets of audio data, namely, a first set of audio data, a second set of audio data, and a third set of audio data, which are sent by three projection sending ends. And at the moment, the user inputs a sound removing instruction, the sound removing instruction identifies that the audio data to be removed is the second group of audio data, the second group of audio data is removed, the first group of audio data and the third group of audio data are synchronized and mixed, and the mixed first group of audio data and the mixed third group of audio data are played.
In the embodiment of the invention, the designated audio data can be removed, the control on the played audio data is realized, and various user requirements can be met.
Optionally, the receiving image data and audio data sent by the projection sending end through the WebRTC standard includes:
and receiving the image data and the audio data which are transmitted by a plurality of projection transmitting terminals through the WebRTC standard.
In the embodiment of the invention, the projection display end can simultaneously receive all image data and all audio data sent by a plurality of projection sending ends, thereby meeting various user requirements.
Optionally, the method for cloud projection applied to the projection display end in the embodiment of the present invention further includes:
step one, receiving a talkback instruction sent by a projection display end through a WebRTC standard.
And step two, highlighting the image data and/or the audio data corresponding to the talkback instruction.
The spoken instructions identify the highlighted image data and/or audio data. And the projection display end highlights corresponding image data and/or audio data after receiving the talkback instruction.
Highlighting the image data may be to increase the resolution of the corresponding image data, to show the corresponding image data in a central position of the image, or the like.
For example, the projection display end is currently displaying four sets of image data, and the projected image is as shown in fig. 5a, where the area 1 corresponds to the first set of image data, the area 2 corresponds to the second set of image data, the area 3 corresponds to the third set of image data, and the area 4 corresponds to the fourth set of image data. When the second set of image data is highlighted by the received logo, the projected image is as shown in FIG. 5 b.
Highlighting audio data may be to increase the decibel of the corresponding audio data and decrease the decibel of the other audio data, or to mute the other audio data directly.
In the embodiment of the invention, the projection display end can display the image data and/or the audio data prominently according to the talkback instruction, and can meet various user requirements.
The embodiment of the invention also provides a cloud projection system, which is shown in fig. 6. The above-mentioned collection system is an application program product, and is installed in a projection sending end, for example, in a smart phone, in a desktop computer, or in a notebook computer. When the application program installed in the projection sending terminal runs, the projection sending terminal can realize any one of the above methods applied to the cloud projection of the projection sending terminal. The application program installed in the projection sending end is compatible with various systems, including: windows system, Mac system, Linux system, Android system, iOS system, etc. The image data and the audio data are based on the WebRTC standard, and are directly transmitted to the projection display end through the router via the network without depending on a server. The display system is a client electronic device and is directly connected with the projector. When the client electronic equipment and the projector run, any one of the above methods applied to the cloud projection of the projection display side is realized.
In the embodiment of the invention, by displaying the image data and the audio data, the projection display end can play the sound while projecting the picture, thereby realizing that the sound is projected to the projection display end at the same time. Data are received and transmitted through the WebRTC standard, adaptation of an entity data line is reduced, a server is not needed, communication between a projection sending end and a projection display end point to point is achieved, and the problems of poor stability and robustness caused by server abnormity can be solved.
An embodiment of the present invention provides a cloud projection apparatus, which is applied to a projection transmitting end, and referring to fig. 7, the apparatus includes:
a desktop stream collection module 701, configured to record image data of a screen of a projection sending end;
a sound collecting and mixing module 702, configured to collect audio data of the projection transmitting end;
the WebRTC sending module 703 is configured to send the image data and the audio data to a projection display end according to a WebRTC standard, so that the projection display end projects the image data and plays the audio data.
The WebRTC sending module is mainly responsible for the transmission of signaling and the transmission of data. The signaling transmission is responsible for establishing connection between the projection sending end and the projection display end and for transmitting control instructions. The data transmission part is responsible for transmitting image data and audio data between the projection sending end and the projection display end, and meanwhile, the data transmission part maintains automatic adjustment of data flow, network disconnection and reconnection and the like when the network changes.
In the embodiment of the invention, by collecting and sending the image data and the audio data, the projection display end can play the sound while projecting the picture, thereby realizing that the sound is projected to the projection display end at the same time. Data are sent to the projection display end through the WebRTC standard, a P2P mode is adopted, adaptation of an entity data line is reduced, a server is not needed, communication between the projection sending end and the projection display end point to point is achieved, and the problem that stability and robustness are poor due to server abnormity can be solved.
Optionally, the desktop flow collecting module 701 includes:
the area selection submodule is used for selecting a designated area on the screen of the projection transmitting end according to a position selection instruction input by a user;
and the recording submodule is used for recording the image data of the appointed area.
In the embodiment of the invention, a user can freely determine the projection area on the screen of the projection sending end through the position selection instruction, and the projection mode is more flexible.
Optionally, the sound collecting and mixing module 702 includes:
and the first acquisition submodule is used for acquiring first audio data played by the projection sending end.
And the second acquisition submodule is used for acquiring second audio data recorded by the microphone at the projection transmitting end.
And the audio mixing sub-module is used for synchronizing and mixing the first audio data and the second audio data to obtain the audio data.
In the embodiment of the invention, the sound played by the projection sending end and the sound recorded by the projection sending end microphone are collected simultaneously, so that the sound yield of the projection sending end is more comprehensive, and the requirements of users in various aspects can be met.
Optionally, the WebRTC sending module 703 is specifically configured to:
and sending the image data and the audio data to a plurality of projection display terminals through a WebRTC standard so as to enable the plurality of projection display terminals to project the image data and play the audio data.
In the embodiment of the invention, one projection sending end sends the image data and the audio data to a plurality of projection display ends, so that the plurality of projection display ends can simultaneously display the data of one projection sending end, and various user requirements can be met.
Optionally, the WebRTC sending module 703 includes:
the data sending submodule is used for sending the image data and the audio data to the projection display terminal through a WebRTC standard;
and the instruction sending submodule is used for sending a talkback instruction to the projection display end through a WebRTC standard so that the projection display end can display the image data and/or the audio data in a highlighting mode according to the talkback instruction.
In the embodiment of the invention, the image data and/or the audio data are/is highlighted by the projection display end by sending the main speaking instruction, so that various user requirements can be met.
An embodiment of the present invention provides a cloud projection apparatus, which is applied to a projection display end, and referring to fig. 8, the apparatus includes:
a WebRTC receiving module 801, configured to receive image data and audio data sent by the projection sending end through the WebRTC standard;
a desktop stream display module 802, configured to display the image data in a projection manner;
and a sound playing module 803, configured to play the audio data.
In the embodiment of the invention, by displaying the image data and the audio data, the projection display end can play the sound while projecting the picture, thereby realizing that the sound is projected to the projection display end at the same time. Data are received and transmitted through the WebRTC standard, a P2P mode is adopted, adaptation of an entity data line is reduced, a server is not needed, communication between a projection sending end and a projection display end point to point is achieved, and the problems of poor stability and robustness caused by server abnormity can be solved.
Optionally, the desktop stream display module 802 includes:
an image combining sub-module for combining the image data transmitted by the plurality of projection transmitting terminals;
and the projection display submodule is used for projecting and displaying the combined image data.
In the embodiment of the invention, the image data sent by the plurality of projection sending ends are combined and displayed, so that the simultaneous display of the image data of the projection sending ends is realized, and various user requirements can be met.
Optionally, the desktop stream display module 802 is specifically configured to:
and respectively carrying out projection display on the image data sent by the plurality of projection sending ends according to a preset display sequence.
In the embodiment of the invention, the sequential display of the image data of each projection sending end is realized, and various user requirements can be met.
Optionally, the sound playing module 803 includes:
the instruction acquisition submodule is used for acquiring a sound removing instruction input by a user, wherein the sound removing instruction identifies audio data to be removed;
an audio eliminating submodule, configured to eliminate the audio data to be eliminated from the audio data sent by the plurality of projection sending terminals to obtain remaining audio data;
and the audio display sub-module is used for mixing the residual audio data and playing the mixed residual audio data.
In the embodiment of the invention, the designated audio data can be removed, the control on the played audio data is realized, and various user requirements can be met.
Optionally, the WebRTC receiving module 801 is specifically configured to:
and receiving the image data and the audio data which are transmitted by a plurality of projection transmitting terminals through the WebRTC standard.
In the embodiment of the invention, the projection display end can simultaneously receive all image data and all audio data sent by a plurality of projection sending ends, thereby meeting various user requirements.
Optionally, the apparatus for cloud projection applied to the projection display end in the embodiment of the present invention further includes:
and the instruction receiving module is used for receiving the talkback instruction sent by the projection display end through the WebRTC standard.
And the highlighting module is used for highlighting the image data and/or the audio data corresponding to the talkback instruction.
In the embodiment of the invention, the projection display end can display the image data and/or the audio data prominently according to the talkback instruction, and can meet various user requirements.
An embodiment of the present invention further provides an electronic device, which is applied to a projection transmitting end, and as shown in fig. 9, the electronic device includes a processor 901, a communication interface 902, a memory 903, and a communication bus 904, where the processor 901, the communication interface 902, and the memory 903 complete mutual communication through the communication bus 904,
a memory 903 for storing computer programs;
the processor 901 is configured to implement the following steps when executing the program stored in the memory 903:
recording image data of a screen of a projection sending end;
collecting audio data of the projection sending end;
and sending the image data and the audio data to a projection display end through a WebRTC standard so as to enable the projection display end to project the image data and play the audio data.
In the embodiment of the invention, by collecting and sending the image data and the audio data, the projection display end can play the sound while projecting the picture, thereby realizing that the sound is projected to the projection display end at the same time. Data are sent to the projection display end through the WebRTC standard, a P2P mode is adopted, adaptation of an entity data line is reduced, a server is not needed, communication between the projection sending end and the projection display end point to point is achieved, and the problem that stability and robustness are poor due to server abnormity can be solved.
Optionally, when the processor 901 is configured to execute the program stored in the memory 903, any of the above methods applied to cloud projection of the projection transmitting end may also be implemented.
The embodiment of the present invention further provides an electronic device, which is applied to a projection display end, as shown in fig. 10, and includes a processor 1001, a communication interface 1002, a memory 1003 and a communication bus 1004, wherein the processor 1001, the communication interface 1002 and the memory 1003 complete mutual communication through the communication bus 1004,
a memory 1003 for storing a computer program;
the processor 1001 is configured to implement the following steps when executing the program stored in the memory 1003:
receiving image data and audio data transmitted by a projection transmitting terminal through a WebRTC standard;
projecting and displaying the image data;
and playing the audio data.
In the embodiment of the invention, by displaying the image data and the audio data, the projection display end can play the sound while projecting the picture, thereby realizing that the sound is projected to the projection display end at the same time. Data are received and transmitted through the WebRTC standard, a P2P mode is adopted, adaptation of an entity data line is reduced, a server is not needed, communication between a projection sending end and a projection display end point to point is achieved, and the problems of poor stability and robustness caused by server abnormity can be solved.
Optionally, when the processor 1001 is configured to execute the program stored in the memory 1003, any one of the above methods applied to the cloud projection of the projection display end may also be implemented.
Optionally, the electronic device applied to the projection display end may be a projector, and the projector further includes a projection module and a sound playing module, where the projection module and the sound playing module are under the command of the processor 1001, so as to implement any of the above methods applied to the cloud projection of the projection display end.
The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the electronic equipment and other equipment.
The Memory may include a Random Access Memory (RAM) or a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the Integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.
In another embodiment provided by the present invention, a computer-readable storage medium is further provided, where instructions are stored in the computer-readable storage medium, and when the instructions are executed on a computer, the computer is caused to execute any one of the above-described methods applied to cloud projection of a projection transmitting end.
In the embodiment of the invention, by collecting and sending the image data and the audio data, the projection display end can play the sound while projecting the picture, thereby realizing that the sound is projected to the projection display end at the same time. The data are sent to the projection display end through the WebRTC standard, adaptation of an entity data line is reduced, a server is not needed, communication from the projection sending end to the projection display end point is achieved, and the problems of poor stability and robustness caused by server abnormity can be solved.
In another embodiment provided by the present invention, a computer-readable storage medium is further provided, in which instructions are stored, and when the instructions are executed on a computer, the computer is caused to execute any one of the above-described methods applied to cloud projection of a projection display.
In the embodiment of the invention, by displaying the image data and the audio data, the projection display end can play the sound while projecting the picture, thereby realizing that the sound is projected to the projection display end at the same time. Data are received and transmitted through the WebRTC standard, adaptation of an entity data line is reduced, a server is not needed, communication between a projection sending end and a projection display end point to point is achieved, and the problems of poor stability and robustness caused by server abnormity can be solved.
In yet another embodiment provided by the present invention, a computer program product containing instructions is also provided, which when run on a computer, causes the computer to execute the method applied to the cloud projection of the projection transmitting end in the above embodiments.
In the embodiment of the invention, by collecting and sending the image data and the audio data, the projection display end can play the sound while projecting the picture, thereby realizing that the sound is projected to the projection display end at the same time. The data are sent to the projection display end through the WebRTC standard, adaptation of an entity data line is reduced, a server is not needed, communication from the projection sending end to the projection display end point is achieved, and the problems of poor stability and robustness caused by server abnormity can be solved.
In yet another embodiment provided by the present invention, a computer program product containing instructions is also provided, which when run on a computer, causes the computer to execute the method applied to the cloud projection of the projection exhibition terminal in the above embodiments.
In the embodiment of the invention, by displaying the image data and the audio data, the projection display end can play the sound while projecting the picture, thereby realizing that the sound is projected to the projection display end at the same time. Data are received and transmitted through the WebRTC standard, adaptation of an entity data line is reduced, a server is not needed, communication between a projection sending end and a projection display end point to point is achieved, and the problems of poor stability and robustness caused by server abnormity can be solved.
An embodiment of the present invention further provides a cloud projection system, as shown in fig. 11, including:
a projection sending end 1101 and a projection display end 1102;
the projection transmitter 1101 is configured to record image data of a screen of the projection transmitter 1101; collecting audio data of the projection transmitting terminal 1101; sending the image data and the audio data to a projection display terminal 1102 through a WebRTC standard;
the projection display terminal 1102 is configured to receive image data and audio data sent by the projection sending terminal 1101 according to the WebRTC standard; projecting and displaying the image data; and playing the audio data.
In the embodiment of the invention, by displaying the image data and the audio data, the projection display end can play the sound while projecting the picture, thereby realizing that the sound is projected to the projection display end at the same time. Data are received and transmitted through the WebRTC standard, adaptation of an entity data line is reduced, a server is not needed, communication between a projection sending end and a projection display end point to point is achieved, and the problems of poor stability and robustness caused by server abnormity can be solved.
Optionally, the projection sending end 1101 is specifically configured to select a designated area on a screen of the projection sending end 1101 according to a position selection instruction input by a user; recording the image data of the appointed area; collecting audio data of the projection transmitting terminal 1101; and sending the image data and the audio data to the projection display terminal 1102 through the WebRTC standard.
In the embodiment of the invention, a user can freely determine the projection area on the screen of the projection sending end through the position selection instruction, and the projection mode is more flexible.
Optionally, the projection sending end 1101 is specifically configured to record image data of a screen of the projection sending end 1101; collecting first audio data played by the projection sending terminal 1101; acquiring second audio data recorded by a microphone of the projection sending terminal 1101; and synchronizing and mixing the first audio data and the second audio data to obtain the audio data. (ii) a Sending the image data and the audio data to a projection display terminal 1102 through a WebRTC standard;
in the embodiment of the invention, the sound played by the projection sending end and the sound recorded by the projection sending end microphone are collected simultaneously, so that the sound yield of the projection sending end is more comprehensive, and the requirements of users in various aspects can be met.
Optionally, the projection display terminal 1102 is specifically configured to receive image data and audio data sent by the projection sending terminal 1101 according to the WebRTC standard; combining the image data transmitted by a plurality of projection transmitting terminals; projecting and displaying the combined image data; and playing the audio data.
In the embodiment of the invention, the image data sent by the plurality of projection sending ends are combined and displayed, so that the simultaneous display of the image data of the projection sending ends is realized, and various user requirements can be met.
Optionally, the projection display terminal 1102 is specifically configured to receive image data and audio data sent by the projection sending terminal 1101 according to the WebRTC standard; respectively carrying out projection display on the image data sent by a plurality of projection sending ends according to a preset display sequence; and playing the audio data.
In the embodiment of the invention, the sequential display of the image data of each projection sending end is realized, and various user requirements can be met.
Optionally, the projection display terminal 1102 is specifically configured to receive image data and audio data sent by the projection sending terminal 1101 according to the WebRTC standard; projecting and displaying the image data; acquiring a voice removing instruction input by a user, wherein the voice removing instruction identifies audio data to be removed; in each audio data sent by a plurality of projection sending ends, eliminating the audio data to be eliminated to obtain residual audio data; and mixing the residual audio data, and playing the mixed residual audio data.
In the embodiment of the invention, the designated audio data can be removed, the control on the played audio data is realized, and various user requirements can be met.
Optionally, the projection sending terminal 1101 is further configured to send a talkback instruction to the projection display terminal according to the WebRTC standard; correspondingly, the projection display terminal 1102 is further configured to receive the talkback command, and highlight the image data and/or the audio data corresponding to the talkback command.
In the embodiment of the invention, the projection display end can display the image data and/or the audio data prominently according to the talkback instruction, and can meet various user requirements.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the apparatus, the electronic device, the storage medium, the computer program product and the system embodiment, since they are substantially similar to the method embodiment, the description is relatively simple, and the relevant points can be referred to the partial description of the method embodiment.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (13)
1. A cloud projection method is applied to a projection sending end, and comprises the following steps:
recording image data of a screen of the projection sending end;
collecting first audio data played by the projection sending end;
acquiring second audio data recorded by a microphone of the projection sending end;
synchronizing and mixing the first audio data and the second audio data to obtain audio data;
sending the image data and the audio data to a projection display end through a WebRTC standard; and sending a talkback instruction to the projection display end through a WebRTC standard so that the projection display end can display the image data and/or the audio data in a highlighting mode according to the talkback instruction.
2. The method of claim 1, wherein the recording of the image data of the screen at the projection transmitter comprises:
selecting a designated area on a screen of the projection sending end according to a position selection instruction input by a user;
and recording the image data of the designated area.
3. A cloud projection method is applied to a projection display end, and comprises the following steps:
receiving image data and audio data transmitted by a projection transmitting terminal through a WebRTC standard;
projecting and displaying the image data;
acquiring a sound removing instruction input by a user, wherein the sound removing instruction identifies audio data to be removed;
in each audio data sent by a plurality of projection sending ends, eliminating the audio data to be eliminated to obtain residual audio data;
mixing the residual audio data, and playing the mixed residual audio data;
receiving a talkback instruction sent by a projection display end through a WebRTC standard; and highlighting image data and/or audio data corresponding to the talkback instruction.
4. The method of claim 3, wherein the projecting presents the image data, comprising:
combining the image data transmitted by the plurality of projection transmitting terminals;
and projecting and displaying the combined image data.
5. The method of claim 3, wherein the projecting presents the image data, comprising:
and respectively carrying out projection display on the image data sent by the plurality of projection sending ends according to a preset display sequence.
6. The utility model provides a device of cloud projection which characterized in that is applied to the projection sending end, the device includes:
the desktop stream collection module is used for recording image data of a screen of the projection sending end;
a sound collection and mixing module, the sound collection and mixing module comprising:
the first acquisition submodule is used for acquiring first audio data played by the projection sending end;
the second acquisition submodule is used for acquiring second audio data recorded by the microphone of the projection sending end;
the audio mixing sub-module is used for synchronizing and mixing the first audio data and the second audio data to obtain the audio data;
the WebRTC sending module is used for sending the image data and the audio data to a projection display end through a WebRTC standard; and sending a talkback instruction to the projection display end through a WebRTC standard so that the projection display end can display the image data and/or the audio data in a highlighting mode according to the talkback instruction.
7. The apparatus of claim 6, wherein the desktop flow collection module comprises:
the area selection submodule is used for selecting a designated area on a screen of the projection sending end according to a position selection instruction input by a user;
and the recording submodule is used for recording the image data of the specified area.
8. A cloud projection device is applied to a projection display end, and comprises:
the WebRTC receiving module is used for receiving the image data and the audio data which are sent by the projection sending end through the WebRTC standard;
the desktop stream display module is used for displaying the image data in a projection mode;
the sound playing module, the sound playing module includes:
the instruction acquisition submodule is used for acquiring a sound removing instruction input by a user, wherein the sound removing instruction identifies audio data to be removed;
the audio eliminating submodule is used for eliminating the audio data to be eliminated in the audio data sent by the plurality of projection sending ends to obtain residual audio data;
the audio display sub-module is used for mixing the audio of the residual audio data and playing the mixed residual audio data;
the instruction receiving module is used for receiving a talkback instruction sent by the projection display end through the WebRTC standard;
and the highlighting module is used for highlighting the image data and/or the audio data corresponding to the talkback instruction.
9. The apparatus of claim 8, wherein the desktop stream display module comprises:
an image combination submodule, configured to combine the image data sent by the plurality of projection sending terminals;
and the projection display submodule is used for projecting and displaying the combined image data.
10. The apparatus of claim 8, wherein the desktop stream display module is specifically configured to:
and respectively carrying out projection display on the image data sent by the plurality of projection sending ends according to a preset display sequence.
11. A cloud projection system, the system comprising:
a projection sending end and a projection display end;
the projection sending terminal is used for recording image data of a screen of the projection sending terminal; collecting first audio data played by the projection sending end; acquiring second audio data recorded by a microphone of the projection sending end; synchronizing and mixing the first audio data and the second audio data to obtain audio data; sending the image data and the audio data to the projection display terminal through a WebRTC standard; sending a talkback instruction to the projection display end through a WebRTC standard so that the projection display end can display the image data and/or the audio data in a highlighted mode according to the talkback instruction;
the projection display end is used for receiving the image data and the audio data which are sent by the projection sending end through the WebRTC standard; projecting and displaying the image data; acquiring a sound removing instruction input by a user, wherein the sound removing instruction identifies audio data to be removed; in each audio data sent by a plurality of projection sending ends, eliminating the audio data to be eliminated to obtain residual audio data; mixing the residual audio data, and playing the mixed residual audio data; receiving a talkback instruction sent by a projection display end through a WebRTC standard; and highlighting image data and/or audio data corresponding to the talkback instruction.
12. The system of claim 11, wherein the projection transmitter is specifically configured to: selecting a designated area on a screen of the projection sending end according to a position selection instruction input by a user; recording the image data of the appointed area; collecting audio data of the projection sending end; and sending the image data and the audio data to the projection display terminal through a WebRTC standard.
13. The system of claim 11, wherein the projection presentation end is specifically configured to: receiving image data and audio data transmitted by the projection transmitting terminal through a WebRTC standard; respectively carrying out projection display on the image data sent by the plurality of projection sending ends according to a preset display sequence; and playing the audio data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711292228.2A CN108124172B (en) | 2017-12-08 | 2017-12-08 | Cloud projection method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711292228.2A CN108124172B (en) | 2017-12-08 | 2017-12-08 | Cloud projection method, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108124172A CN108124172A (en) | 2018-06-05 |
| CN108124172B true CN108124172B (en) | 2021-01-22 |
Family
ID=62229001
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711292228.2A Active CN108124172B (en) | 2017-12-08 | 2017-12-08 | Cloud projection method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108124172B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110109636B (en) * | 2019-04-28 | 2022-04-05 | 华为技术有限公司 | Screen projection method, electronic device and system |
| CN110381197B (en) * | 2019-06-27 | 2021-06-15 | 华为技术有限公司 | Method, device and system for processing audio data in many-to-one screen projection |
| CN110535871B (en) * | 2019-09-09 | 2022-04-19 | 焦点教育科技有限公司 | WebRTC-based classroom real-time video projection method and system |
| CN111030921B (en) * | 2019-12-17 | 2023-02-10 | 杭州涂鸦信息技术有限公司 | Multi-window communication method and system based on webpage instant messaging |
| CN111510754A (en) * | 2020-04-27 | 2020-08-07 | 四川长虹电器股份有限公司 | Method for reducing sound delay of external Bluetooth sound box of smart television |
| CN114845144B (en) * | 2022-04-26 | 2023-12-15 | 长沙朗源电子科技有限公司 | Screen projection method, auxiliary screen projection device and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202818483U (en) * | 2012-08-16 | 2013-03-20 | 山西省电力公司大同供电分公司 | Television conference system |
| CN103702062A (en) * | 2013-12-27 | 2014-04-02 | Tcl集团股份有限公司 | Audio and video communication method, device and system |
| CN104079597A (en) * | 2013-03-26 | 2014-10-01 | 华为终端有限公司 | Transfer method of media stream and user equipment |
| CN105739937A (en) * | 2016-01-27 | 2016-07-06 | 努比亚技术有限公司 | Mobile terminal projection method and system, and terminal equipment |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130329114A1 (en) * | 2012-06-08 | 2013-12-12 | Samsung Electronics Co., Ltd. | Image magnifier for pin-point control |
-
2017
- 2017-12-08 CN CN201711292228.2A patent/CN108124172B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202818483U (en) * | 2012-08-16 | 2013-03-20 | 山西省电力公司大同供电分公司 | Television conference system |
| CN104079597A (en) * | 2013-03-26 | 2014-10-01 | 华为终端有限公司 | Transfer method of media stream and user equipment |
| CN103702062A (en) * | 2013-12-27 | 2014-04-02 | Tcl集团股份有限公司 | Audio and video communication method, device and system |
| CN105739937A (en) * | 2016-01-27 | 2016-07-06 | 努比亚技术有限公司 | Mobile terminal projection method and system, and terminal equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108124172A (en) | 2018-06-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108124172B (en) | Cloud projection method, device and system | |
| JP6626440B2 (en) | Method and apparatus for playing multimedia files | |
| US20160353161A1 (en) | One-screen sharing method, device and system | |
| CN111031368B (en) | Multimedia playing method, device, equipment and storage medium | |
| CN112788383A (en) | Method, system and storage medium for synchronizing media content between different devices | |
| CN102857805A (en) | Method and device for processing signals of mobile terminal | |
| US9584761B2 (en) | Videoconference terminal, secondary-stream data accessing method, and computer storage medium | |
| CN111988647A (en) | Sound and picture synchronous adjusting method, device, equipment and medium | |
| CN103841466A (en) | Screen projection method, computer end and mobile terminal | |
| WO2014190655A1 (en) | Application synchronization method, application server and terminal | |
| US20150271417A1 (en) | Tv system with improved video switching capabilities, and associated tv environment, server and terminal | |
| US20190361830A1 (en) | Electronic device and control method thereof | |
| CN104837046A (en) | Multi-media file processing method and device | |
| CN111131891A (en) | Audio and video playing method and device, playing equipment and system | |
| WO2015135297A1 (en) | Wireless microphone, video conference system, and operating method therefor | |
| US20180152739A1 (en) | Device-Based Audio-Format Selection | |
| CN114840282B (en) | Screen recording method and screen recording device of intelligent interaction panel | |
| CN115278332A (en) | Display device, playing device and data transmission method | |
| CN114639392A (en) | Audio processing method and device, electronic equipment and storage medium | |
| CN103686045A (en) | Audio/video information transmission method and equipment | |
| CN113489934A (en) | Intelligent housekeeper server, system and screen remote interaction method | |
| US8943247B1 (en) | Media sink device input identification | |
| US20180316739A1 (en) | Method and device for realizing compatibility of secondary video | |
| CN113129915B (en) | Audio sharing method, device, equipment, storage medium and program product | |
| CN113473168B (en) | Live broadcast method and system, live broadcast method executed by portable device and portable device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |