CN113038209A - Wireless screen transmission data processing method and system and computer readable storage medium - Google Patents
Wireless screen transmission data processing method and system and computer readable storage medium Download PDFInfo
- Publication number
- CN113038209A CN113038209A CN202110329877.5A CN202110329877A CN113038209A CN 113038209 A CN113038209 A CN 113038209A CN 202110329877 A CN202110329877 A CN 202110329877A CN 113038209 A CN113038209 A CN 113038209A
- Authority
- CN
- China
- Prior art keywords
- data
- video
- audio
- lossless
- decoding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 42
- 238000003672 processing method Methods 0.000 title claims abstract description 16
- 238000009877 rendering Methods 0.000 claims abstract description 93
- 238000000034 method Methods 0.000 claims abstract description 14
- 238000012545 processing Methods 0.000 claims description 12
- 238000004891 communication Methods 0.000 claims description 10
- 238000000926 separation method Methods 0.000 claims description 3
- 238000004590 computer program Methods 0.000 claims description 2
- 230000009467 reduction Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
- H04N21/43637—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
Abstract
The invention discloses a wireless screen transmission data processing method, a system and a computer readable storage medium, wherein the method is applied to a receiving end of a wireless screen transmission, and comprises the following steps: receiving first data through a millimeter wave module or receiving second data through a wifi module, wherein the first data are lossless audio and video data, and the second data are encoded audio and video encoding data; separating the first data to obtain lossless audio data and lossless video data, or separating the second data to obtain audio coded data and video coded data; and directly rendering and playing the lossless audio data and the lossless video data, or performing protocol decoding and decoding on the audio coded data and the video coded data to obtain audio decoded data and video decoded data, and then performing rendering and playing. The invention can solve the problems of low transmission speed, long time consumption of data decoding, data quality loss, incapability of being compatible with data sent by an old sending end and the like in the prior art.
Description
Technical Field
The invention relates to the technical field of wireless screen transmission, in particular to a wireless screen transmission data processing method, a wireless screen transmission data processing system and a computer readable storage medium.
Background
With the development of science and technology, the wireless screen transmission technology is popularized and applied, and a sending end of the wireless screen transmission can wirelessly transmit audio and video data to a receiving end for playing. In the prior art, a screen transmitting receiving end mainly uses a wifi communication module to receive data, then performs protocol decoding operation on the data according to a defined protocol to obtain audio and video coding data, then performs decoding operation on the audio and video data through a decoding module, and finally performs rendering operation on the decoded data.
The prior art solutions mainly have the following problems:
1. the wifi module is used for communication, the transmission speed is low, the audio and video data can be displayed in real time only by compression operation, and wifi communication is easily influenced by surrounding wifi environment and is easily interfered by a channel;
2. the data decoding operation is time-consuming, and a part of delay is added to the decoding operation;
3. the data after the audio and video coding is lossy data, and problems of font jaggy sense, image blurring, definition reduction and the like can occur after a receiving end decodes and renders;
4. in order to increase the transmission speed, hardware is replaced, and after the hardware is replaced, data sent by an old sending end cannot be compatible.
Disclosure of Invention
Therefore, an embodiment of the present invention provides a wireless screen transmission data processing method, so as to solve the problems of slow transmission speed, long data decoding time consumption, data quality loss, incompatibility with data sent by an old sending end, and the like in the prior art.
The wireless screen transmission data processing method is applied to a receiving end of a wireless screen transmission, the receiving end is provided with a millimeter wave module and a wifi module, and the method comprises the following steps:
receiving first data through a millimeter wave module or receiving second data through a wifi module, wherein the first data are lossless audio and video data, and the second data are encoded audio and video encoding data;
separating the first data to obtain lossless audio data and lossless video data, or separating the second data to obtain audio coded data and video coded data;
and directly rendering and playing the lossless audio data and the lossless video data, or performing protocol decoding and decoding operations on the audio coded data and the video coded data to obtain audio decoded data and video decoded data, and then rendering and playing the audio decoded data and the video decoded data.
According to the wireless screen transmission data processing method, aiming at the problems that wifi transmission speed is low and interference is easy to occur, the millimeter wave module is added at the receiving end, the millimeter wave module can directly receive lossless audio and video data, decoding operation is not needed, the problems of definition reduction, interference and the like can not occur, data can be received at an extremely high speed, the problem of delay increase is avoided, and a display picture is enabled to be consistent with a source picture.
In addition, the wireless screen transmission data processing method according to the above embodiment of the present invention may further have the following additional technical features:
further, the steps of directly performing rendering and playing operations on the lossless audio data and the lossless video data, or performing protocol decoding and decoding operations on the audio coded data and the video coded data to obtain audio decoded data and video decoded data, and performing rendering and playing operations on the audio decoded data and the video decoded data specifically include:
judging whether a rendered picture exists in a display interface of the receiving end;
if the rendered picture exists in the display interface of the receiving end, closing the rendered picture, and disconnecting the communication with the source equipment of the rendered picture;
rendering the lossless video data in a new picture and playing the lossless audio data, or rendering the video decoding data in a new picture and playing the audio decoding data.
Further, after the step of determining whether a rendered screen exists in the display interface of the receiving end, the method further includes:
and if the rendered picture does not exist in the display interface of the receiving end, directly rendering the lossless video data and playing the lossless audio data, or directly rendering the video decoding data and playing the audio decoding data.
Further, the method further comprises:
if the generation time of the lossless video data is earlier than that of the video decoding data, rendering the lossless video data, playing the lossless audio data, closing the rendering of the lossless video data and the playing of the lossless audio data when the video decoding data is obtained, rendering the video decoding data, and playing the audio decoding data;
if the generation time of the video decoding data is earlier than that of the lossless video data, rendering the video decoding data, playing the audio decoding data, and when the lossless video data is obtained, closing the rendering of the video decoding data and the playing of the audio decoding data, rendering the lossless video data, and playing the lossless audio data.
Further, the steps of performing a deprotocolation and decoding operation on the audio coded data and the video coded data specifically include:
carrying out protocol decoding operation on the audio coded data to obtain audio coded data subjected to protocol decoding, and carrying out protocol decoding operation on the video coded data to obtain video coded data subjected to protocol decoding;
and carrying out audio decoding on the audio coded data subjected to the protocol decoding to obtain audio decoded data, and carrying out video decoding on the video coded data subjected to the protocol decoding to obtain video decoded data.
Another embodiment of the present invention provides a wireless screen transmission data processing system to solve the problems of slow transmission speed, long data decoding time consumption, data quality loss, incompatibility with data sent by an old sending end, and the like in the prior art.
The wireless screen transmission data processing system according to one embodiment of the invention is applied to a receiving end of a wireless screen transmission, the receiving end is provided with a millimeter wave module and a wifi module, and the system comprises:
the receiving module is used for receiving first data through the millimeter wave module or receiving second data through the wifi module, wherein the first data are lossless audio and video data, and the second data are encoded audio and video encoding data;
the separation module is used for separating the first data to obtain lossless audio data and lossless video data, or separating the second data to obtain audio coded data and video coded data;
and the rendering and playing module is used for directly performing rendering and playing operations on the lossless audio data and the lossless video data, or performing protocol decoding and decoding operations on the audio coded data and the video coded data to obtain audio decoded data and video decoded data, and then performing rendering and playing operations on the audio decoded data and the video decoded data.
According to the wireless screen transmission data processing system, aiming at the problems that wifi transmission speed is low and interference is easy to occur, the millimeter wave module is added at the receiving end, the millimeter wave module can directly receive lossless audio and video data, decoding operation is not needed, the problems of definition reduction, interference and the like can not occur, data can be received at an extremely high speed, the problem of delay increase is avoided, and a display picture is enabled to be consistent with a source picture.
In addition, the wireless screen transmission data processing system according to the above embodiment of the present invention may further have the following additional technical features:
further, the rendering and playing module is specifically configured to:
judging whether a rendered picture exists in a display interface of the receiving end;
if the rendered picture exists in the display interface of the receiving end, closing the rendered picture, and disconnecting the communication with the source equipment of the rendered picture;
rendering the lossless video data in a new picture and playing the lossless audio data, or rendering the video decoding data in a new picture and playing the audio decoding data.
Further, the rendering and playing module is further configured to:
and if the rendered picture does not exist in the display interface of the receiving end, directly rendering the lossless video data and playing the lossless audio data, or directly rendering the video decoding data and playing the audio decoding data.
Further, the rendering and playing module is further configured to:
if the generation time of the lossless video data is earlier than that of the video decoding data, rendering the lossless video data, playing the lossless audio data, closing the rendering of the lossless video data and the playing of the lossless audio data when the video decoding data is obtained, rendering the video decoding data, and playing the audio decoding data;
if the generation time of the video decoding data is earlier than that of the lossless video data, rendering the video decoding data, playing the audio decoding data, and when the lossless video data is obtained, closing the rendering of the video decoding data and the playing of the audio decoding data, rendering the lossless video data, and playing the lossless audio data.
Further, the rendering and playing module is further configured to:
carrying out protocol decoding operation on the audio coded data to obtain audio coded data subjected to protocol decoding, and carrying out protocol decoding operation on the video coded data to obtain video coded data subjected to protocol decoding;
and carrying out audio decoding on the audio coded data subjected to the protocol decoding to obtain audio decoded data, and carrying out video decoding on the video coded data subjected to the protocol decoding to obtain video decoded data.
Another embodiment of the invention also proposes a computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned method.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The above and/or additional aspects and advantages of embodiments of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a flowchart of a wireless screen transmission data processing method according to an embodiment of the present invention;
FIG. 2 is a detailed flowchart of step S103 in FIG. 1;
fig. 3 is a schematic structural diagram of a wireless screen-through data processing system according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a wireless screen transmission data processing method according to an embodiment of the present invention is applied to a receiving end of a wireless screen transmission, where the receiving end is provided with a millimeter wave module and a wifi module, and the method includes steps S101 to S103:
s101, receiving first data through a millimeter wave module or receiving second data through a wifi module, wherein the first data are lossless audio and video data, and the second data are encoded audio and video encoding data.
Wherein, in this embodiment, on the basis that traditional receiving terminal possesses the wifi module, increased the millimeter wave module, it is corresponding, pass the sending end of screen at wireless, also increased the millimeter wave module. After the receiving end is started, the millimeter wave module and the wifi module in the receiving end are respectively used for receiving data wirelessly transmitted by the sending end, but the data received by the millimeter wave module and the wifi module are different, the first data received by the millimeter wave module is lossless audio and video data, and the second data received by the wifi module is encoded audio and video encoding data. It should be noted that the millimeter wave module and the wifi module do not receive data at the same time, and one of the modules receives data, for example, when the first data is received by the millimeter wave module, the wifi module does not receive the second data, or when the second data is received by the wifi module, the millimeter wave module does not receive the first data.
S102, separating the first data to obtain lossless audio data and lossless video data, or separating the second data to obtain audio coded data and video coded data.
After the millimeter wave module receives the data, decoding operation is not needed, the audio screen and the video data are separated to obtain lossless audio and lossless video data, and the next rendering and playing stage operation is directly carried out. After the wifi module receives the data, the audio coded data and the video coded data need to be separated firstly, and then the data needs to be subjected to protocol decoding and decoding, so that the operations in the rendering and playing stages can be performed.
S103, directly rendering and playing the lossless audio data and the lossless video data, or performing protocol decoding and decoding operations on the audio coded data and the video coded data to obtain audio decoded data and video decoded data, and then rendering and playing the audio decoded data and the video decoded data.
Wherein, the steps of performing the deprotocolation and decoding operations on the audio coded data and the video coded data specifically include:
carrying out protocol decoding operation on the audio coded data to obtain audio coded data subjected to protocol decoding, and carrying out protocol decoding operation on the video coded data to obtain video coded data subjected to protocol decoding;
and carrying out audio decoding on the audio coded data subjected to the protocol decoding to obtain audio decoded data, and carrying out video decoding on the video coded data subjected to the protocol decoding to obtain video decoded data.
According to the wireless screen transmission data processing method provided by the embodiment, aiming at the problems that wifi transmission speed is low and interference is easy to occur, the millimeter wave module is added at the receiving end, the millimeter wave module can directly receive lossless audio and video data, decoding operation is not needed, the problems of definition reduction, interference and the like are avoided, data can be received at a very high speed, and the problem of delay increase is avoided, so that a display picture is consistent with a source picture.
In addition, as a specific example, referring to fig. 2, in step S103, directly performing rendering and playing operations on the lossless audio data and the lossless video data, or performing a protocol decoding and decoding operation on the encoded audio data and the encoded video data to obtain audio decoded data and video decoded data, and then performing rendering and playing operations on the audio decoded data and the video decoded data specifically includes:
and S1031, judging whether a rendered picture exists in the display interface of the receiving end.
S1032, if there is an already rendered screen in the display interface of the receiving end, closing the already rendered screen, and disconnecting the communication with the source device of the already rendered screen.
That is, if there is a rendered screen in the display interface of the receiving end, it is necessary to disconnect the communication with the source device of the rendered screen.
S1033, rendering the lossless video data in a new picture, and playing the lossless audio data, or rendering the video decoded data in a new picture, and playing the audio decoded data.
Specifically, if no rendered picture exists in the display interface of the receiving end, the lossless video data is directly rendered, and the lossless audio data is played, or the video decoding data is directly rendered, and the audio decoding data is played.
Further, as a specific example, the method further includes:
if the generation time of the lossless video data is earlier than that of the video decoding data, rendering the lossless video data, playing the lossless audio data, closing the rendering of the lossless video data and the playing of the lossless audio data when the video decoding data is obtained, rendering the video decoding data, and playing the audio decoding data.
If the generation time of the video decoding data is earlier than that of the lossless video data, rendering the video decoding data, playing the audio decoding data, and when the lossless video data is obtained, closing the rendering of the video decoding data and the playing of the audio decoding data, rendering the lossless video data, and playing the lossless audio data. Therefore, the playing mode of preempting screen projection can be realized.
Referring to fig. 3, based on the same inventive concept, a wireless screen transmission data processing system provided in another embodiment of the present invention is applied to a receiving end of a wireless screen transmission, where the receiving end is provided with a millimeter wave module and a wifi module, and the system includes:
the receiving module 10 is configured to receive first data through the millimeter wave module or receive second data through the wifi module, where the first data is lossless audio and video data, and the second data is encoded audio and video encoded data;
a separation module 20, configured to separate the first data to obtain lossless audio data and lossless video data, or separate the second data to obtain audio coded data and video coded data;
the rendering and playing module 30 is configured to directly perform rendering and playing operations on the lossless audio data and the lossless video data, or perform protocol decoding and decoding operations on the audio coded data and the video coded data to obtain audio decoded data and video decoded data, and then perform rendering and playing operations on the audio decoded data and the video decoded data.
In this embodiment, the rendering and playing module 30 is specifically configured to:
judging whether a rendered picture exists in a display interface of the receiving end;
if the rendered picture exists in the display interface of the receiving end, closing the rendered picture, and disconnecting the communication with the source equipment of the rendered picture;
rendering the lossless video data in a new picture and playing the lossless audio data, or rendering the video decoding data in a new picture and playing the audio decoding data.
In this embodiment, the rendering and playing module 30 is further configured to:
and if the rendered picture does not exist in the display interface of the receiving end, directly rendering the lossless video data and playing the lossless audio data, or directly rendering the video decoding data and playing the audio decoding data.
In this embodiment, the rendering and playing module 30 is further configured to:
if the generation time of the lossless video data is earlier than that of the video decoding data, rendering the lossless video data, playing the lossless audio data, closing the rendering of the lossless video data and the playing of the lossless audio data when the video decoding data is obtained, rendering the video decoding data, and playing the audio decoding data;
if the generation time of the video decoding data is earlier than that of the lossless video data, rendering the video decoding data, playing the audio decoding data, and when the lossless video data is obtained, closing the rendering of the video decoding data and the playing of the audio decoding data, rendering the lossless video data, and playing the lossless audio data.
In this embodiment, the rendering and playing module 30 is further configured to:
carrying out protocol decoding operation on the audio coded data to obtain audio coded data subjected to protocol decoding, and carrying out protocol decoding operation on the video coded data to obtain video coded data subjected to protocol decoding;
and carrying out audio decoding on the audio coded data subjected to the protocol decoding to obtain audio decoded data, and carrying out video decoding on the video coded data subjected to the protocol decoding to obtain video decoded data.
According to the wireless screen transmission data processing system provided by the embodiment, aiming at the problems that wifi transmission speed is low and interference is easy to occur, the millimeter wave module is added at the receiving end, the millimeter wave module can directly receive lossless audio and video data, decoding operation is not needed, the problems of definition reduction, interference and the like are avoided, data can be received at a very high speed, and the problem of delay increase is avoided, so that a display picture is consistent with a source picture.
Furthermore, an embodiment of the present invention also provides a computer-readable storage medium, on which computer instructions are stored, which when executed by a processor implement the steps of the above-mentioned method.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
While embodiments of the invention have been shown and described, it will be understood by those of ordinary skill in the art that: various changes, modifications, substitutions and alterations can be made to the embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their equivalents.
Claims (10)
1. A wireless screen transmission data processing method is characterized by being applied to a wireless screen transmission receiving end, wherein the receiving end is provided with a millimeter wave module and a wifi module, and the method comprises the following steps:
receiving first data through a millimeter wave module or receiving second data through a wifi module, wherein the first data are lossless audio and video data, and the second data are encoded audio and video encoding data;
separating the first data to obtain lossless audio data and lossless video data, or separating the second data to obtain audio coded data and video coded data;
and directly rendering and playing the lossless audio data and the lossless video data, or performing protocol decoding and decoding operations on the audio coded data and the video coded data to obtain audio decoded data and video decoded data, and then rendering and playing the audio decoded data and the video decoded data.
2. The wireless screen transmission data processing method according to claim 1, wherein the steps of directly performing rendering and playing operations on the lossless audio data and the lossless video data, or performing protocol decoding and decoding operations on the audio coded data and the video coded data to obtain audio decoded data and video decoded data, and then performing rendering and playing operations on the audio decoded data and the video decoded data specifically include:
judging whether a rendered picture exists in a display interface of the receiving end;
if the rendered picture exists in the display interface of the receiving end, closing the rendered picture, and disconnecting the communication with the source equipment of the rendered picture;
rendering the lossless video data in a new picture and playing the lossless audio data, or rendering the video decoding data in a new picture and playing the audio decoding data.
3. The wireless screen transmission data processing method according to claim 2, wherein after the step of determining whether the rendered screen exists in the display interface of the receiving end, the method further comprises:
and if the rendered picture does not exist in the display interface of the receiving end, directly rendering the lossless video data and playing the lossless audio data, or directly rendering the video decoding data and playing the audio decoding data.
4. The wireless screen transmission data processing method according to claim 2 or 3, wherein the method further comprises:
if the generation time of the lossless video data is earlier than that of the video decoding data, rendering the lossless video data, playing the lossless audio data, closing the rendering of the lossless video data and the playing of the lossless audio data when the video decoding data is obtained, rendering the video decoding data, and playing the audio decoding data;
if the generation time of the video decoding data is earlier than that of the lossless video data, rendering the video decoding data, playing the audio decoding data, and when the lossless video data is obtained, closing the rendering of the video decoding data and the playing of the audio decoding data, rendering the lossless video data, and playing the lossless audio data.
5. The wireless screen transmission data processing method according to claim 1, wherein the steps of performing de-agreement and decoding operations on the audio coded data and the video coded data specifically include:
carrying out protocol decoding operation on the audio coded data to obtain audio coded data subjected to protocol decoding, and carrying out protocol decoding operation on the video coded data to obtain video coded data subjected to protocol decoding;
and carrying out audio decoding on the audio coded data subjected to the protocol decoding to obtain audio decoded data, and carrying out video decoding on the video coded data subjected to the protocol decoding to obtain video decoded data.
6. The utility model provides a wireless screen data processing system that passes, its characterized in that is applied to the wireless receiving terminal that passes the screen, the receiving terminal is equipped with millimeter wave module and wifi module, the system includes:
the receiving module is used for receiving first data through the millimeter wave module or receiving second data through the wifi module, wherein the first data are lossless audio and video data, and the second data are encoded audio and video encoding data;
the separation module is used for separating the first data to obtain lossless audio data and lossless video data, or separating the second data to obtain audio coded data and video coded data;
and the rendering and playing module is used for directly performing rendering and playing operations on the lossless audio data and the lossless video data, or performing protocol decoding and decoding operations on the audio coded data and the video coded data to obtain audio decoded data and video decoded data, and then performing rendering and playing operations on the audio decoded data and the video decoded data.
7. The wireless screen transmission data processing system of claim 6, wherein the rendering and playing module is specifically configured to:
judging whether a rendered picture exists in a display interface of the receiving end;
if the rendered picture exists in the display interface of the receiving end, closing the rendered picture, and disconnecting the communication with the source equipment of the rendered picture;
rendering the lossless video data in a new picture and playing the lossless audio data, or rendering the video decoding data in a new picture and playing the audio decoding data.
8. The wireless touch screen data processing system of claim 7, wherein the render playback module is further configured to:
and if the rendered picture does not exist in the display interface of the receiving end, directly rendering the lossless video data and playing the lossless audio data, or directly rendering the video decoding data and playing the audio decoding data.
9. The wireless touch screen data processing system of claim 7 or 8, wherein the render playback module is further configured to:
if the generation time of the lossless video data is earlier than that of the video decoding data, rendering the lossless video data, playing the lossless audio data, closing the rendering of the lossless video data and the playing of the lossless audio data when the video decoding data is obtained, rendering the video decoding data, and playing the audio decoding data;
if the generation time of the video decoding data is earlier than that of the lossless video data, rendering the video decoding data, playing the audio decoding data, and when the lossless video data is obtained, closing the rendering of the video decoding data and the playing of the audio decoding data, rendering the lossless video data, and playing the lossless audio data.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110329877.5A CN113038209A (en) | 2021-03-26 | 2021-03-26 | Wireless screen transmission data processing method and system and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110329877.5A CN113038209A (en) | 2021-03-26 | 2021-03-26 | Wireless screen transmission data processing method and system and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113038209A true CN113038209A (en) | 2021-06-25 |
Family
ID=76472666
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110329877.5A Pending CN113038209A (en) | 2021-03-26 | 2021-03-26 | Wireless screen transmission data processing method and system and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113038209A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105979334A (en) * | 2016-07-06 | 2016-09-28 | 乐视控股（北京）有限公司 | Screen content transmission system, terminal and screen content transmission method |
| CN106060965A (en) * | 2016-07-28 | 2016-10-26 | 乐视控股（北京）有限公司 | Screen content conveying method and terminal |
| CN106688284A (en) * | 2014-09-19 | 2017-05-17 | 高通股份有限公司 | Collaborative demand-based dual-mode wi-fi network control to optimize wireless power and performance |
| CN211670948U (en) * | 2020-05-08 | 2020-10-13 | 广州市泰旨信息技术有限公司 | Fan-shaped wireless screen projector host |
| CN212435812U (en) * | 2020-05-29 | 2021-01-29 | 深圳市绿联科技有限公司 | Wireless screen projection device |
-
2021
- 2021-03-26 CN CN202110329877.5A patent/CN113038209A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106688284A (en) * | 2014-09-19 | 2017-05-17 | 高通股份有限公司 | Collaborative demand-based dual-mode wi-fi network control to optimize wireless power and performance |
| CN105979334A (en) * | 2016-07-06 | 2016-09-28 | 乐视控股（北京）有限公司 | Screen content transmission system, terminal and screen content transmission method |
| CN106060965A (en) * | 2016-07-28 | 2016-10-26 | 乐视控股（北京）有限公司 | Screen content conveying method and terminal |
| CN211670948U (en) * | 2020-05-08 | 2020-10-13 | 广州市泰旨信息技术有限公司 | Fan-shaped wireless screen projector host |
| CN212435812U (en) * | 2020-05-29 | 2021-01-29 | 深圳市绿联科技有限公司 | Wireless screen projection device |
Non-Patent Citations (1)
| Title |
|---|
| 图飞飞无线投屏: "无线投屏的三种常见技术", 《无线投屏的三种常见技术》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112087633B (en) | Video decoding method, device and storage medium | |
| KR101634134B1 (en) | System, method, and computer program product for decompression of block compressed images | |
| US11627369B2 (en) | Video enhancement control method, device, electronic device, and storage medium | |
| US11456013B2 (en) | Video decoding control method, electronic device, and storage medium | |
| CN109361950B (en) | Video processing method and device, electronic equipment and storage medium | |
| US20240045641A1 (en) | Screen sharing display method and apparatus, device, and storage medium | |
| CN112422978A (en) | Intelligent transcoding method and device, electronic equipment and storage medium | |
| CN103731672A (en) | Audio and video decoding method and smart television | |
| CN109587555B (en) | Video processing method and device, electronic equipment and storage medium | |
| CN109587561B (en) | Video processing method and device, electronic equipment and storage medium | |
| CN110572673A (en) | Video encoding and decoding method and device, storage medium and electronic device | |
| US20200194009A1 (en) | Display apparatus and method of controlling the same | |
| US9997132B2 (en) | Data transmission method, data transmission system and portable display device of transmitting compressed data | |
| CN109120979B (en) | Video enhancement control method and device and electronic equipment | |
| CN113038209A (en) | Wireless screen transmission data processing method and system and computer readable storage medium | |
| CN109104581B (en) | Wireless screen transmission method, system and receiving terminal | |
| CN108093258B (en) | Code stream data decoding method, computer device and computer readable storage medium | |
| CN110572672A (en) | Video encoding and decoding method and device, storage medium and electronic device | |
| KR20160082521A (en) | Chroma down-conversion and up-conversion processing | |
| CN115567754A (en) | Video playing method, device, equipment and storage medium | |
| CN112954420A (en) | Wireless screen transmission method and system | |
| CN113055735A (en) | Wireless screen transmission data transmission method, system and computer readable storage medium | |
| CN112449186B (en) | Encoding method, decoding method, corresponding devices, electronic equipment and storage medium | |
| CN110266915B (en) | Method and device for controlling video acquisition content on android device | |
| CN109257636B (en) | Switching method and device for video enhancement, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210625 |