CN112565876B - Screen projection method, device, equipment, system and storage medium - Google Patents

Screen projection method, device, equipment, system and storage medium Download PDF

Info

Publication number
CN112565876B
CN112565876B CN202011378752.3A CN202011378752A CN112565876B CN 112565876 B CN112565876 B CN 112565876B CN 202011378752 A CN202011378752 A CN 202011378752A CN 112565876 B CN112565876 B CN 112565876B
Authority
CN
China
Prior art keywords
audio
mobile terminal
resource
screen projection
playing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011378752.3A
Other languages
Chinese (zh)
Other versions
CN112565876A (en
Inventor
李凌
陈锡华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Happycast Technology Co Ltd
Original Assignee
Shenzhen Happycast Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Happycast Technology Co Ltd filed Critical Shenzhen Happycast Technology Co Ltd
Priority to CN202011378752.3A priority Critical patent/CN112565876B/en
Publication of CN112565876A publication Critical patent/CN112565876A/en
Application granted granted Critical
Publication of CN112565876B publication Critical patent/CN112565876B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Telephone Function (AREA)

Abstract

The invention relates to the technical field of screen projection, and discloses a screen projection method, a screen projection device, screen projection equipment, a screen projection system and a storage medium, wherein the screen projection method comprises the steps of receiving an audio resource playing instruction initiated by a mobile terminal; establishing an audio media channel with the mobile terminal; and forwarding the audio resource in the audio and video resource to the mobile terminal through the audio media channel so as to play the forwarded audio resource and play the video resource in the audio and video resource at the mobile terminal. The screen projection method, the screen projection device, the screen projection equipment, the screen projection system and the storage medium can play audio resources on the mobile terminal of the user side as required during screen projection, and screen projection use experience of the user is improved.

Description

Screen projection method, device, equipment, system and storage medium
Technical Field
The invention relates to the technical field of screen projection, in particular to a screen projection method, a screen projection device, screen projection equipment, a screen projection system and a storage medium.
Background
After the user screens the audio and video resources to the screen projection equipment, the audio and video resources can be synchronously played on the screen projection equipment.
In some cases, the user may only want to play the video resource on the screen projection device, and the audio resource on the mobile terminal on the user side, for example, the audio sound played by the screen projection device is small, the user is far away from the screen projection device and cannot hear the audio played by the screen projection device clearly, or the user wants to listen to the audio through a headset. The screen projection scheme in the prior art can only play audio and video resources on the screen projection equipment synchronously, so that the screen projection use experience of a user is influenced.
Therefore, how to provide an effective scheme for playing the audio resource on the mobile terminal of the user side when the user throws the screen is a problem to be determined in the prior art.
Disclosure of Invention
In order to solve the problem that the screen projection use experience of a user is influenced by the fact that audio and video resources are synchronously played on screen projection equipment in the prior art, the invention aims to provide a screen projection method, a screen projection device, screen projection equipment, a screen projection system and a storage medium, so that the audio resources in the screen projection method can be conveniently played on a mobile terminal of a user side during screen projection, and the user experience is improved.
In a first aspect, the present invention provides a screen projection method, including:
receiving an audio resource playing instruction initiated by a mobile terminal;
establishing an audio media channel with the mobile terminal;
forwarding the audio resource in the audio and video resource to the mobile terminal through the audio media channel so as to play the forwarded audio resource on the mobile terminal, and
and playing the video resources in the audio and video resources.
Based on the above disclosure, the screen projection method provided by the invention establishes the audio media channel with the mobile terminal in the screen projection process, forwards the audio resource in the audio and video resource to the mobile terminal through the audio media channel for playing, and plays the video resource in the audio and video resource at the screen projection equipment end, so that the audio resource can be played on the mobile terminal at the user side as required during screen projection, and the screen projection use experience of the user is improved.
In a possible design, the audio resource playing instruction carries a headset connection state of the mobile terminal, and the establishing of the audio media channel with the mobile terminal includes:
and when the headset connection state carried in the audio resource playing instruction represents that the mobile terminal is currently connected with the headset, an audio media channel is established with the mobile terminal.
In one possible design, the playing a video resource of the audio and video resources includes:
and playing the video resource in the audio and video resource, and stopping playing the audio resource in the audio and video resource.
In one possible design, when receiving an audio resource playing instruction initiated by the mobile terminal, the method further includes:
pausing the playing of the audio and video resources being played;
the playing of the video resource in the audio and video resource comprises:
playing the video resource when the audio resource is forwarded to the mobile terminal through the audio media channel; or
And delaying the playing of the video resource when the audio resource is forwarded to the mobile terminal through the audio media channel.
In one possible design, the method further includes:
acquiring the current headset connection state of the mobile terminal in real time;
and when the current headset connection state of the mobile terminal represents that the mobile terminal is not connected with the headset currently, stopping forwarding the audio resources to the mobile terminal and synchronously playing the audio resources in the audio and video resources.
In a second aspect, the present invention provides another screen projection method, including:
the method comprises the steps that the mobile terminal sends an audio resource playing instruction to screen projection equipment;
the screen projection equipment receives the audio resource playing instruction initiated by the mobile terminal;
the mobile terminal and the screen projection equipment end establish an audio media channel;
the screen projection equipment forwards the audio resources in the audio and video resources to the mobile terminal through the audio media channel;
the mobile terminal plays the forwarded audio resource;
and the screen projection equipment plays the video resource in the audio and video resource.
In a third aspect, the present invention provides a screen projection apparatus, comprising:
the receiving unit is used for receiving an audio resource playing instruction initiated by the mobile terminal;
a channel establishing unit, configured to establish an audio media channel with the mobile terminal;
a forwarding unit, configured to forward the audio resource in the audio and video resource to the mobile terminal through the audio media channel, so as to play the forwarded audio resource at the mobile terminal, and
and the playing control unit is used for playing the video resource in the audio and video resource.
In a possible design, the audio resource playing instruction carries a headset connection state of the mobile terminal, and the channel establishing unit is specifically configured to, when configured to establish an audio media channel with the mobile terminal:
and when the headset connection state carried in the audio resource playing instruction represents that the mobile terminal is currently connected with the headset, an audio media channel is established with the mobile terminal.
In a possible design, when the playing control unit is configured to play a video resource in the audio and video resource, the playing control unit is specifically configured to:
and playing the video resource in the audio and video resource, and stopping playing the audio resource in the audio and video resource.
In one possible design, the screen projection device further includes:
a pause unit, configured to pause playing of the audio and video resource being played when receiving an audio resource playing instruction initiated by the mobile terminal
When the playing control unit is used for playing the video resource in the audio and video resource, the playing control unit is specifically used for:
playing the video resource when the audio resource is forwarded to the mobile terminal through the audio media channel; or
And delaying the playing of the video resource when the audio resource is forwarded to the mobile terminal through the audio media channel.
In one possible design, the screen projection device further includes:
the acquiring unit is used for acquiring the current headset connection state of the mobile terminal in real time;
the playing control unit is further used for stopping forwarding the audio resource to the mobile terminal and synchronously playing the audio resource in the audio and video resource when the current headset connection state of the mobile terminal represents that the headset is not connected to the mobile terminal currently.
In a fourth aspect, the present invention provides a screen projection device, which includes a memory, a processor and a transceiver, which are connected in communication in sequence, wherein the memory is used for storing a computer program, the transceiver is used for sending and receiving messages, and the processor is used for reading the computer program and executing the screen projection method as described in any one of the above.
In a fifth aspect, the present invention provides a screen projection system, including: the mobile terminal is used for sending an audio resource playing instruction to the screen projection equipment;
the screen projection equipment is used for receiving the audio resource playing instruction initiated by the mobile terminal;
the mobile terminal is also used for establishing an audio media channel with the screen projection equipment terminal;
the screen projection equipment is also used for forwarding the audio resources in the audio and video resources to the mobile terminal through the audio media channel;
the mobile terminal is also used for playing the forwarded audio resource;
the screen projection equipment is also used for playing the video resources in the audio and video resources.
In a sixth aspect, the invention provides a computer program product comprising instructions which, when run on a computer, cause the computer to perform the method of screen projection according to the first aspect.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic application environment diagram of a screen projection method, device, equipment and storage medium provided by the invention.
FIG. 2 is a flowchart of a screen projection method applied to a screen projection device provided by the present invention;
fig. 3 is a schematic structural diagram of a screen projection device provided by the invention.
Fig. 4 is a schematic structural diagram of a screen projection device provided by the present invention.
Fig. 5 is a flowchart of a screen projection method applied to a screen projection system provided by the invention.
Detailed Description
The invention is further described with reference to the following figures and specific embodiments. It should be noted that the description of the embodiments is provided to help understanding of the present invention, but the present invention is not limited thereto. Specific structural and functional details disclosed herein are merely illustrative of example embodiments of the invention. This invention may, however, be embodied in many alternate forms and should not be construed as limited to the embodiments set forth herein.
It will be understood that, although the terms first, second, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of example embodiments of the present invention.
It should be understood that, for the term "and/or" as may appear herein, it is merely an associative relationship that describes an associated object, meaning that three relationships may exist, e.g., a and/or B may mean: a exists alone, B exists alone, and A and B exist at the same time; for the term "/and" as may appear herein, which describes another associative object relationship, it means that two relationships may exist, e.g., a/and B, may mean: a exists independently, and A and B exist independently; in addition, for the character "/" that may appear herein, it generally means that the former and latter associated objects are in an "or" relationship.
It will be understood that when an element is referred to herein as being "connected," "connected," or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may be present. Conversely, if a unit is referred to herein as being "directly adjacent" or "directly coupled" to another unit, it is intended that no intervening units are present. In addition, other words used to describe the relationship between elements should be interpreted in a similar manner (e.g., "between 8230; \8230; between pairs" directly between 8230; \8230; between "," adjacent "pairs" directly adjacent ", etc.).
It is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments of the invention. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes" and/or "including," when used herein, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, numbers, steps, operations, elements, components, and/or groups thereof.
It should also be noted that, in some alternative implementations, the functions/acts noted may occur out of the order noted in the figures. For example, two figures shown in succession may in fact be executed substantially concurrently or the figures may sometimes be executed in the reverse order, depending upon the functionality/acts involved.
It should be understood that specific details are provided in the following description to facilitate a thorough understanding of example embodiments. However, it will be understood by those of ordinary skill in the art that the example embodiments may be practiced without these specific details. For example, systems may be shown in block diagrams in order not to obscure the examples in unnecessary detail. In other instances, well-known processes, structures and techniques may be shown without unnecessary detail in order to avoid obscuring example embodiments.
Examples
In order to solve the problem that the screen projection use experience of a user is influenced due to the fact that audio and video resources are synchronously played on screen projection equipment in the prior art, the invention aims to provide a screen projection method, a screen projection device, screen projection equipment, a screen projection system and a storage medium.
First, in order to more intuitively understand the scheme provided by the embodiment of the present application, a system architecture of the screen projection scheme provided by the embodiment of the present application is described below with reference to fig. 1.
Fig. 1 is a schematic application environment diagram of a screen projection method, apparatus, device and storage medium according to one or more embodiments of the present application. As shown in fig. 1, the mobile terminal establishes a communication connection with the screen projection device, so that the audio and video resources of the mobile terminal are projected on the screen projection device for playing. The mobile terminal may be, but is not limited to, a tablet computer, a smart phone, a Personal Digital Assistant (PDA), and the like, and the screen projection device may be a smart television, a large screen device for projecting a screen, and the like.
As shown in fig. 2, which is a flowchart of a screen projection method applied to a screen projection device provided in an embodiment of the present application, the screen projection method may include the following steps:
step S201, receiving an audio resource playing instruction initiated by the mobile terminal.
The audio resource playing instruction initiated by the mobile terminal can be triggered in response to the operation of the user. For example, a control for initiating an audio resource playing instruction may be set on a screen projecting application interface of the mobile terminal, and when a user wants to play an audio resource in a screen projecting audio and video resource on the mobile terminal side, the user may touch the control on the screen projecting application interface of the mobile terminal, and at this time, the mobile terminal generates an audio resource playing instruction and sends the instruction to a screen projecting device currently projecting a screen. And the audio resource playing instruction is used for indicating that the audio resource in the audio and video resource needing to be projected is played on the mobile terminal side.
In the embodiment of the application, the audio resource playing instruction is triggered in response to the operation of the user. It is understood that in some other embodiments, the audio resource playing command may be triggered by other triggering manners, for example, by voice control or some other operation on the mobile terminal (e.g., the mobile terminal is connected to a headset via a wired or bluetooth connection).
And S202, establishing an audio media channel with the mobile terminal.
After receiving an audio resource playing instruction initiated by the mobile terminal, the screen projection device establishes an audio media channel with the mobile terminal, wherein the audio media channel is used for sending audio resources.
In the embodiment of the application, the audio resource can be directly played through a loudspeaker at the mobile terminal, and can also be played only through a headset connected with the mobile terminal.
And when the audio resource can be directly played at the mobile terminal through the loudspeaker, an audio media channel is established with the mobile terminal after receiving an audio resource playing instruction initiated by the mobile terminal.
For the situation that the audio resource can only be played through the headset connected with the mobile terminal, the headset connection state of the mobile terminal can be carried in the audio resource playing instruction initiated by the mobile terminal, and the headset connection state can be connected or disconnected. And when the headset connection state carried in the audio resource playing instruction represents that the mobile terminal is currently connected with the headset, establishing an audio media channel with the mobile terminal. And when the headset connection state carried in the audio resource playing instruction represents that the mobile terminal is not connected with the headset currently, an audio media channel cannot be established with the mobile terminal.
In the embodiment of the application, the screen projection equipment can also pause playing of the audio and video resources being played when receiving the audio resource playing instruction initiated by the mobile terminal. It can be understood that, in some other embodiments, the screen projecting device may also continue to play the audio and video resources being played in the process of establishing the audio media channel with the mobile terminal after receiving the audio resource playing instruction initiated by the mobile terminal.
And S203, forwarding the audio resource in the audio and video resource to the mobile terminal through the audio media channel so as to play the forwarded audio resource on the mobile terminal.
The audio and video resources from the screen of the mobile terminal to the screen projecting device comprise audio resources and video resources, after an audio media channel is established with the mobile terminal, the screen projecting device can forward the audio resources in the audio and video resources to the mobile terminal, and the mobile terminal plays the forwarded audio resources after receiving the audio resources forwarded by the screen projecting device.
And S204, playing the video resource in the audio and video resource.
In the embodiment of the application, because the audio resources in the audio and video resources are sent to the mobile terminal and played at the mobile terminal, the screen projection device only needs to play the video resources in the audio and video resources at present, that is, the screen projection device plays the video resources in the audio and video resources, and stops playing the audio resources in the audio and video resources. Therefore, the video resource in the audio and video resource can be played on the screen projection equipment, and the audio resource in the audio and video resource can be played on the mobile terminal. When the audio sound played by the screen projection equipment is small or the user is far away from the screen projection equipment, the audio played by the screen projection equipment cannot be clearly heard, the mode can be adopted, the user can conveniently and clearly hear the audio content while the screen projection is realized, and therefore the screen projection use experience of the user is improved. Furthermore, the audio resources can be played through the headset connected with the mobile terminal, the played audio cannot interfere with other people, and user experience is further improved.
In the embodiment of the application, the screen projection equipment consumes a certain time in the process of forwarding the audio resource to the mobile terminal through the audio media channel, if the consumed time is short, the audio resource and the video resource can be basically kept synchronous, and a user cannot generate the feeling of audio lag. At this time, the video resource may be played while the audio resource is forwarded to the mobile terminal through the audio media channel.
If the time consumed by the screen projection equipment in the process of forwarding the audio resource to the mobile terminal through the audio media channel is long, the audio resource and the video resource cannot be kept synchronous, and if the video resource is played according to the normal playing progress all the time, a user can generate the feeling of audio lag. At this time, the video resource may be delayed from being played while the audio resource is forwarded to the mobile terminal through the audio media channel. The delay time is the estimated time for forwarding the audio resource to the mobile terminal through the audio media channel, and the estimated time can be determined according to multiple tests.
For example, the time consumed by the screen projection device in the process of forwarding the audio resource to the mobile terminal through the audio media channel is 400 milliseconds, and the time taken by the screen projection device to forward the audio resource to the mobile terminal through the audio media channel is 11 hours, 22 minutes, 33 seconds and 200 milliseconds, so that the video resource can be delayed to be played by 400 milliseconds. I.e. it can pause for 400 ms from 200 ms starting at 11 h 22 min 33 s and continue to play the video resource normally until 600 ms starting at 11 h 22 min 33 s.
Further, if the audio resource can only be played through the headset connected with the mobile terminal, the mobile terminal can also send the current headset connection state of the audio resource to the screen projection device in real time, the screen projection device obtains the current headset connection state of the mobile terminal in real time, and when the current headset connection state of the mobile terminal represents that the mobile terminal is not connected with the headset currently, the audio resource is stopped being forwarded to the mobile terminal and the audio resource in the audio and video resource is played synchronously. Therefore, the audio can be automatically switched to be played by the screen projection device when the mobile terminal is disconnected from the headset.
Therefore, by the screen projecting method described in the foregoing steps S201 to S204, an audio media channel is established with the mobile terminal in the screen projecting process, and the audio resource in the audio and video resource is forwarded to the mobile terminal through the audio media channel to be played, and the video resource in the audio and video resource is played at the screen projecting device, so that the audio resource can be played on the mobile terminal at the user side as required during screen projection, and the screen projecting experience of the user is improved. Meanwhile, the audio resources can be played through the headset connected with the mobile terminal, the played audio cannot interfere with other people, and user experience is further improved. Secondly, if the time consumed by the screen projection equipment in the process of forwarding the audio resource to the mobile terminal through the audio media channel is long, the video resource can be delayed to be played when the audio resource is forwarded to the mobile terminal through the audio media channel, so that the audio and the video are kept synchronous, the feeling of audio lag is not generated, and the screen projection effect is guaranteed. In addition, the current headset connection state of the mobile terminal can be acquired in real time, and when the current headset connection state of the mobile terminal represents that the mobile terminal is not connected with a headset currently, the forwarding of the audio resource to the mobile terminal is stopped, and the audio resource in the audio and video resource is played synchronously. Therefore, the audio can be automatically switched to be played by the screen projection equipment when the mobile terminal is disconnected from the headset.
In a second aspect, an embodiment of the present application provides a screen projection apparatus, where the screen projection apparatus is applicable to a screen projection device, please refer to fig. 3, and the screen projection apparatus includes:
the receiving unit is used for receiving an audio resource playing instruction initiated by the mobile terminal;
the channel establishing unit is used for establishing an audio media channel with the mobile terminal;
a forwarding unit, configured to forward the audio resource in the audio and video resource to the mobile terminal through the audio media channel, so as to play the forwarded audio resource at the mobile terminal, and
and the playing control unit is used for playing the video resource in the audio and video resource.
In a possible design, the audio resource playing instruction carries a headset connection state of the mobile terminal, and the channel establishing unit is specifically configured to, when configured to establish an audio media channel with the mobile terminal:
and when the headset connection state carried in the audio resource playing instruction represents that the mobile terminal is currently connected with the headset, an audio media channel is established with the mobile terminal.
In a possible design, when the playing control unit is configured to play a video resource in the audio and video resource, the playing control unit is specifically configured to:
and playing the video resource in the audio and video resource, and stopping playing the audio resource in the audio and video resource.
In one possible design, the screen projection device further includes:
a pause unit for pausing the playing of the audio and video resources when receiving an audio resource playing instruction initiated by the mobile terminal
When the playing control unit is used for playing the video resource in the audio and video resource, the playing control unit is specifically used for:
playing the video resource when the audio resource is forwarded to the mobile terminal through the audio media channel; or
And delaying the playing of the video resource when the audio resource is forwarded to the mobile terminal through the audio media channel.
In one possible design, the screen projection device further includes:
the acquiring unit is used for acquiring the current headset connection state of the mobile terminal in real time;
the playing control unit is further used for stopping forwarding the audio resource to the mobile terminal and synchronously playing the audio resource in the audio and video resource when the current headset connection state of the mobile terminal represents that the headset is not connected to the mobile terminal currently.
For the working process, the working details, and the technical effects of the apparatus provided in the second aspect of this embodiment, reference may be made to the first aspect of this embodiment, which is not described herein again.
As shown in fig. 4, a third aspect of the embodiments of the present application provides a screen projection apparatus, including a memory, a processor, and a transceiver, which are sequentially connected in a communication manner, where the memory is used to store a computer program, the transceiver is used to transmit and receive a message, and the processor is used to read the computer program and perform the screen projection method according to the first aspect of the embodiments.
By way of specific example, the Memory may include, but is not limited to, a Random Access Memory (RAM), a Read Only Memory (ROM), a Flash Memory (Flash Memory), a first-in-first-out Memory (FIFO), a first-in-last-out Memory (FILO), and/or the like; the processor may not be limited to a microprocessor of the STM32F105 series, an ARM (Advanced RISC Machines), an X86 or the like architecture processor, or a processor integrated with an NPU (neutral-network processing unit); the transceiver may be, but is not limited to, a WiFi (wireless fidelity) wireless transceiver, a bluetooth wireless transceiver, a General Packet Radio Service (GPRS) wireless transceiver, a ZigBee protocol (ieee 802.15.4 standard-based low power local area network protocol), a 3G transceiver, a 4G transceiver, and/or a 5G transceiver, etc.
For the working process, the working details, and the technical effects of the apparatus provided in the third aspect of this embodiment, reference may be made to the first aspect of the embodiment, which is not described herein again.
A fourth aspect of this embodiment provides a screen projection system, where the screen projection system includes a mobile terminal and a screen projection device, and the mobile terminal is configured to send an audio resource playing instruction to the screen projection device;
the screen projection equipment is used for receiving the audio resource playing instruction initiated by the mobile terminal;
the mobile terminal is also used for establishing an audio media channel with the screen projection equipment terminal;
the screen projection equipment is also used for forwarding the audio resources in the audio and video resources to the mobile terminal through the audio media channel;
the mobile terminal is also used for playing the forwarded audio resource;
the screen projection equipment is also used for playing the video resources in the audio and video resources.
For the working process, the working details, and the technical effects of the apparatus provided in the fourth aspect of this embodiment, reference may be made to the first aspect of the embodiment, which is not described herein again.
As shown in fig. 5, a fifth aspect of the present embodiment provides a screen projection method applied to a screen projection system, where the screen projection method may include the following steps:
and S501, the mobile terminal sends an audio resource playing instruction to the screen projection equipment.
Step S502, the screen projection equipment receives an audio resource playing instruction initiated by the mobile terminal.
And S503, establishing an audio media channel between the mobile terminal and the screen projection equipment terminal.
And S504, the screen projection equipment forwards the audio resources in the audio and video resources to the mobile terminal through the audio media channel.
And S505, the mobile terminal plays the forwarded audio resource.
And S506, the screen projection equipment plays the video resource in the audio and video resource.
For the working process, the working details, and the technical effects of the apparatus provided in the fifth aspect of this embodiment, reference may be made to the first aspect of this embodiment, which are not described herein again.
A sixth aspect of the present embodiment provides a computer-readable storage medium storing instructions for implementing the screen projection method according to the first aspect, that is, the computer-readable storage medium has instructions stored thereon, which when executed on a computer, perform the screen projection method according to the first aspect. The computer-readable storage medium refers to a carrier for storing data, and may include, but is not limited to, floppy disks, optical disks, hard disks, flash memories, flash disks and/or Memory sticks (Memory sticks), etc., and the computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices.
For the working process, the working details, and the technical effects of the computer-readable storage medium provided in the sixth aspect of this embodiment, reference may be made to the first aspect of the embodiment, which is not described herein again.
A seventh aspect of the present embodiment provides a computer program product comprising instructions which, when run on a computer, are adapted to cause the computer to perform the screen projection method according to the first aspect of the present embodiment, wherein the computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable apparatus.
The embodiments described above are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a repository code combining means to execute the methods according to the embodiments or parts of the embodiments.
The invention is not limited to the above alternative embodiments, and any other various forms of products can be obtained by anyone in the light of the present invention, but any changes in shape or structure thereof, which fall within the scope of the present invention as defined in the claims, fall within the scope of the present invention.

Claims (9)

1. A screen projection method is applied to screen projection equipment and is characterized by comprising the following steps:
receiving an audio resource playing instruction initiated by a mobile terminal;
establishing an audio media channel with the mobile terminal;
forwarding audio resources in audio and video resources to the mobile terminal through the audio media channel so as to play the forwarded audio resources on the mobile terminal, and
playing the video resource in the audio and video resource;
acquiring the current headset connection state of the mobile terminal in real time;
and when the current headset connection state of the mobile terminal represents that the mobile terminal is not connected with the headset currently, stopping forwarding the audio resources to the mobile terminal and synchronously playing the audio resources in the audio and video resources.
2. The method according to claim 1, wherein the audio resource playing instruction carries a headset connection status of the mobile terminal, and the establishing an audio media channel with the mobile terminal includes:
and when the headset connection state carried in the audio resource playing instruction represents that the mobile terminal is currently connected with the headset, an audio media channel is established with the mobile terminal.
3. The method of claim 1, wherein the playing a video asset of the audiovisual assets comprises:
and playing the video resource in the audio and video resource, and stopping playing the audio resource in the audio and video resource.
4. The method of claim 1, wherein upon receiving a mobile terminal-initiated audio asset playback instruction, the method further comprises:
pausing the playing of the audio and video resources being played;
the playing of the video resource in the audio and video resource comprises:
playing the video resource when the audio resource is forwarded to the mobile terminal through the audio media channel; or
And delaying the playing of the video resource when the audio resource is forwarded to the mobile terminal through the audio media channel.
5. A method of screen projection, comprising:
the method comprises the steps that the mobile terminal sends an audio resource playing instruction to screen projection equipment;
the screen projection equipment receives the audio resource playing instruction initiated by the mobile terminal;
the mobile terminal and the screen projection equipment end establish an audio media channel;
the screen projection equipment forwards the audio resources in the audio and video resources to the mobile terminal through the audio media channel;
the mobile terminal plays the forwarded audio resource;
the screen projection equipment plays video resources in the audio and video resources;
the screen projection equipment acquires the current headset connection state of the mobile terminal in real time;
and when the current headset connection state of the mobile terminal represents that the mobile terminal is not connected with the headset currently, the screen projection equipment stops forwarding the audio resources to the mobile terminal and synchronously plays the audio resources in the audio and video resources.
6. The utility model provides a throw screen device is applied to and throws screen equipment which characterized in that includes:
the receiving unit is used for receiving an audio resource playing instruction initiated by the mobile terminal;
a channel establishing unit, configured to establish an audio media channel with the mobile terminal;
a forwarding unit, configured to forward an audio resource in the audio and video resource to the mobile terminal through the audio media channel, so as to play the forwarded audio resource at the mobile terminal, and
the playing control unit is used for playing the video resource in the audio and video resource;
the acquiring unit is used for acquiring the current headset connection state of the mobile terminal in real time;
the playing control unit is also used for stopping transmitting the audio resources to the mobile terminal and synchronously playing the audio resources in the audio and video resources when the current headset connection state of the mobile terminal represents that the headset is not connected to the mobile terminal at present.
7. A screen projection device, which comprises a memory, a processor and a transceiver which are sequentially connected in communication, wherein the memory is used for storing a computer program, the transceiver is used for sending and receiving messages, and the processor is used for reading the computer program and executing the screen projection method according to any one of claims 1 to 4.
8. A screen projection system, comprising: the mobile terminal is used for sending an audio resource playing instruction to the screen projection equipment;
the screen projection equipment is used for receiving the audio resource playing instruction initiated by the mobile terminal;
the mobile terminal is also used for establishing an audio media channel with the screen projection equipment end;
the screen projection equipment is also used for forwarding audio resources in the audio and video resources to the mobile terminal through the audio media channel;
the mobile terminal is also used for playing the forwarded audio resource;
the screen projection equipment is also used for playing video resources in the audio and video resources;
acquiring the current headset connection state of the mobile terminal in real time; and
and when the current headset connection state of the mobile terminal represents that the mobile terminal is not connected with the headset currently, stopping forwarding the audio resources to the mobile terminal and synchronously playing the audio resources in the audio and video resources.
9. A computer-readable storage medium having instructions stored thereon, which when executed on a computer perform the screen projection method of any one of claims 1 to 4.
CN202011378752.3A 2020-11-30 2020-11-30 Screen projection method, device, equipment, system and storage medium Active CN112565876B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011378752.3A CN112565876B (en) 2020-11-30 2020-11-30 Screen projection method, device, equipment, system and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011378752.3A CN112565876B (en) 2020-11-30 2020-11-30 Screen projection method, device, equipment, system and storage medium

Publications (2)

Publication Number Publication Date
CN112565876A CN112565876A (en) 2021-03-26
CN112565876B true CN112565876B (en) 2023-03-24

Family

ID=75045652

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011378752.3A Active CN112565876B (en) 2020-11-30 2020-11-30 Screen projection method, device, equipment, system and storage medium

Country Status (1)

Country Link
CN (1) CN112565876B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113542706B (en) * 2021-06-25 2023-06-13 深圳乐播科技有限公司 Screen throwing method, device and equipment of running machine and storage medium
CN115525366A (en) * 2021-06-25 2022-12-27 华为技术有限公司 Screen projection method and related device

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111741372A (en) * 2020-07-08 2020-10-02 聚好看科技股份有限公司 Screen projection method for video call, display device and terminal device

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109743465A (en) * 2019-03-18 2019-05-10 维沃移动通信有限公司 A kind of audio data output method and terminal
CN110177399A (en) * 2019-04-30 2019-08-27 深圳市鹰硕技术有限公司 One kind is the same as screen method for connecting network, device, smart machine and storage medium
CN110381197B (en) * 2019-06-27 2021-06-15 华为技术有限公司 Method, device and system for processing audio data in many-to-one screen projection
CN111031368B (en) * 2019-11-25 2021-03-16 腾讯科技(深圳)有限公司 Multimedia playing method, device, equipment and storage medium
CN111131866B (en) * 2019-11-25 2021-06-15 华为技术有限公司 Screen-projecting audio and video playing method and electronic equipment

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111741372A (en) * 2020-07-08 2020-10-02 聚好看科技股份有限公司 Screen projection method for video call, display device and terminal device

Also Published As

Publication number Publication date
CN112565876A (en) 2021-03-26

Similar Documents

Publication Publication Date Title
CN109445739B (en) Audio playing method and device, electronic equipment and computer readable medium
CN107360458B (en) Play control method, device, storage medium and terminal
US8537740B2 (en) Mobile communication device and system supporting media flow control
CN110166788B (en) Information synchronous playing method, device and storage medium
CN109819303B (en) Data output method and related equipment
EP3544305B1 (en) A method and a system for performing scrubbing in a video stream
US11202066B2 (en) Video data encoding and decoding method, device, and system, and storage medium
CN112565876B (en) Screen projection method, device, equipment, system and storage medium
KR20120076859A (en) Method and apparatus for synchronizing keep alive packet in a portable terminal
KR102174014B1 (en) Method, system, and apparatus for handling system calls during voice calls
WO2022017007A1 (en) Audio data processing method, server, and storage medium
CN113573172A (en) Dual-device audio playing method and device, electronic device and storage medium
WO2016150189A1 (en) Volume control method, playing device, mobile terminal and system
EP4275349A1 (en) Call audio playback speed adjustment
CN113840269B (en) Multimedia data transmission method and device, electronic equipment and storage medium
CN105163391A (en) Data transmission method, terminal and wireless access point
KR20230133864A (en) Systems and methods for handling speech audio stream interruptions
KR20090121760A (en) Method, terminal for sharing content and computer readable record-medium on which program for executing method thereof
CN109151784B (en) Network connection method and device and electronic equipment
CN109819360A (en) The audio collection method and system of more wireless microphones
CN115314494A (en) Multi-device cooperative work method and device
CN112055238B (en) Video playing control method, device and system
CN106358070B (en) Multimedia file uploading method and device
JP2017212549A (en) Content distribution method, content reception method, program, information processing device and information processing system
WO2024109399A1 (en) State notification method and apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant