WO2017140161A1

WO2017140161A1 - Method, device and system for sharing audio and video resource, and network gateway

Info

Publication number: WO2017140161A1
Application number: PCT/CN2016/108759
Authority: WO
Inventors: 袁文华
Original assignee: 中兴通讯股份有限公司
Priority date: 2016-02-18
Filing date: 2016-12-07
Publication date: 2017-08-24
Also published as: CN107094266A

Abstract

Disclosed are a method, device and system for sharing an audio and video resource, and a network gateway. The method comprises: receiving an audio and video stream sent by a sending end; judging whether the number of receiving ends connected to a network gateway is more than one; if it is determined that the number of receiving ends connected to the network gateway is more than one, producing a plurality of copies of the audio and video stream according to the number of receiving ends, and sending one copy of the audio and video stream to each of the receiving ends connected to the network gateway so that each receiving end receives and projects the audio and video stream. The method for sharing an audio and video resource in the embodiments of the present invention realizes the synchronization of audio and video contents between a sending end and a receiving end, thus satisfying the requirements for watching an audio and video resource on the receiving end, and improving the user experience.

Description

Method, device, system and network gateway for sharing audio and video resources

Technical field

The embodiments of the present invention relate to the technical field, and in particular, to a method, an apparatus, a system, and a network gateway for sharing audio and video resources.

Background technique

Miracast, also known as WI-FI Display, is a point-to-point multimedia sharing protocol developed by the WI-FI Alliance. Its main purpose is to transmit the multimedia data of the source device to the destination device for playback display by wireless transmission. . Specifically, Miracast is a wireless display standard based on WI-FI Direct, and handheld devices supporting this standard can share video images wirelessly. For example, a mobile phone that supports Miracast can use Miracast to directly synchronize a movie or photo to a TV or other device for playback without any connection line, so as to meet the needs of the user to watch the video, thereby improving the user experience.

Among them, the connection process of Miracast is: first, look for the nearby Miracast device with Wi-Fi Direct, and then transmit the information of the discovered Miracast device to the user, after which the user can find the device that was previously connected or previously connected. Select the device you want to connect to. After the wireless connection is established, the devices on both sides will coordinate the device function and network conditions to select the appropriate audio and video transmission format. After the online protocol session of the video stream is established between the two devices, the source device sends a series of real-time streaming protocol (RTSP) control commands to the destination device to control the playback and termination of the video stream. During the connection of Miracast, there can only be one image receiving end, which is suitable for projection from small screen to large screen.

However, in some cases, sometimes the user will have a device that supports the Miracast function, but other reproduction devices (for example, a reproduction device such as a television, a projection device, etc.) are not, and sometimes the user needs to be on multiple large or small screens. Displaying image information, how to display image information on the screen of multiple or large or small reproduction devices at the same time is an urgent problem to be solved.

Summary of the invention

The embodiments of the present invention aim to solve at least one of the technical problems in the related art to some extent.

Therefore, the first object of the embodiment of the present invention is to provide a method for sharing audio and video resources, which realizes synchronization of audio and video content between a transmitting end and a receiving end, and satisfies the viewing of audio and video resources on the receiving end. Demand increases user experience.

A second object of the embodiments of the present invention is to provide an apparatus for sharing audio and video resources.

A third object of embodiments of the present invention is to provide a network gateway.

A fourth object of the embodiments of the present invention is to provide a system for sharing audio and video resources.

To achieve the above objective, the first aspect of the present invention provides a method for sharing audio and video resources, including: receiving an audio and video stream sent by a sending end; determining whether the number of receiving ends connected to the network gateway is multiple; If the number of the receiving ends connected to the network gateway is multiple, the audio and video streams are duplicated according to the number of the receiving ends, and an audio and video is sent to each receiving end connected to the network gateway. Streaming so that each receiving end receives and projects the audiovisual stream.

In an embodiment of the present invention, before the sending, by the receiving end, the audio and video stream to each of the network gateways, the method further includes: determining, for each of the receiving ends, the current receiving end And an audio and video data format, and determining whether the audio and video data format is consistent with the format of the audio and video stream; if not, converting the format of the audio and video stream according to the audio and video data format, and converting the format The subsequent audio and video stream is sent to the current receiving end.

In an embodiment of the present invention, before the receiving the audio and video stream sent by the sending end, the method further includes: establishing a wireless communication connection with the sending end, and establishing a Miracast session with the sending end.

In an embodiment of the present invention, the method further includes determining, when the number of receiving ends connected to the network gateway is one, determining an audio and video data format required by the receiving end, and determining the audio and video data. Whether the format is consistent with the format of the audio and video stream; if the audio and video data format is inconsistent with the format of the audio and video stream, the The format of the audio and video stream is converted, and the converted audio and video stream is sent to the receiving end.

In an embodiment of the present invention, after the determining whether the number of receiving ends connected to the network gateway is multiple, the method further includes: if the receiving end with the new access is monitored, according to the newly accessed The number of receiving ends copies the audio and video streams in multiple copies, and sends an audio and video stream to each newly accessed receiving end, so that each newly accessed receiving end receives and projects the audio and video streams.

According to the method for sharing audio and video resources according to the embodiment of the present invention, after receiving the audio and video stream sent by the transmitting end, it is determined whether the number of receiving ends connected to the network gateway is multiple, and determining the number of receiving ends connected to the network gateway. When there are multiple, the audio and video streams are copied according to the number of receiving ends, and an audio and video stream is sent to each receiving end connected to the network gateway, so that each receiving end receives and projects the audio and video streams, thereby The plurality of receiving ends synchronously display the audio and video content of the transmitting end, which satisfies the requirement of the user to use the audio and video content of the plurality of receiving end projection transmitting ends, thereby improving the user experience.

To achieve the above objective, the second aspect of the present invention provides an apparatus for sharing audio and video resources, including: a receiving module, configured to receive an audio and video stream sent by a sending end; and a determining module configured to determine a connection with the network gateway. Whether the number of the receiving ends is multiple; the first processing module is configured to: when determining that the number of receiving ends connected to the network gateway is multiple, copying the audio and video streams according to the number of the receiving ends, and An audio and video stream is sent to each receiving end connected to the network gateway, so that each receiving end receives and projects the audio and video streams.

In an embodiment of the present invention, the apparatus further includes: a second processing module, configured to: before the first processing module sends an audio and video stream to each receiving end connected to the network gateway, Determining, by the receiving end, the audio and video data format required by the current receiving end, and determining whether the audio and video data format is consistent with the format of the audio and video stream, and in the audio and video data format and the sound In the format of the video stream, the format of the audio and video stream is converted according to the audio and video data format, and the converted audio and video stream is sent to the current receiving end.

In an embodiment of the present invention, the device further includes: an establishing module, configured to be in the Before receiving the audio and video stream sent by the sending end, the receiving module establishes a wireless communication connection with the sending end, and establishes a Miracast session with the sending end.

In an embodiment of the present invention, the apparatus further includes: a third processing module, configured to determine an audio and video data format required by the receiving end when the number of receiving ends connected to the network gateway is one, And determining whether the audio and video data format is consistent with the format of the audio and video stream, and when the audio and video data format is inconsistent with the format of the audio and video stream, the audio and video according to the audio and video data format The format of the stream is converted, and the converted audio and video stream is sent to the receiving end.

In an embodiment of the present invention, the apparatus further includes: a fourth processing module, configured to: after the determining module determines whether the number of receiving ends connected to the network gateway is multiple, when monitoring the new access At the receiving end, the audio and video streams are duplicated according to the number of newly accessed receiving ends, and an audio and video stream is sent to each newly accessed receiving end, so that each newly accessed receiving end receives And projecting the audio and video stream.

The device for sharing audio and video resources according to the embodiment of the present invention receives the audio and video stream sent by the sending end by the receiving module, and determines whether the number of receiving ends connected to the network gateway is multiple by the determining module, and determines the network gateway When the number of connected receiving ends is multiple, the first processing module copies the audio and video streams according to the number of receiving ends, and sends an audio and video stream to each receiving end connected to the network gateway, so that each receiving end The audio and video streams are received and projected, thereby enabling a plurality of receiving ends to synchronously display the audio and video content of the transmitting end, which satisfies the requirement of the user to use the audio and video content of the plurality of receiving ends to project the transmitting end, thereby improving the user experience.

To achieve the above objective, the third aspect of the present invention provides a network gateway, including: an apparatus for sharing audio and video resources in the second aspect.

The network gateway according to the embodiment of the present invention determines whether the number of receiving ends connected to the network gateway is multiple after receiving the audio and video stream sent by the transmitting end, and determines that the number of receiving ends connected to the network gateway is multiple. And copying the audio and video streams according to the number of receiving ends, and sending an audio and video stream to each receiving end connected to the network gateway, so that each receiving end receives and projects the audio and video streams, thereby making multiple The receiving end synchronously displays the audio and video content of the transmitting end. The requirement for the user to use the audio and video content of the plurality of receiving end projection transmitting ends is satisfied, and the user experience is improved.

To achieve the above objective, the fourth aspect of the present invention provides a system for sharing audio and video resources, a transmitting end, a network gateway, and at least one receiving end, wherein the transmitting end is configured to send a sound to the network gateway. Video stream data; the network gateway is configured to receive the audio and video stream data sent by the sending end, and determine whether the number of the receiving ends is multiple, and when the number of the receiving ends is multiple, according to The number of receiving ends copies the audio and video streams, and sends an audio and video stream to each receiving end connected to the network gateway, so that each receiving end receives and projects the audio and video streams; The receiving end is configured to receive the audio and video stream sent by the network gateway, and project the audio and video stream.

In an embodiment of the present invention, the network gateway is further configured to: determine, before each of the receiving ends, a current receiving before sending an audio and video stream to each receiving end connected to the network gateway. And determining a format of the audio and video data required, and determining whether the audio and video data format is consistent with the format of the audio and video stream, and when the audio and video data format is inconsistent with the format of the audio and video stream, according to the The audio and video data format converts the format of the audio and video stream, and sends the converted audio and video stream to the current receiving end.

In an embodiment of the present invention, the network gateway is further configured to: determine, when the number of receiving ends connected to the network gateway is one, determine an audio and video data format required by the receiving end, and determine the Whether the audio and video data format is consistent with the format of the audio and video stream; if the audio and video data format is inconsistent with the format of the audio and video stream, converting the format of the audio and video stream according to the audio and video data format And transmitting the converted audio and video stream to the receiving end.

In an embodiment of the present invention, after the network gateway determines whether the number of receiving ends connected to the network gateway is multiple, if the network gateway monitors a receiving end with a new access, the network gateway is configured according to The number of receiving ends of the new access copies the audio and video streams in multiple copies, and sends an audio and video stream to each newly accessed receiving end, so that the receiving end of each new access receives and projects the sound. Video stream.

In the embodiment of the present invention, a computer storage medium is further provided, and the computer storage medium may store an execution instruction, where the execution instruction is used to perform the method for sharing audio and video resources in the foregoing embodiment.

According to the audio and video resource sharing system of the embodiment of the present invention, after receiving the audio and video stream sent by the transmitting end, the network gateway determines whether the number of receiving ends connected to the network gateway is multiple, and determines the receiving connection with the network gateway. When the number of terminals is multiple, the audio and video streams are copied according to the number of the receiving ends, and an audio and video stream is sent to each receiving end connected to the network gateway, so that each receiving end receives and projects the audio and video streams. Thereby, the plurality of receiving ends synchronously display the audio and video content of the transmitting end, which satisfies the requirement that the user uses the audio and video content of the plurality of receiving ends to project the transmitting end, thereby improving the user experience.

DRAWINGS

1 is a flow chart of a method for sharing audio and video resources according to an embodiment of the present invention.

2 is a flow chart of a method for sharing audio and video resources according to another embodiment of the present invention.

3 is a flow chart of a method for sharing audio and video resources according to still another embodiment of the present invention.

FIG. 4 is a schematic structural diagram of an apparatus for sharing audio and video resources according to an embodiment of the present invention.

FIG. 5 is a schematic structural diagram of an apparatus for sharing audio and video resources according to another embodiment of the present invention.

6 is a schematic diagram of the basic structure of a network gateway.

FIG. 7 is a schematic structural diagram of a system for sharing audio and video resources according to an embodiment of the present invention.

8 is a diagram of an example of a system for audio and video resource sharing, in accordance with one embodiment of the present invention.

detailed description

The embodiments of the present invention are described in detail below, and the examples of the embodiments are illustrated in the drawings, wherein the same or similar reference numerals are used to refer to the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the drawings are intended to be illustrative of the invention and are not to be construed as limiting.

A method, an apparatus, a system, and a network gateway for sharing audio and video resources according to an embodiment of the present invention are described below with reference to the accompanying drawings.

As shown in FIG. 1, the method for sharing audio and video resources includes:

S101. Receive an audio and video stream sent by the sending end.

The sender is a device compatible with the Miracast function, that is, the sender is a device that supports the Miracast function.

In the process of projecting audio and video to the receiving end, after the network gateway receives the wireless communication connection request sent by the transmitting end, the network gateway establishes a wireless communication connection with the transmitting end based on the wireless communication connection request, and the transmitting end Establish a Miracast session.

After the Miracast session is established between the network gateway and the sending end, the sending end sends the audio and video stream to the network gateway. Correspondingly, the network gateway receives and saves the audio and video stream sent by the sending end.

Among them, the wireless communication connection can be established between the transmitting end and the network gateway through multiple wireless methods, for example, WIFI (Wireless Fidelity) mode, Bluetooth, etc. In practical applications, the user can select and monitor the network gateway according to needs. The wireless mode of the communication connection is not limited in this embodiment.

It should be understood that the network gateway in this embodiment is a gateway compatible with the Miracast function.

The receiving end may be a device compatible with the Miracast function or a device not compatible with the Miracast function.

S102. Determine whether the number of receiving ends connected to the network gateway is multiple.

S103. If it is determined that the number of the receiving ends connected to the network gateway is multiple, the audio and video streams are copied according to the number of the receiving ends, and an audio and video stream is sent to each receiving end connected to the network gateway, so that Each receiving end receives and projects an audio and video stream.

Specifically, in the process of receiving and saving the audio and video stream sent by the sending end, the network gateway also acquires the number of receiving ends connected to the current time, and determines the current time and Whether the number of receiving ends of the connection is multiple, if it is determined that the number of receiving ends connected to the current time is multiple, in order to enable the receiving end connected thereto to display the audio and video resources sent by the transmitting end, that is, in order to connect with the same The receiving end synchronously displays the audio and video resources of the transmitting end. At this time, the network gateway can copy the audio and video streams according to the number of receiving ends connected thereto.

It should be noted that the receiving end of the embodiment and the network gateway may be connected by wire, or may be connected by wireless. For example, the current receiving end is a smart TV, and the smart TV may be wired or wireless. The way to establish a communication connection with the network gateway.

It should be understood that in the process of interaction between the network gateway and the receiving end, the interaction between the network gateway and the receiving end may be compatible with Miracast, or may be compatible with Miracast and adopt other streaming media transmission and playing modes. The interaction between the network gateway and the receiving end can be selected according to the actual situation. This embodiment does not limit the interaction mode between the network gateway and the receiving end.

Generally, the data format of the audio and video supported by each receiving end may be different. In order to enable the receiving end to play the audio and video stream sent by the network gateway normally, the network gateway copies the audio and video stream according to the data of the receiving end, and then responds to the corresponding In the process of sending the audio and video stream by the receiving end, for each receiving end, the network gateway can determine the audio and video data format required by the current receiving end, and determine whether the audio and video data format and the format of the audio and video stream required by the current receiving end are Consistently, if it is determined that the format of the audio and video data required by the current receiving end is inconsistent with the format of the audio and video stream, the network gateway converts the format of the audio and video stream according to the audio and video data format required by the current receiving end, and converts the format. The subsequent audio and video streams are sent to the current receiving end. Correspondingly, the current receiving end receives and plays the audio and video content corresponding to the audio and video.

According to the method for sharing audio and video resources according to the embodiment of the present invention, after receiving the audio and video stream sent by the transmitting end, it is determined whether the number of receiving ends connected to the network gateway is multiple, and determining the number of receiving ends connected to the network gateway. When there are multiple, the audio and video streams are copied according to the number of receiving ends, and an audio and video stream is sent to each receiving end connected to the network gateway, so that each receiving end receives and projects the audio and video streams, thereby So that multiple receiving ends synchronously display the audio and video content of the transmitting end, which satisfies the need for the user to use the audio and video content of the plurality of receiving end projection transmitting ends. Demand, improve user experience.

Based on the foregoing embodiment, as shown in FIG. 2, the method for sharing audio and video resources may further include steps S104 and S105.

S104. If it is determined that the number of receiving ends connected to the network gateway is one, determine an audio and video data format required by the receiving end, and determine whether the audio and video data format is consistent with the format of the audio and video streams.

S105. If the audio and video data format is inconsistent with the format of the audio and video stream, convert the format of the audio and video stream according to the audio and video data format, and send the converted audio and video stream to the receiving end.

It should be understood that if the audio and video data format is consistent with the format of the audio and video stream, the network gateway does not need to convert the format of the audio and video data, and the network gateway directly sends the corresponding audio and video stream to the receiving end, and the corresponding receiving end is The audio and video streams play the corresponding audio and video content, thereby realizing the synchronization of audio and video content between the transmitting end and the receiving end, satisfying the requirement of viewing audio and video resources on the receiving end, and improving the user experience.

As shown in FIG. 3, the method for sharing audio and video resources includes:

S301. Receive an audio and video stream sent by the sending end.

Wherein, the wireless communication connection can be established between the transmitting end and the network gateway through multiple wireless modes. For example, the WIFI (Wireless Fidelity) mode, the Bluetooth, and the like, in a practical application, the user can select a wireless mode for monitoring the communication connection with the network gateway according to the requirement, which is not limited in this embodiment.

S302. Determine whether the number of receiving ends connected to the network gateway is multiple.

S303. If it is determined that the number of the receiving ends connected to the network gateway is multiple, the audio and video streams are copied according to the number of the receiving ends, and an audio and video stream is sent to each receiving end connected to the network gateway, so that Each receiving end receives and projects an audio and video stream.

Specifically, in the process of receiving and storing the audio and video stream sent by the sending end, the network gateway also obtains the number of receiving ends connected to the current time, and determines whether the number of receiving ends connected to the current time is multiple, if it is determined The number of receiving ends connected to the current time is multiple, so that the receiving end connected thereto can display the audio and video resources sent by the transmitting end, that is, in order to enable the receiving end connected thereto to synchronously display the audio and video resources of the transmitting end, At this time, the network gateway can copy the audio and video streams according to the number of receiving ends connected thereto.

Generally, the data format of the audio and video supported by each receiving end may be different. In order to enable the receiving end to play the audio and video stream sent by the network gateway normally, the network gateway will use the data of the receiving end. After the audio and video streams are copied in multiple copies, in the process of transmitting the audio and video streams to the corresponding receiving end, for each receiving end, the network gateway can determine the audio and video data format required by the current receiving end, and determine the current receiving end required Whether the format of the audio and video data is consistent with the format of the audio and video stream, if it is determined that the format of the audio and video data required by the current receiving end is inconsistent with the format of the audio and video stream, the network gateway according to the audio and video data format required by the current receiving end The format of the audio and video stream is converted, and the converted audio and video stream is sent to the current receiving end. Correspondingly, the current receiving end receives and plays the audio and video content corresponding to the audio and video.

S304. If it is determined that the number of receiving ends connected to the network gateway is one, determine an audio and video data format required by the receiving end, and determine whether the audio and video data format is the same as the format of the audio and video stream.

S305. If the audio and video data format is inconsistent with the format of the audio and video stream, convert the format of the audio and video stream according to the audio and video data format, and send the converted audio and video stream to the receiving end.

Generally, in the process of synchronously playing audio and video on the transmitting end and the receiving end, the receiving end connected to the network gateway is not fixed, and the user can increase the number of receiving ends connected to the network gateway according to actual needs, in order to make a new connection. The receiving end of the network gateway can be synchronized with the audio and video content of the sending end. As shown in FIG. 3, after step S302, step S306 can also be included.

S306. If the receiving end with the new access is monitored, the audio and video streams are copied according to the number of newly accessed receiving ends, and an audio and video stream is sent to each newly accessed receiving end, so that each The receiving end of the new access receives and projects the audio and video streams.

Therefore, the receiving end of the new access network can receive the audio and video stream sent by the sending end, so that the receiving end of the new access network gateway can also realize the audio and video synchronization with the transmitting end.

It should be understood that, in the actual situation, the receiving end may also disconnect from the network gateway at any time. In this case, in order to reduce the consumption of the network gateway resources, after the network gateway monitors the disconnected receiving end, The network gateway can update the number of receiving ends with which the connection is established, and copy the audio and video streams according to the updated number, thereby stopping the copying of the audio and video streams for the disconnected receiving end.

In order to implement the foregoing embodiments, an embodiment of the present invention further provides an apparatus for sharing audio and video resources.

FIG. 4 is a schematic structural diagram of an apparatus for sharing audio and video resources according to an embodiment of the present invention. The device for sharing the audio and video resources is located in a network gateway, and the network gateway is a gateway compatible with the function of the receiving end of the Miracast. As shown in FIG. 4, the device for sharing audio and video resources includes a receiving module 110, a determining module 120, and a first processing module. 130.

Specifically, the receiving module 110 is configured to receive an audio and video stream sent by the transmitting end.

In an embodiment of the present invention, as shown in FIG. 5, the apparatus may further include an establishing module 140 configured to establish a wireless communication connection with the transmitting end before the receiving module receives the audio and video stream sent by the transmitting end. And establish a Miracast session with the sender.

The receiving end may be a device compatible with the Miracast function or a device not compatible with the Miracast function. Specifically, the determining module 120 is configured to determine whether the number of receiving ends connected to the network gateway is multiple.

The first processing module 130 is configured to: when the number of the receiving ends connected to the network gateway is determined to be multiple, copy the audio and video streams according to the number of the receiving ends, and send a voice to each receiving end connected to the network gateway. The video stream is such that each receiving end receives and projects the audio and video streams.

Generally, the data format of the audio and video supported by each receiving end may be different. In order to enable the receiving end to play the audio and video stream sent by the network gateway normally, as shown in FIG. 5, the apparatus may further include a second processing module 150. The second processing module 150 is configured to determine, according to each receiving end, the audio and video data format required by the current receiving end before the first processing module 130 sends an audio and video stream to each receiving end connected to the network gateway, and determine Whether the audio and video data format is consistent with the format of the audio and video stream, and in the audio and video data format and the audio and video stream format, the format of the audio and video stream is converted according to the audio and video data format, and the formatted audio and video stream is converted. Send to the current receiving end.

As shown in FIG. 5, the apparatus may further include a third processing module 160 configured to determine an audio and video data format required by the receiving end when the number of receiving ends connected to the network gateway is one, and determine The audio and video data format is consistent with the format of the audio and video stream, and when the audio and video data format is inconsistent with the format of the audio and video stream, the format of the audio and video stream is converted according to the audio and video data format, and the formatted audio and video is converted. The stream is sent to the receiving end.

Generally, in the process of synchronously playing audio and video on the transmitting end and the receiving end, the receiving end connected to the network gateway is not fixed, and the user can increase the number of receiving ends connected to the network gateway according to actual needs, in order to make a new connection. The receiving end of the network gateway can be connected to the sound of the transmitting end. The video content is synchronized. As shown in FIG. 5, the apparatus may further include a fourth processing module 170, where the fourth processing module 170 is configured to monitor after the determining module 120 determines whether the number of receiving ends connected to the network gateway is multiple. When there is a new access receiver, the audio and video streams are copied according to the number of newly accessed receivers, and an audio and video stream is sent to each newly accessed receiver to make each new access. The receiving end receives and projects the audio and video streams.

It should be noted that the foregoing description of the method for sharing audio and video resources is also applicable to the device for sharing audio and video resources in the embodiment, and the implementation principle is similar, and details are not described herein again.

In order to implement the foregoing embodiments, an embodiment of the present invention further provides a network gateway.

A network gateway includes an apparatus for sharing audio and video resources according to an embodiment of the second aspect of the present invention.

6 is a schematic diagram of the basic structure of a network gateway. As shown in FIG. 6, the network gateway includes a central processing unit (GWCU) 60, a first network interface (GW-IF1) 61, a first data processing module (P-IF1) 62, and a universal WAN interface (GW-WAN-IF). 63, a second network interface (GW-IF2) 64, a second data processing module (P-IF2) 65, wherein:

The central processing unit 60 is arranged to control the universal WAN interface 63, the first data processing module 62 and the second data processing module 65 in the network gateway.

The first network interface 61 is arranged to connect to the transmitting end.

The first data processing module 62 is configured to preprocess the received message stream, audio and video streams.

The universal WAN interface 63 is a universal WAN interface of the network gateway and is set to connect to the Internet.

The second network interface 64 is arranged to connect to one or more sink devices.

The second data processing module 65 is arranged to copy and construct a message stream, an audio and video stream to be transmitted to the receiving device.

It should be understood that the network gateway has the common functions of a common network gateway, and can complete the functions of connecting the sender and the receiver, processing and copying the message stream, audio and video stream described in the present invention.

In order to implement the foregoing embodiments, an embodiment of the present invention further provides a system for sharing audio and video resources.

FIG. 7 is a schematic structural diagram of a system for sharing audio and video resources according to an embodiment of the present invention. The system for sharing audio and video resources may include a transmitting end 10, a network gateway 20, and at least one receiving end 30, where

The transmitting end 10 is arranged to transmit audio and video stream data to the network gateway 20.

The network gateway 20 is configured to receive the audio and video stream data sent by the transmitting end 10, and determine whether the number of receiving ends is multiple, and when the number of receiving ends is multiple, according to the number of receiving ends The audio and video streams are copied in multiple copies, and an audio and video stream is sent to each receiving end connected to the network gateway 20, so that each receiving end receives and projects the audio and video streams.

The receiving end 30 is arranged to receive the audio and video stream sent by the network gateway 20 and project the audio and video stream.

For example, as shown in FIG. 8 , the system for sharing audio and video resources includes N receiving ends 30, and each receiving end 30 is wirelessly connected with The network gateway 20 communicates.

In an embodiment of the present invention, the data format of the audio and video supported by each receiving end 30 may be different. In order to enable the receiving end 30 to play the audio and video streams sent by the network gateway 20 normally, the network gateway 20 is further configured to: Before each audio and video stream is sent to each receiving end connected to the network gateway 20, for each receiving end, the audio and video data format required by the current receiving end is determined, and the format of the audio and video data and the format of the audio and video stream are determined. Whether it is consistent, and when the audio and video data format is inconsistent with the format of the audio and video stream, the format of the audio and video stream is converted according to the audio and video data format, and the converted audio and video stream is sent to the current receiving end 30.

In addition, when the number of receiving ends connected to the network gateway 20 is one, the network gateway 20 can determine the audio and video data format required by the receiving end, and determine whether the audio and video data format is consistent with the format of the audio and video stream, and if the audio and video The data format is inconsistent with the format of the audio and video stream, and the format of the audio and video stream is converted according to the audio and video data format, and the converted audio and video stream is sent to the receiving end.

It should be understood that if the audio and video data format is consistent with the format of the audio and video stream, the network gateway 20 does not need to convert the format of the audio and video stream, and directly sends the corresponding audio and video stream to the receiving end 30, and the receiving end 30 plays the sound. The audio and video content corresponding to the video stream.

Generally, in the process of synchronously playing audio and video on the transmitting end 10 and the receiving end, the receiving end connected to the network gateway 20 is not fixed, and the user can increase the number of receiving ends connected to the network gateway 20 according to actual needs, in order to The receiving end of the new access network gateway 20 can synchronize with the audio and video content of the transmitting end 10. After the network gateway 20 determines whether the number of receiving ends connected to the network gateway 20 is multiple, if the network gateway 20 monitors that there is a new connection. At the receiving end, the network gateway 20 copies the audio and video streams according to the number of newly received receiving ends, And sending an audio and video stream to each newly accessed receiving end, so that each newly accessed receiving end receives and projects the audio and video streams.

It should be noted that the foregoing description of the method and device for sharing audio and video resources and the network gateway are also applicable to the system for sharing audio and video resources in this embodiment, and details are not described herein again.

Embodiments of the present invention also provide a storage medium. Optionally, in the embodiment, the foregoing storage medium may be configured to store program code for performing the following steps:

S1, receiving an audio and video stream sent by the sending end;

S2, determining whether the number of receiving ends connected to the network gateway is multiple;

S3. If it is determined that the number of the receiving ends connected to the network gateway is multiple, the audio and video streams are copied according to the number of the receiving ends, and an audio and video stream is sent to each receiving end connected to the network gateway, so that Each receiving end receives and projects an audio and video stream.

Optionally, in this embodiment, the foregoing storage medium may include, but not limited to, a USB flash drive, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, and a magnetic memory. A variety of media that can store program code, such as a disc or a disc.

In the description of the present specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" and the like means a specific feature described in connection with the embodiment or example. A structure, material or feature is included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms is not necessarily directed to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be in any one or more The embodiments or examples are combined in a suitable manner. In addition, various embodiments or examples described in the specification, as well as features of various embodiments or examples, may be combined and combined.

Moreover, the terms "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, features defining "first" or "second" may include at least one of the features, either explicitly or implicitly. In the description of the present invention, the meaning of "a plurality" is at least two, such as two, three, etc., unless specifically defined otherwise.

Any process or method description in the flowcharts or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a particular logical function or process. And the scope of the preferred embodiments of the invention includes additional implementations, in which the functions may be performed in a substantially simultaneous manner or in an opposite order depending on the functions involved, in the order shown or discussed. It will be understood by those skilled in the art to which the embodiments of the present invention pertain.

The logic and/or steps represented in the flowchart or otherwise described herein, for example, may be considered as an ordered list of executable instructions for implementing logical functions, and may be embodied in any computer readable medium, Used in conjunction with, or in conjunction with, an instruction execution system, apparatus, or device (eg, a computer-based system, a system including a processor, or other system that can fetch instructions and execute instructions from an instruction execution system, apparatus, or device) Or use with equipment. For the purposes of this specification, a "computer-readable medium" can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with the instruction execution system, apparatus, or device. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections (electronic devices) having one or more wires, portable computer disk cartridges (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM). In addition, the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if appropriate, other suitable Way to handle it The program is obtained electronically and then stored in computer memory.

It should be understood that portions of the invention may be implemented in hardware, software, firmware or a combination thereof. In the above-described embodiments, multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques well known in the art: having logic gates for implementing logic functions on data signals. Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

One of ordinary skill in the art can understand that all or part of the steps carried by the method of implementing the above embodiments can be completed by a program to instruct related hardware, and the program can be stored in a computer readable storage medium. When executed, one or a combination of the steps of the method embodiments is included.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. The integrated modules, if implemented in the form of software functional modules and sold or used as stand-alone products, may also be stored in a computer readable storage medium.

The above mentioned storage medium may be a read only memory, a magnetic disk or an optical disk or the like. Although the embodiments of the present invention have been shown and described, it is understood that the above-described embodiments are illustrative and are not to be construed as limiting the scope of the invention. The embodiments are subject to variations, modifications, substitutions and variations.

Industrial applicability

In the embodiment of the present invention, after receiving the audio and video stream sent by the transmitting end, determining whether the number of receiving ends connected to the network gateway is multiple, and determining that the number of receiving ends connected to the network gateway is multiple, according to The number of receiving ends copies multiple copies of the audio and video stream, and sends an audio and video stream to each receiving end connected to the network gateway, so that each receiving end receives and projects audio and video. The frequency stream, thereby enabling a plurality of receiving ends to synchronously display the audio and video content of the transmitting end, satisfies the requirement of the user to use the audio and video content of the plurality of receiving end projection transmitting ends, thereby improving the user experience.

Claims

A method for sharing audio and video resources includes the following steps:

Receiving an audio and video stream sent by the sender;

Determining whether the number of receiving ends connected to the network gateway is multiple;

If it is determined that the number of the receiving ends connected to the network gateway is multiple, the audio and video streams are copied according to the number of the receiving ends, and one copy is sent to each receiving end connected to the network gateway. The audio and video streams are such that each receiving end receives and projects the audio and video streams.
The method for sharing audio and video resources according to claim 1, wherein before the sending of the audio and video stream to each receiving end connected to the network gateway, the method further includes:

Determining, by each of the receiving ends, an audio and video data format required by the current receiving end, and determining whether the audio and video data format is consistent with the format of the audio and video stream;

If not, the format of the audio and video stream is converted according to the audio and video data format, and the converted audio and video stream is sent to the current receiving end.
The method for sharing audio and video resources according to claim 1, wherein before the receiving the audio and video stream sent by the transmitting end, the method further comprises:

Establishing a wireless communication connection with the sender and establishing a Miracast session with the sender.
The method for sharing audio and video resources according to claim 1, further comprising:

When the number of receiving ends connected to the network gateway is one, determining an audio and video data format required by the receiving end, and determining whether the audio and video data format is consistent with the format of the audio and video stream;

If the audio and video data format is inconsistent with the format of the audio and video stream, The audio and video data format converts the format of the audio and video stream, and sends the converted audio and video stream to the receiving end.
The method for sharing audio and video resources according to claim 1 or 4, wherein after determining whether the number of receiving ends connected to the network gateway is multiple, the method further includes:

If the receiving end with the new access is monitored, the audio and video streams are duplicated according to the number of newly accessed receiving ends, and an audio and video stream is sent to each newly accessed receiving end, so that each The receiving end of the new access receives and projects the audio and video streams.
A device for sharing audio and video resources, comprising:

a receiving module, configured to receive an audio and video stream sent by the sending end;

The determining module is configured to determine whether the number of receiving ends connected to the network gateway is multiple;

a first processing module, configured to: when the number of the receiving ends connected to the network gateway is determined to be multiple, copy the audio and video streams according to the number of the receiving ends, and send each of the audio and video streams to each of the network gateways The connected receiving end sends a stream of audio and video such that each receiving end receives and projects the audio and video stream.
The device for sharing audio and video resources according to claim 6, further comprising:

a second processing module, configured to determine, before each of the receiving ends, a tone required by the current receiving end, before the first processing module sends an audio and video stream to each receiving end connected to the network gateway a video data format, and determining whether the audio and video data format is consistent with a format of the audio and video stream, and when the audio and video data format and the audio and video stream are in a format, according to the audio and video data format The format of the audio and video stream is converted, and the converted audio and video stream is sent to the current receiving end.
The device for sharing audio and video resources according to claim 6, further comprising:

And establishing a module, configured to establish a wireless communication connection with the sending end and establish a Miracast session with the sending end before the receiving module receives the audio and video stream sent by the sending end.
The device for sharing audio and video resources according to claim 6, further comprising:

a third processing module, configured to determine an audio and video data format required by the receiving end when the number of receiving ends connected to the network gateway is one, and determine the audio and video data format and the audio and video stream Whether the format is consistent, and when the audio and video data format is inconsistent with the format of the audio and video stream, converting the format of the audio and video stream according to the audio and video data format, and converting the formatted audio and video stream Send to the receiving end.
The device for sharing audio and video resources according to claim 6 or 9, further comprising:

a fourth processing module, configured to: after the determining module determines whether the number of receiving ends connected to the network gateway is multiple, when monitoring the receiving end with the new access, according to the number of newly accessed receiving ends The audio and video streams are copied in multiple copies, and an audio and video stream is sent to each newly accessed receiving end, so that each newly accessed receiving end receives and projects the audio and video streams.
A network gateway, comprising: an apparatus for sharing audio and video resources according to any one of claims 6-10.
A system for sharing audio and video resources, comprising: a transmitting end, a network gateway, and at least one receiving end, wherein

The sending end is configured to send audio and video stream data to the network gateway;

The network gateway is configured to receive the audio and video stream data sent by the sending end, and determine whether the number of the receiving ends is multiple, and the number of the receiving ends is multiple And copying the audio and video streams according to the number of the receiving ends, and sending an audio and video stream to each receiving end connected to the network gateway, so that each receiving end receives and projects the sound. Video stream

The receiving end is configured to receive the audio and video stream sent by the network gateway, and project the audio and video stream.
The system for sharing audio and video resources according to claim 12, wherein the network gateway is further configured to:

Before sending an audio and video stream to each receiving end connected to the network gateway, determining, for each of the receiving ends, an audio and video data format required by the current receiving end, and determining the audio and video data format and Whether the format of the audio and video stream is consistent, and when the audio and video data format is inconsistent with the format of the audio and video stream, converting the format of the audio and video stream according to the audio and video data format, and converting The formatted audio and video stream is sent to the current receiving end.
The system for sharing audio and video resources according to claim 12, wherein the network gateway is further configured to:

When the number of receiving ends connected to the network gateway is one, determining an audio and video data format required by the receiving end, and determining whether the audio and video data format is consistent with the format of the audio and video stream;

If the audio and video data format is inconsistent with the format of the audio and video stream, converting the format of the audio and video stream according to the audio and video data format, and transmitting the converted audio and video stream to the receiving end.
The system for sharing audio and video resources according to claim 12 or 14, wherein after the network gateway determines whether the number of receiving ends connected to the network gateway is plural, if the network gateway monitors that there is new access At the receiving end, the network gateway root Copying the audio and video streams according to the number of newly accessed receiving ends, and transmitting an audio and video stream to each newly accessed receiving end, so that each newly accessed receiving end receives and projects the said Audio and video streaming.