WO2017140161A1 - Procédé, dispositif et système pour partager une ressource audio et vidéo, et passerelle de réseau - Google Patents

Procédé, dispositif et système pour partager une ressource audio et vidéo, et passerelle de réseau Download PDF

Info

Publication number
WO2017140161A1
WO2017140161A1 PCT/CN2016/108759 CN2016108759W WO2017140161A1 WO 2017140161 A1 WO2017140161 A1 WO 2017140161A1 CN 2016108759 W CN2016108759 W CN 2016108759W WO 2017140161 A1 WO2017140161 A1 WO 2017140161A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
video
network gateway
video stream
receiving end
Prior art date
Application number
PCT/CN2016/108759
Other languages
English (en)
Chinese (zh)
Inventor
袁文华
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2017140161A1 publication Critical patent/WO2017140161A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
    • H04N21/4385—Multiplex stream processing, e.g. multiplex stream decrypting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44204—Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched

Definitions

  • the embodiments of the present invention relate to the technical field, and in particular, to a method, an apparatus, a system, and a network gateway for sharing audio and video resources.
  • Miracast also known as WI-FI Display
  • WI-FI Display is a point-to-point multimedia sharing protocol developed by the WI-FI Alliance. Its main purpose is to transmit the multimedia data of the source device to the destination device for playback display by wireless transmission.
  • Miracast is a wireless display standard based on WI-FI Direct, and handheld devices supporting this standard can share video images wirelessly.
  • a mobile phone that supports Miracast can use Miracast to directly synchronize a movie or photo to a TV or other device for playback without any connection line, so as to meet the needs of the user to watch the video, thereby improving the user experience.
  • the connection process of Miracast is: first, look for the nearby Miracast device with Wi-Fi Direct, and then transmit the information of the discovered Miracast device to the user, after which the user can find the device that was previously connected or previously connected. Select the device you want to connect to. After the wireless connection is established, the devices on both sides will coordinate the device function and network conditions to select the appropriate audio and video transmission format. After the online protocol session of the video stream is established between the two devices, the source device sends a series of real-time streaming protocol (RTSP) control commands to the destination device to control the playback and termination of the video stream.
  • RTSP real-time streaming protocol
  • the user will have a device that supports the Miracast function, but other reproduction devices (for example, a reproduction device such as a television, a projection device, etc.) are not, and sometimes the user needs to be on multiple large or small screens. Displaying image information, how to display image information on the screen of multiple or large or small reproduction devices at the same time is an urgent problem to be solved.
  • other reproduction devices for example, a reproduction device such as a television, a projection device, etc.
  • the embodiments of the present invention aim to solve at least one of the technical problems in the related art to some extent.
  • the first object of the embodiment of the present invention is to provide a method for sharing audio and video resources, which realizes synchronization of audio and video content between a transmitting end and a receiving end, and satisfies the viewing of audio and video resources on the receiving end.
  • Demand increases user experience.
  • a second object of the embodiments of the present invention is to provide an apparatus for sharing audio and video resources.
  • a third object of embodiments of the present invention is to provide a network gateway.
  • a fourth object of the embodiments of the present invention is to provide a system for sharing audio and video resources.
  • the first aspect of the present invention provides a method for sharing audio and video resources, including: receiving an audio and video stream sent by a sending end; determining whether the number of receiving ends connected to the network gateway is multiple; If the number of the receiving ends connected to the network gateway is multiple, the audio and video streams are duplicated according to the number of the receiving ends, and an audio and video is sent to each receiving end connected to the network gateway. Streaming so that each receiving end receives and projects the audiovisual stream.
  • the method before the sending, by the receiving end, the audio and video stream to each of the network gateways, the method further includes: determining, for each of the receiving ends, the current receiving end And an audio and video data format, and determining whether the audio and video data format is consistent with the format of the audio and video stream; if not, converting the format of the audio and video stream according to the audio and video data format, and converting the format The subsequent audio and video stream is sent to the current receiving end.
  • the method before the receiving the audio and video stream sent by the sending end, the method further includes: establishing a wireless communication connection with the sending end, and establishing a Miracast session with the sending end.
  • the method further includes determining, when the number of receiving ends connected to the network gateway is one, determining an audio and video data format required by the receiving end, and determining the audio and video data. Whether the format is consistent with the format of the audio and video stream; if the audio and video data format is inconsistent with the format of the audio and video stream, the The format of the audio and video stream is converted, and the converted audio and video stream is sent to the receiving end.
  • the method further includes: if the receiving end with the new access is monitored, according to the newly accessed The number of receiving ends copies the audio and video streams in multiple copies, and sends an audio and video stream to each newly accessed receiving end, so that each newly accessed receiving end receives and projects the audio and video streams.
  • the method for sharing audio and video resources after receiving the audio and video stream sent by the transmitting end, it is determined whether the number of receiving ends connected to the network gateway is multiple, and determining the number of receiving ends connected to the network gateway.
  • the audio and video streams are copied according to the number of receiving ends, and an audio and video stream is sent to each receiving end connected to the network gateway, so that each receiving end receives and projects the audio and video streams, thereby
  • the plurality of receiving ends synchronously display the audio and video content of the transmitting end, which satisfies the requirement of the user to use the audio and video content of the plurality of receiving end projection transmitting ends, thereby improving the user experience.
  • the second aspect of the present invention provides an apparatus for sharing audio and video resources, including: a receiving module, configured to receive an audio and video stream sent by a sending end; and a determining module configured to determine a connection with the network gateway. Whether the number of the receiving ends is multiple; the first processing module is configured to: when determining that the number of receiving ends connected to the network gateway is multiple, copying the audio and video streams according to the number of the receiving ends, and An audio and video stream is sent to each receiving end connected to the network gateway, so that each receiving end receives and projects the audio and video streams.
  • the apparatus further includes: a second processing module, configured to: before the first processing module sends an audio and video stream to each receiving end connected to the network gateway, Determining, by the receiving end, the audio and video data format required by the current receiving end, and determining whether the audio and video data format is consistent with the format of the audio and video stream, and in the audio and video data format and the sound
  • the format of the audio and video stream is converted according to the audio and video data format, and the converted audio and video stream is sent to the current receiving end.
  • the device further includes: an establishing module, configured to be in the Before receiving the audio and video stream sent by the sending end, the receiving module establishes a wireless communication connection with the sending end, and establishes a Miracast session with the sending end.
  • an establishing module configured to be in the Before receiving the audio and video stream sent by the sending end, the receiving module establishes a wireless communication connection with the sending end, and establishes a Miracast session with the sending end.
  • the apparatus further includes: a third processing module, configured to determine an audio and video data format required by the receiving end when the number of receiving ends connected to the network gateway is one, And determining whether the audio and video data format is consistent with the format of the audio and video stream, and when the audio and video data format is inconsistent with the format of the audio and video stream, the audio and video according to the audio and video data format The format of the stream is converted, and the converted audio and video stream is sent to the receiving end.
  • a third processing module configured to determine an audio and video data format required by the receiving end when the number of receiving ends connected to the network gateway is one, And determining whether the audio and video data format is consistent with the format of the audio and video stream, and when the audio and video data format is inconsistent with the format of the audio and video stream, the audio and video according to the audio and video data format The format of the stream is converted, and the converted audio and video stream is sent to the receiving end.
  • the apparatus further includes: a fourth processing module, configured to: after the determining module determines whether the number of receiving ends connected to the network gateway is multiple, when monitoring the new access At the receiving end, the audio and video streams are duplicated according to the number of newly accessed receiving ends, and an audio and video stream is sent to each newly accessed receiving end, so that each newly accessed receiving end receives And projecting the audio and video stream.
  • a fourth processing module configured to: after the determining module determines whether the number of receiving ends connected to the network gateway is multiple, when monitoring the new access At the receiving end, the audio and video streams are duplicated according to the number of newly accessed receiving ends, and an audio and video stream is sent to each newly accessed receiving end, so that each newly accessed receiving end receives And projecting the audio and video stream.
  • the device for sharing audio and video resources receives the audio and video stream sent by the sending end by the receiving module, and determines whether the number of receiving ends connected to the network gateway is multiple by the determining module, and determines the network gateway
  • the first processing module copies the audio and video streams according to the number of receiving ends, and sends an audio and video stream to each receiving end connected to the network gateway, so that each receiving end
  • the audio and video streams are received and projected, thereby enabling a plurality of receiving ends to synchronously display the audio and video content of the transmitting end, which satisfies the requirement of the user to use the audio and video content of the plurality of receiving ends to project the transmitting end, thereby improving the user experience.
  • the third aspect of the present invention provides a network gateway, including: an apparatus for sharing audio and video resources in the second aspect.
  • the network gateway determines whether the number of receiving ends connected to the network gateway is multiple after receiving the audio and video stream sent by the transmitting end, and determines that the number of receiving ends connected to the network gateway is multiple. And copying the audio and video streams according to the number of receiving ends, and sending an audio and video stream to each receiving end connected to the network gateway, so that each receiving end receives and projects the audio and video streams, thereby making multiple.
  • the receiving end synchronously displays the audio and video content of the transmitting end. The requirement for the user to use the audio and video content of the plurality of receiving end projection transmitting ends is satisfied, and the user experience is improved.
  • the fourth aspect of the present invention provides a system for sharing audio and video resources, a transmitting end, a network gateway, and at least one receiving end, wherein the transmitting end is configured to send a sound to the network gateway.
  • Video stream data the network gateway is configured to receive the audio and video stream data sent by the sending end, and determine whether the number of the receiving ends is multiple, and when the number of the receiving ends is multiple, according to The number of receiving ends copies the audio and video streams, and sends an audio and video stream to each receiving end connected to the network gateway, so that each receiving end receives and projects the audio and video streams;
  • the receiving end is configured to receive the audio and video stream sent by the network gateway, and project the audio and video stream.
  • the network gateway is further configured to: determine, before each of the receiving ends, a current receiving before sending an audio and video stream to each receiving end connected to the network gateway. And determining a format of the audio and video data required, and determining whether the audio and video data format is consistent with the format of the audio and video stream, and when the audio and video data format is inconsistent with the format of the audio and video stream, according to the The audio and video data format converts the format of the audio and video stream, and sends the converted audio and video stream to the current receiving end.
  • the network gateway is further configured to: determine, when the number of receiving ends connected to the network gateway is one, determine an audio and video data format required by the receiving end, and determine the Whether the audio and video data format is consistent with the format of the audio and video stream; if the audio and video data format is inconsistent with the format of the audio and video stream, converting the format of the audio and video stream according to the audio and video data format And transmitting the converted audio and video stream to the receiving end.
  • the network gateway determines whether the number of receiving ends connected to the network gateway is multiple, if the network gateway monitors a receiving end with a new access, the network gateway is configured according to The number of receiving ends of the new access copies the audio and video streams in multiple copies, and sends an audio and video stream to each newly accessed receiving end, so that the receiving end of each new access receives and projects the sound. Video stream.
  • a computer storage medium is further provided, and the computer storage medium may store an execution instruction, where the execution instruction is used to perform the method for sharing audio and video resources in the foregoing embodiment.
  • the network gateway determines whether the number of receiving ends connected to the network gateway is multiple, and determines the receiving connection with the network gateway.
  • the audio and video streams are copied according to the number of the receiving ends, and an audio and video stream is sent to each receiving end connected to the network gateway, so that each receiving end receives and projects the audio and video streams.
  • the plurality of receiving ends synchronously display the audio and video content of the transmitting end, which satisfies the requirement that the user uses the audio and video content of the plurality of receiving ends to project the transmitting end, thereby improving the user experience.
  • FIG. 1 is a flow chart of a method for sharing audio and video resources according to an embodiment of the present invention.
  • FIG. 2 is a flow chart of a method for sharing audio and video resources according to another embodiment of the present invention.
  • FIG. 3 is a flow chart of a method for sharing audio and video resources according to still another embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of an apparatus for sharing audio and video resources according to an embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of an apparatus for sharing audio and video resources according to another embodiment of the present invention.
  • FIG. 6 is a schematic diagram of the basic structure of a network gateway.
  • FIG. 7 is a schematic structural diagram of a system for sharing audio and video resources according to an embodiment of the present invention.
  • FIG. 8 is a diagram of an example of a system for audio and video resource sharing, in accordance with one embodiment of the present invention.
  • FIG. 1 is a flow chart of a method for sharing audio and video resources according to an embodiment of the present invention.
  • the method for sharing audio and video resources includes:
  • S101 Receive an audio and video stream sent by the sending end.
  • the sender is a device compatible with the Miracast function, that is, the sender is a device that supports the Miracast function.
  • the network gateway In the process of projecting audio and video to the receiving end, after the network gateway receives the wireless communication connection request sent by the transmitting end, the network gateway establishes a wireless communication connection with the transmitting end based on the wireless communication connection request, and the transmitting end Establish a Miracast session.
  • the sending end sends the audio and video stream to the network gateway.
  • the network gateway receives and saves the audio and video stream sent by the sending end.
  • the wireless communication connection can be established between the transmitting end and the network gateway through multiple wireless methods, for example, WIFI (Wireless Fidelity) mode, Bluetooth, etc.
  • WIFI Wireless Fidelity
  • Bluetooth etc.
  • the user can select and monitor the network gateway according to needs.
  • the wireless mode of the communication connection is not limited in this embodiment.
  • the network gateway in this embodiment is a gateway compatible with the Miracast function.
  • the receiving end may be a device compatible with the Miracast function or a device not compatible with the Miracast function.
  • the audio and video streams are copied according to the number of the receiving ends, and an audio and video stream is sent to each receiving end connected to the network gateway, so that Each receiving end receives and projects an audio and video stream.
  • the network gateway in the process of receiving and saving the audio and video stream sent by the sending end, the network gateway also acquires the number of receiving ends connected to the current time, and determines the current time and Whether the number of receiving ends of the connection is multiple, if it is determined that the number of receiving ends connected to the current time is multiple, in order to enable the receiving end connected thereto to display the audio and video resources sent by the transmitting end, that is, in order to connect with the same
  • the receiving end synchronously displays the audio and video resources of the transmitting end.
  • the network gateway can copy the audio and video streams according to the number of receiving ends connected thereto.
  • the receiving end of the embodiment and the network gateway may be connected by wire, or may be connected by wireless.
  • the current receiving end is a smart TV, and the smart TV may be wired or wireless. The way to establish a communication connection with the network gateway.
  • the interaction between the network gateway and the receiving end may be compatible with Miracast, or may be compatible with Miracast and adopt other streaming media transmission and playing modes.
  • the interaction between the network gateway and the receiving end can be selected according to the actual situation. This embodiment does not limit the interaction mode between the network gateway and the receiving end.
  • the data format of the audio and video supported by each receiving end may be different.
  • the network gateway copies the audio and video stream according to the data of the receiving end, and then responds to the corresponding
  • the network gateway can determine the audio and video data format required by the current receiving end, and determine whether the audio and video data format and the format of the audio and video stream required by the current receiving end are Consistently, if it is determined that the format of the audio and video data required by the current receiving end is inconsistent with the format of the audio and video stream, the network gateway converts the format of the audio and video stream according to the audio and video data format required by the current receiving end, and converts the format.
  • the subsequent audio and video streams are sent to the current receiving end.
  • the current receiving end receives and plays the audio and video content corresponding to the audio and video.
  • the method for sharing audio and video resources after receiving the audio and video stream sent by the transmitting end, it is determined whether the number of receiving ends connected to the network gateway is multiple, and determining the number of receiving ends connected to the network gateway.
  • the audio and video streams are copied according to the number of receiving ends, and an audio and video stream is sent to each receiving end connected to the network gateway, so that each receiving end receives and projects the audio and video streams, thereby So that multiple receiving ends synchronously display the audio and video content of the transmitting end, which satisfies the need for the user to use the audio and video content of the plurality of receiving end projection transmitting ends.
  • Demand improve user experience.
  • the method for sharing audio and video resources may further include steps S104 and S105.
  • the network gateway does not need to convert the format of the audio and video data, and the network gateway directly sends the corresponding audio and video stream to the receiving end, and the corresponding receiving end is
  • the audio and video streams play the corresponding audio and video content, thereby realizing the synchronization of audio and video content between the transmitting end and the receiving end, satisfying the requirement of viewing audio and video resources on the receiving end, and improving the user experience.
  • FIG. 3 is a flow chart of a method for sharing audio and video resources according to still another embodiment of the present invention.
  • the method for sharing audio and video resources includes:
  • S301 Receive an audio and video stream sent by the sending end.
  • the sender is a device compatible with the Miracast function, that is, the sender is a device that supports the Miracast function.
  • the network gateway In the process of projecting audio and video to the receiving end, after the network gateway receives the wireless communication connection request sent by the transmitting end, the network gateway establishes a wireless communication connection with the transmitting end based on the wireless communication connection request, and the transmitting end Establish a Miracast session.
  • the sending end sends the audio and video stream to the network gateway.
  • the network gateway receives and saves the audio and video stream sent by the sending end.
  • the wireless communication connection can be established between the transmitting end and the network gateway through multiple wireless modes.
  • the WIFI Wireless Fidelity
  • the Bluetooth in a practical application, the user can select a wireless mode for monitoring the communication connection with the network gateway according to the requirement, which is not limited in this embodiment.
  • the network gateway in this embodiment is a gateway compatible with the Miracast function.
  • the receiving end may be a device compatible with the Miracast function or a device not compatible with the Miracast function.
  • the audio and video streams are copied according to the number of the receiving ends, and an audio and video stream is sent to each receiving end connected to the network gateway, so that Each receiving end receives and projects an audio and video stream.
  • the network gateway in the process of receiving and storing the audio and video stream sent by the sending end, the network gateway also obtains the number of receiving ends connected to the current time, and determines whether the number of receiving ends connected to the current time is multiple, if it is determined The number of receiving ends connected to the current time is multiple, so that the receiving end connected thereto can display the audio and video resources sent by the transmitting end, that is, in order to enable the receiving end connected thereto to synchronously display the audio and video resources of the transmitting end, At this time, the network gateway can copy the audio and video streams according to the number of receiving ends connected thereto.
  • the receiving end of the embodiment and the network gateway may be connected by wire, or may be connected by wireless.
  • the current receiving end is a smart TV, and the smart TV may be wired or wireless. The way to establish a communication connection with the network gateway.
  • the interaction between the network gateway and the receiving end may be compatible with Miracast, or may be compatible with Miracast and adopt other streaming media transmission and playing modes.
  • the interaction between the network gateway and the receiving end can be selected according to the actual situation. This embodiment does not limit the interaction mode between the network gateway and the receiving end.
  • the data format of the audio and video supported by each receiving end may be different.
  • the network gateway will use the data of the receiving end.
  • the network gateway can determine the audio and video data format required by the current receiving end, and determine the current receiving end required Whether the format of the audio and video data is consistent with the format of the audio and video stream, if it is determined that the format of the audio and video data required by the current receiving end is inconsistent with the format of the audio and video stream, the network gateway according to the audio and video data format required by the current receiving end
  • the format of the audio and video stream is converted, and the converted audio and video stream is sent to the current receiving end.
  • the current receiving end receives and plays the audio and video content corresponding to the audio and video.
  • the receiving end connected to the network gateway is not fixed, and the user can increase the number of receiving ends connected to the network gateway according to actual needs, in order to make a new connection.
  • the receiving end of the network gateway can be synchronized with the audio and video content of the sending end. As shown in FIG. 3, after step S302, step S306 can also be included.
  • the audio and video streams are copied according to the number of newly accessed receiving ends, and an audio and video stream is sent to each newly accessed receiving end, so that each The receiving end of the new access receives and projects the audio and video streams.
  • the receiving end of the new access network can receive the audio and video stream sent by the sending end, so that the receiving end of the new access network gateway can also realize the audio and video synchronization with the transmitting end.
  • the receiving end may also disconnect from the network gateway at any time.
  • the network gateway can update the number of receiving ends with which the connection is established, and copy the audio and video streams according to the updated number, thereby stopping the copying of the audio and video streams for the disconnected receiving end.
  • the method for sharing audio and video resources after receiving the audio and video stream sent by the transmitting end, it is determined whether the number of receiving ends connected to the network gateway is multiple, and determining the number of receiving ends connected to the network gateway.
  • the audio and video streams are copied according to the number of receiving ends, and an audio and video stream is sent to each receiving end connected to the network gateway, so that each receiving end receives and projects the audio and video streams, thereby
  • the plurality of receiving ends synchronously display the audio and video content of the transmitting end, which satisfies the requirement of the user to use the audio and video content of the plurality of receiving end projection transmitting ends, thereby improving the user experience.
  • an embodiment of the present invention further provides an apparatus for sharing audio and video resources.
  • FIG. 4 is a schematic structural diagram of an apparatus for sharing audio and video resources according to an embodiment of the present invention.
  • the device for sharing the audio and video resources is located in a network gateway, and the network gateway is a gateway compatible with the function of the receiving end of the Miracast.
  • the device for sharing audio and video resources includes a receiving module 110, a determining module 120, and a first processing module. 130.
  • the receiving module 110 is configured to receive an audio and video stream sent by the transmitting end.
  • the sender is a device compatible with the Miracast function, that is, the sender is a device that supports the Miracast function.
  • the apparatus may further include an establishing module 140 configured to establish a wireless communication connection with the transmitting end before the receiving module receives the audio and video stream sent by the transmitting end. And establish a Miracast session with the sender.
  • an establishing module 140 configured to establish a wireless communication connection with the transmitting end before the receiving module receives the audio and video stream sent by the transmitting end. And establish a Miracast session with the sender.
  • the wireless communication connection can be established between the transmitting end and the network gateway through multiple wireless methods, for example, WIFI (Wireless Fidelity) mode, Bluetooth, etc.
  • WIFI Wireless Fidelity
  • Bluetooth etc.
  • the user can select and monitor the network gateway according to needs.
  • the wireless mode of the communication connection is not limited in this embodiment.
  • the receiving end may be a device compatible with the Miracast function or a device not compatible with the Miracast function.
  • the determining module 120 is configured to determine whether the number of receiving ends connected to the network gateway is multiple.
  • the first processing module 130 is configured to: when the number of the receiving ends connected to the network gateway is determined to be multiple, copy the audio and video streams according to the number of the receiving ends, and send a voice to each receiving end connected to the network gateway.
  • the video stream is such that each receiving end receives and projects the audio and video streams.
  • the receiving end of the embodiment and the network gateway may be connected by wire, or may be connected by wireless.
  • the current receiving end is a smart TV, and the smart TV may be wired or wireless. The way to establish a communication connection with the network gateway.
  • the interaction between the network gateway and the receiving end may be compatible with Miracast, or may be compatible with Miracast and adopt other streaming media transmission and playing modes.
  • the interaction between the network gateway and the receiving end can be selected according to the actual situation. This embodiment does not limit the interaction mode between the network gateway and the receiving end.
  • the apparatus may further include a second processing module 150.
  • the second processing module 150 is configured to determine, according to each receiving end, the audio and video data format required by the current receiving end before the first processing module 130 sends an audio and video stream to each receiving end connected to the network gateway, and determine Whether the audio and video data format is consistent with the format of the audio and video stream, and in the audio and video data format and the audio and video stream format, the format of the audio and video stream is converted according to the audio and video data format, and the formatted audio and video stream is converted. Send to the current receiving end.
  • the apparatus may further include a third processing module 160 configured to determine an audio and video data format required by the receiving end when the number of receiving ends connected to the network gateway is one, and determine The audio and video data format is consistent with the format of the audio and video stream, and when the audio and video data format is inconsistent with the format of the audio and video stream, the format of the audio and video stream is converted according to the audio and video data format, and the formatted audio and video is converted.
  • the stream is sent to the receiving end.
  • the receiving end connected to the network gateway is not fixed, and the user can increase the number of receiving ends connected to the network gateway according to actual needs, in order to make a new connection.
  • the receiving end of the network gateway can be connected to the sound of the transmitting end.
  • the video content is synchronized.
  • the apparatus may further include a fourth processing module 170, where the fourth processing module 170 is configured to monitor after the determining module 120 determines whether the number of receiving ends connected to the network gateway is multiple. When there is a new access receiver, the audio and video streams are copied according to the number of newly accessed receivers, and an audio and video stream is sent to each newly accessed receiver to make each new access.
  • the receiving end receives and projects the audio and video streams.
  • the receiving end may also disconnect from the network gateway at any time.
  • the network gateway can update the number of receiving ends with which the connection is established, and copy the audio and video streams according to the updated number, thereby stopping the copying of the audio and video streams for the disconnected receiving end.
  • the device for sharing audio and video resources receives the audio and video stream sent by the sending end by the receiving module, and determines whether the number of receiving ends connected to the network gateway is multiple by the determining module, and determines the network gateway
  • the first processing module copies the audio and video streams according to the number of receiving ends, and sends an audio and video stream to each receiving end connected to the network gateway, so that each receiving end
  • the audio and video streams are received and projected, thereby enabling a plurality of receiving ends to synchronously display the audio and video content of the transmitting end, which satisfies the requirement of the user to use the audio and video content of the plurality of receiving ends to project the transmitting end, thereby improving the user experience.
  • an embodiment of the present invention further provides a network gateway.
  • a network gateway includes an apparatus for sharing audio and video resources according to an embodiment of the second aspect of the present invention.
  • the network gateway determines whether the number of receiving ends connected to the network gateway is multiple after receiving the audio and video stream sent by the transmitting end, and determines that the number of receiving ends connected to the network gateway is multiple. And copying the audio and video streams according to the number of receiving ends, and sending an audio and video stream to each receiving end connected to the network gateway, so that each receiving end receives and projects the audio and video streams, thereby making multiple.
  • the receiving end synchronously displays the audio and video content of the transmitting end. The requirement for the user to use the audio and video content of the plurality of receiving end projection transmitting ends is satisfied, and the user experience is improved.
  • the network gateway includes a central processing unit (GWCU) 60, a first network interface (GW-IF1) 61, a first data processing module (P-IF1) 62, and a universal WAN interface (GW-WAN-IF). 63, a second network interface (GW-IF2) 64, a second data processing module (P-IF2) 65, wherein:
  • the central processing unit 60 is arranged to control the universal WAN interface 63, the first data processing module 62 and the second data processing module 65 in the network gateway.
  • the first network interface 61 is arranged to connect to the transmitting end.
  • the first data processing module 62 is configured to preprocess the received message stream, audio and video streams.
  • the universal WAN interface 63 is a universal WAN interface of the network gateway and is set to connect to the Internet.
  • the second network interface 64 is arranged to connect to one or more sink devices.
  • the second data processing module 65 is arranged to copy and construct a message stream, an audio and video stream to be transmitted to the receiving device.
  • the network gateway has the common functions of a common network gateway, and can complete the functions of connecting the sender and the receiver, processing and copying the message stream, audio and video stream described in the present invention.
  • an embodiment of the present invention further provides a system for sharing audio and video resources.
  • FIG. 7 is a schematic structural diagram of a system for sharing audio and video resources according to an embodiment of the present invention.
  • the system for sharing audio and video resources may include a transmitting end 10, a network gateway 20, and at least one receiving end 30, where
  • the transmitting end 10 is arranged to transmit audio and video stream data to the network gateway 20.
  • the network gateway 20 is configured to receive the audio and video stream data sent by the transmitting end 10, and determine whether the number of receiving ends is multiple, and when the number of receiving ends is multiple, according to the number of receiving ends.
  • the audio and video streams are copied in multiple copies, and an audio and video stream is sent to each receiving end connected to the network gateway 20, so that each receiving end receives and projects the audio and video streams.
  • the receiving end 30 is arranged to receive the audio and video stream sent by the network gateway 20 and project the audio and video stream.
  • the system for sharing audio and video resources includes N receiving ends 30, and each receiving end 30 is wirelessly connected with The network gateway 20 communicates.
  • the data format of the audio and video supported by each receiving end 30 may be different.
  • the network gateway 20 is further configured to: Before each audio and video stream is sent to each receiving end connected to the network gateway 20, for each receiving end, the audio and video data format required by the current receiving end is determined, and the format of the audio and video data and the format of the audio and video stream are determined. Whether it is consistent, and when the audio and video data format is inconsistent with the format of the audio and video stream, the format of the audio and video stream is converted according to the audio and video data format, and the converted audio and video stream is sent to the current receiving end 30.
  • the network gateway 20 can determine the audio and video data format required by the receiving end, and determine whether the audio and video data format is consistent with the format of the audio and video stream, and if the audio and video The data format is inconsistent with the format of the audio and video stream, and the format of the audio and video stream is converted according to the audio and video data format, and the converted audio and video stream is sent to the receiving end.
  • the network gateway 20 does not need to convert the format of the audio and video stream, and directly sends the corresponding audio and video stream to the receiving end 30, and the receiving end 30 plays the sound.
  • the audio and video content corresponding to the video stream is consistent with the format of the audio and video stream.
  • the receiving end connected to the network gateway 20 is not fixed, and the user can increase the number of receiving ends connected to the network gateway 20 according to actual needs, in order to The receiving end of the new access network gateway 20 can synchronize with the audio and video content of the transmitting end 10.
  • the network gateway 20 determines whether the number of receiving ends connected to the network gateway 20 is multiple, if the network gateway 20 monitors that there is a new connection.
  • the network gateway 20 copies the audio and video streams according to the number of newly received receiving ends, And sending an audio and video stream to each newly accessed receiving end, so that each newly accessed receiving end receives and projects the audio and video streams.
  • the network gateway determines whether the number of receiving ends connected to the network gateway is multiple, and determines the receiving connection with the network gateway.
  • the audio and video streams are copied according to the number of the receiving ends, and an audio and video stream is sent to each receiving end connected to the network gateway, so that each receiving end receives and projects the audio and video streams.
  • the plurality of receiving ends synchronously display the audio and video content of the transmitting end, which satisfies the requirement that the user uses the audio and video content of the plurality of receiving ends to project the transmitting end, thereby improving the user experience.
  • Embodiments of the present invention also provide a storage medium.
  • the foregoing storage medium may be configured to store program code for performing the following steps:
  • the audio and video streams are copied according to the number of the receiving ends, and an audio and video stream is sent to each receiving end connected to the network gateway, so that Each receiving end receives and projects an audio and video stream.
  • the foregoing storage medium may include, but not limited to, a USB flash drive, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, and a magnetic memory.
  • ROM Read-Only Memory
  • RAM Random Access Memory
  • a mobile hard disk e.g., a hard disk
  • magnetic memory e.g., a hard disk
  • first and second are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated.
  • features defining “first” or “second” may include at least one of the features, either explicitly or implicitly.
  • the meaning of "a plurality” is at least two, such as two, three, etc., unless specifically defined otherwise.
  • a "computer-readable medium” can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with the instruction execution system, apparatus, or device.
  • computer readable media include the following: electrical connections (electronic devices) having one or more wires, portable computer disk cartridges (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM).
  • the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if appropriate, other suitable Way to handle it The program is obtained electronically and then stored in computer memory.
  • portions of the invention may be implemented in hardware, software, firmware or a combination thereof.
  • multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system.
  • a suitable instruction execution system For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques well known in the art: having logic gates for implementing logic functions on data signals. Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.
  • each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may exist physically separately, or two or more units may be integrated into one module.
  • the above integrated modules can be implemented in the form of hardware or in the form of software functional modules.
  • the integrated modules, if implemented in the form of software functional modules and sold or used as stand-alone products, may also be stored in a computer readable storage medium.
  • the above mentioned storage medium may be a read only memory, a magnetic disk or an optical disk or the like.
  • the transmitting end after receiving the audio and video stream sent by the transmitting end, determining whether the number of receiving ends connected to the network gateway is multiple, and determining that the number of receiving ends connected to the network gateway is multiple, according to The number of receiving ends copies multiple copies of the audio and video stream, and sends an audio and video stream to each receiving end connected to the network gateway, so that each receiving end receives and projects audio and video.
  • the frequency stream thereby enabling a plurality of receiving ends to synchronously display the audio and video content of the transmitting end, satisfies the requirement of the user to use the audio and video content of the plurality of receiving end projection transmitting ends, thereby improving the user experience.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Information Transfer Between Computers (AREA)
  • Small-Scale Networks (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

L'invention concerne un procédé, un dispositif et un système pour partager une ressource audio et vidéo, ainsi qu'une passerelle de réseau. Le procédé consiste : à recevoir un flux audio et vidéo envoyé par une extrémité d'envoi ; à déterminer si le nombre d'extrémités de réception connectées à une passerelle de réseau est ou non supérieur à un ; s'il est déterminé que le nombre d'extrémités de réception connectées à la passerelle de réseau est supérieur à un, à produire une pluralité de copies du flux audio et vidéo selon le nombre d'extrémités de réception, et à envoyer une copie du flux audio et vidéo à chacune des extrémités de réception connectées à la passerelle de réseau de telle sorte que chaque extrémité de réception reçoit et projette le flux audio et vidéo. Le procédé pour partager une ressource audio et vidéo dans les modes de réalisation de la présente invention réalise la synchronisation de contenus audio et vidéo entre une extrémité d'envoi et une extrémité de réception, permettant ainsi de satisfaire les exigences pour regarder une ressource audio et vidéo sur l'extrémité de réception, et d'améliorer l'expérience d'utilisateur.
PCT/CN2016/108759 2016-02-18 2016-12-07 Procédé, dispositif et système pour partager une ressource audio et vidéo, et passerelle de réseau WO2017140161A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610091028.XA CN107094266A (zh) 2016-02-18 2016-02-18 音视频资源共享的方法、装置、系统及网络网关
CN201610091028.X 2016-02-18

Publications (1)

Publication Number Publication Date
WO2017140161A1 true WO2017140161A1 (fr) 2017-08-24

Family

ID=59625577

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/108759 WO2017140161A1 (fr) 2016-02-18 2016-12-07 Procédé, dispositif et système pour partager une ressource audio et vidéo, et passerelle de réseau

Country Status (2)

Country Link
CN (1) CN107094266A (fr)
WO (1) WO2017140161A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114422845A (zh) * 2021-12-20 2022-04-29 瑞芯微电子股份有限公司 收发音视频数据的方法和中转设备

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109032555A (zh) * 2018-07-06 2018-12-18 广州视源电子科技股份有限公司 投屏中音频数据处理方法、装置、存储介质及电子设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102855088A (zh) * 2012-09-14 2013-01-02 福州瑞芯微电子有限公司 开启、设置同屏连接的方法及其对应的系统与设备
CN103796080A (zh) * 2014-01-06 2014-05-14 联想(北京)有限公司 一种数据处理方法与电子设备
US20150095510A1 (en) * 2013-09-30 2015-04-02 Cavium, Inc. Protocol Switching over Multi-Network Interface
CN105812909A (zh) * 2014-12-29 2016-07-27 中国移动通信集团公司 一种视频传输方法及装置

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103888783A (zh) * 2013-06-03 2014-06-25 北京朝歌软件有限公司 多媒体数据传输控制方法、处理装置、服务器及播放系统

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102855088A (zh) * 2012-09-14 2013-01-02 福州瑞芯微电子有限公司 开启、设置同屏连接的方法及其对应的系统与设备
US20150095510A1 (en) * 2013-09-30 2015-04-02 Cavium, Inc. Protocol Switching over Multi-Network Interface
CN103796080A (zh) * 2014-01-06 2014-05-14 联想(北京)有限公司 一种数据处理方法与电子设备
CN105812909A (zh) * 2014-12-29 2016-07-27 中国移动通信集团公司 一种视频传输方法及装置

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114422845A (zh) * 2021-12-20 2022-04-29 瑞芯微电子股份有限公司 收发音视频数据的方法和中转设备

Also Published As

Publication number Publication date
CN107094266A (zh) 2017-08-25

Similar Documents

Publication Publication Date Title
US10637894B2 (en) Real-time placeshifting of media content to paired devices
US9913301B2 (en) Content sharing method and device
KR102305302B1 (ko) 무선 디스플레이를 위한 다이렉트 스트리밍
EP2640100B1 (fr) Procédé et appareil permettant de fournir une session d'affichage Wi-Fi améliorée dans un réseau d'affichage Wi-Fi
KR101632019B1 (ko) 무선 디스플레이 시스템에서 싱크 디바이스에서의 맞춤화된 재생
US10932210B2 (en) Content output device and control method thereof
CN105828151B (zh) 一种显示处理方法及装置
US9749373B2 (en) System and method for improved content streaming
TWI528827B (zh) 於複製模式中作無線多播的方法與設備及電腦可讀取媒體
WO2015139547A1 (fr) Procédé, dispositif et système d'établissement de scénario d'application
WO2018192183A1 (fr) Procédé et appareil permettant le traitement d'un fichier vidéo pendant une distribution d'écran sans fil
US9432725B2 (en) Method and apparatus for transmitting content to plurality of devices
BR102020025848A2 (pt) Equipamento decodificador com dois links de áudio
JP6116240B2 (ja) 送信装置、送信方法、及びプログラム
WO2017140161A1 (fr) Procédé, dispositif et système pour partager une ressource audio et vidéo, et passerelle de réseau
JP2015188204A (ja) 情報処理装置、情報処理方法、およびそのプログラム
WO2017018042A1 (fr) Dispositif de traitement d'informations, procédé de traitement d'informations, et appareil source
KR20190055802A (ko) 컨텐츠를 전송하는 방법 및 장치
KR101339835B1 (ko) 이동 단말의 실시간 화면 재생기, 그 시스템 및 화면 재생 방법
WO2013185702A1 (fr) Système et procédé de gestion de contenu de service dans un environnement multi-dispositifs
US8943247B1 (en) Media sink device input identification
WO2023273992A1 (fr) Système, procédé et appareil de transmission sans fil
US9544350B2 (en) RUI system, RUI server, RUI terminal apparatus and controlling method thereof
CN105530537A (zh) 一种多媒体数据的传输方法及相关设备
KR101337952B1 (ko) 개인용컴퓨터와 텔레비젼을 연결하는 연결장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16890385

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16890385

Country of ref document: EP

Kind code of ref document: A1