WO2015117355A1 - Method and device for realizing multimedia broadcasting of terminal - Google Patents

Method and device for realizing multimedia broadcasting of terminal Download PDF

Info

Publication number
WO2015117355A1
WO2015117355A1 PCT/CN2014/088659 CN2014088659W WO2015117355A1 WO 2015117355 A1 WO2015117355 A1 WO 2015117355A1 CN 2014088659 W CN2014088659 W CN 2014088659W WO 2015117355 A1 WO2015117355 A1 WO 2015117355A1
Authority
WO
WIPO (PCT)
Prior art keywords
streaming media
information
terminal
peer
receiving terminal
Prior art date
Application number
PCT/CN2014/088659
Other languages
French (fr)
Chinese (zh)
Inventor
陈飞雄
郭庆吉
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2015117355A1 publication Critical patent/WO2015117355A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/632—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing using a connection between clients on a wide area network, e.g. setting up a peer-to-peer communication via Internet for retrieving video segments from the hard-disk of other client devices

Definitions

  • the present invention relates to the field of communications technologies, and in particular, to a method and apparatus for implementing multimedia broadcasting of a terminal.
  • Voice and video are common communication information. They have achieved rapid development in the 3G and 4G eras, and have realized long-distance transmission of voice data and video data through mobile networks.
  • VOIP Voice over Internet Protocol
  • VOIP Voice over Internet Protocol
  • the sharing of voice and video needs to be realized in some local areas.
  • the teacher needs to deliver the voice to each listener, and also needs to share the content displayed by the PowerPoint.
  • the most important thing is that Transmit voice data and video data in real time. In this case, if the data is transmitted in real time through the mobile network, the time required for transmitting the data is long and the amount of data is large, so the cost is high.
  • the embodiments of the present invention provide a method and an apparatus for implementing multimedia broadcasting of a terminal.
  • a method for implementing multimedia broadcasting of a terminal includes the following steps:
  • the transmitting terminal processes the captured multimedia information into a streaming media
  • the transmitting terminal broadcasts the streaming media to the receiving terminal, and the streaming media is used to play the multimedia information in the streaming media after being received by the receiving terminal.
  • the transmitting terminal processing the captured multimedia information into the streaming media includes:
  • the captured multimedia time information and the picture time stamp information are processed into a streaming media according to a ratio of 1:N;
  • N is a positive integer.
  • the establishing a peer-to-peer wireless local area network includes:
  • the transmitting terminal and the receiving terminal are connected to a peer-to-peer wireless local area network by a wireless router, and the streaming media of the transmitting terminal is broadcasted to a receiving terminal in the local area network via a wireless router.
  • a method for implementing terminal multimedia broadcasting including the following steps:
  • the receiving terminal After receiving the streaming media, the receiving terminal plays the multimedia information in the streaming media.
  • the method further includes:
  • the voice is filled with a voiceless empty packet of the same length of time
  • an apparatus for implementing multimedia broadcasting of a terminal including:
  • a processing module configured to process, by the sending terminal, the captured multimedia information into a streaming media
  • the broadcast module is configured to broadcast, by the sending terminal, the streaming media to the receiving terminal, where the streaming media is used by the receiving terminal to play the multimedia information in the streaming media.
  • the processing module includes:
  • Adding a timestamp unit configured to add voice timestamp information and picture timestamp information to the captured multimedia information
  • the processing unit is configured to process the captured multimedia information into a streaming media according to a ratio of 1:N to the added voice timestamp information and the picture timestamp information;
  • N is a positive integer.
  • the establishing module establishing the peer-to-peer wireless local area network includes:
  • the transmitting terminal and the receiving terminal are connected to a peer-to-peer wireless local area network by a wireless router, and the streaming media of the transmitting terminal is broadcasted to a receiving terminal in the local area network via a wireless router.
  • an apparatus for implementing multimedia broadcasting of a terminal including:
  • a receiving module configured to receive, by the receiving terminal, a streaming media broadcast by the sending terminal
  • the playing module is configured to play the multimedia information in the streaming media after the receiving terminal receives the streaming media.
  • the playing module further includes:
  • Parsing the subunit configured to parse the received streaming media to obtain the streaming media Multimedia information
  • the determining subunit is configured to determine, according to the obtained multimedia information, whether the voice information and the picture information in the multimedia information are lost;
  • the compensation subunit is configured to copy the previous picture information to compensate if the result of the determination is that the picture information is lost.
  • the embodiment of the present invention can use the intelligent terminal to capture voice and picture information according to different needs, and form similar streaming media data or a separate voice stream, so that it can be shared to each user in the local area network, and can solve internal communication and information of most people. Delivered without the need to add any hardware costs, with a wide range of application scenarios.
  • FIG. 1 is a flowchart of a method for implementing multimedia broadcasting of a terminal according to an embodiment of the present invention
  • FIG. 2 is a flowchart of another method for implementing multimedia broadcasting of a terminal according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of an apparatus for implementing multimedia broadcasting of a terminal according to an embodiment of the present invention
  • FIG. 4 is a schematic diagram of another apparatus for implementing multimedia broadcasting of a terminal according to an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of a first topology structure of a terminal according to an embodiment of the present disclosure
  • FIG. 6 is a schematic diagram of a second topology structure of a terminal according to an embodiment of the present disclosure.
  • FIG. 7 is a schematic structural diagram of a transmitting terminal according to an embodiment of the present disclosure.
  • FIG. 8 is a schematic structural diagram of a receiving terminal according to an embodiment of the present disclosure.
  • FIG. 9 is a schematic diagram of time collection of voice and picture data according to an embodiment of the present invention.
  • FIG. 10 is a schematic diagram of an audio and video data transmission package according to an embodiment of the present invention.
  • FIG. 1 is a flowchart of a method for implementing multimedia broadcasting of a terminal according to an embodiment of the present invention. As shown in FIG. 1 , the method includes the following steps:
  • Step S101 Establish a peer-to-peer wireless local area network including a transmitting terminal and a receiving terminal;
  • the establishing a peer-to-peer wireless local area network includes: connecting the sending terminal and the receiving terminal to a peer-to-peer wireless local area network by using a wireless router, and causing the streaming media of the sending terminal to broadcast to a receiving terminal in the local area network via a wireless router .
  • Step S102 The transmitting terminal processes the captured multimedia information into a streaming media.
  • Step S103 The transmitting terminal broadcasts the streaming media to the receiving terminal, so that the receiving terminal plays the multimedia information in the streaming media at the receiving terminal after receiving the streaming media.
  • the processing, by the sending terminal, the captured multimedia information into the streaming media includes: adding a voice timestamp information and a picture timestamp information to the captured multimedia information; and adding the added voice timestamp information and the image timestamp information
  • the captured multimedia information is processed into a streaming medium in a ratio of 1:N; wherein the N is a positive integer.
  • FIG. 2 is a flowchart of another method for implementing multimedia broadcasting of a terminal according to an embodiment of the present invention. As shown in FIG. 2, the method includes the following steps:
  • Step S201 Establish a peer-to-peer wireless local area network including the sending terminal and the receiving terminal;
  • Step S202 The receiving terminal receives the streaming media broadcast by the sending terminal.
  • Step S203 After receiving the streaming media, the receiving terminal plays multimedia information such as voice and picture in the streaming media.
  • the method further includes: parsing the received streaming media to obtain multimedia information in the streaming media; and determining, according to the obtained multimedia information, And whether the voice information and the picture information in the multimedia information are lost; if the result of the judgment is that the voice information is lost, the voiceless empty packet of the same length of time, that is, an empty packet not including the voice information is filled; If the result of the judgment is that the picture information is lost, the previous picture information is copied for compensation.
  • FIG. 3 is a schematic diagram of an apparatus for implementing multimedia broadcasting of a terminal according to an embodiment of the present invention. As shown in FIG. 3, the method includes:
  • the establishing module 301 is configured to establish a peer-to-peer wireless local area network including the sending terminal and the receiving terminal;
  • the processing module 302 is configured to process, by the sending terminal, the captured multimedia information into a streaming media
  • the broadcast module 303 is configured to broadcast, by the sending terminal, the streaming media to the receiving terminal, where the streaming media is used by the receiving terminal to play the multimedia information in the streaming media.
  • the processing module 302 includes:
  • Adding a timestamp unit configured to add voice timestamp information and picture timestamp information to the captured multimedia information
  • the processing unit is configured to process the captured multimedia information into a streaming media according to a ratio of 1:N to the added voice timestamp information and the picture timestamp information; wherein the N is a positive integer.
  • the establishing a peer-to-peer wireless local area network includes: connecting the sending terminal and the receiving terminal to a peer-to-peer wireless local area network by using a wireless router, and causing the streaming media of the sending terminal to be broadcasted to the local area network via a wireless router.
  • Receiving terminal receiving terminal.
  • FIG. 4 is a schematic diagram of another apparatus for implementing multimedia broadcasting of a terminal according to an embodiment of the present invention. As shown in FIG. 4, the method includes:
  • the establishing module 401 is configured to establish a peer-to-peer wireless local area including the transmitting terminal and the receiving terminal network;
  • the receiving module 402 is configured to receive, by the receiving terminal, the streaming media broadcast by the sending terminal;
  • the playing module 403 is configured to play the multimedia information in the streaming media after the receiving terminal receives the streaming media.
  • the play module 403 includes:
  • the parsing subunit is configured to parse the received streaming media to obtain multimedia information in the streaming media
  • the determining subunit is configured to determine, according to the obtained multimedia information, whether the voice information and the picture information in the multimedia information are lost;
  • the compensation subunit is configured to copy the previous picture information to compensate if the result of the determination is that the picture information is lost.
  • the embodiment of the present invention needs to construct a peer-to-peer LAN node regardless of whether the terminal is a Wi-Fi hotspot. To use, it is necessary to ensure that each intelligent terminal in the local area network has UDP broadcast or multicast function, and the specific peer-to-peer network mode is shown in FIG. 5 and FIG. 6.
  • FIG. 5 is a schematic diagram showing a first topology of a terminal according to an embodiment of the present invention.
  • a Wi-Fi hotspot is a dedicated wireless cat, and other terminals are connected to the local area network, and UDP broadcast or multicast of all terminals passes.
  • the Wi-Fi wireless router broadcasts to each terminal of the local area network, thereby constituting a local area network in which all terminals are peers.
  • FIG. 6 is a schematic diagram showing a second topology structure of a terminal according to an embodiment of the present invention.
  • a Wi-Fi hotspot is a mobile terminal
  • other mobile terminals are connected to the local area network
  • the Wi-Fi hotspot mobile terminal is used as a router.
  • the Wi-Fi hotspot mobile terminal is not equivalent to other LAN terminals, because UDP broadcast or multicast cannot be implemented on each terminal in one way.
  • Terminals that are hotspots and non-hotspot terminals must be treated separately.
  • the terminal is used as a hotspot, there are many parameters to be set.
  • the hotspot parameters need to be taken into consideration to realize UDP broadcast or multicast, and non-hotspot terminals can be processed as usual. After doing so, all terminals that implement the topology are peer-to-peer.
  • FIG. 7 is a schematic structural diagram of a transmitting terminal according to an embodiment of the present invention. As shown in FIG. 7, the method includes a voice and video capturing module 701, a data pre-processing module 702, and a data sending module 703.
  • the voice and video capture module 701 is configured to capture a frame picture required by the audio stream and the video stream by using the smart terminal, that is, configured to capture voice and screen picture information.
  • the voice and video capture module 701 includes: a screen picture capture sub-module and a voice capture sub-module;
  • the screen picture capturing sub-module is configured to collect a screen image on the terminal every short period of time, save it in a video buffer, and add timestamp information as a data source of a subsequent video frame;
  • the voice capture sub-module is configured to continuously capture the voice information received by the terminal for a period of time and save the voice information to the voice buffer, and the start time stamp and the end time stamp of the continuous time need to match the screen image collection time stamp. That is, timing alignment is required.
  • the data pre-processing module 702 is configured to continuously capture video synthesis processing of the screen picture and the voice, that is, store the screen picture information and the voice information in a transmission buffer in a certain proportion. That is to say, the continuous frame picture is synthesized into a video stream, and then according to the timing alignment, the audio stream is added, the complete stream media is synthesized, and the data source of the streaming media server is simply mixed, and the audio stream and the video stream are simply mixed and transmitted. Put the data into the UDP communication send buffer in order, as shown in Figure 9.
  • the data sending module 703 is configured to sequentially take out the buffer on the basis of the peer-to-peer network.
  • the data is broadcast or multicast through the UDP client, so that each terminal in the LAN can receive the data. That is to say, the data is taken out from the transmission buffer, and UDP broadcast or multicast is performed on the local area network. Since there is no retransmission mechanism in UDP broadcast, there is no buffer congestion behavior, that is, the amount of data written in the transmit buffer is larger than the amount of transmitted data, resulting in buffer overflow.
  • FIG. 8 is a schematic structural diagram of a receiving terminal according to an embodiment of the present invention. As shown in FIG. 8, the data receiving module 801, the data analyzing module 802, and the data playing module 803 are included.
  • the data receiving module 801 is configured to receive UDP broadcast or multicast data through the UDP server, and store the data in the receiving buffer; that is, the data received by the UDP broadcast exists in the receiving buffer, and distinguishes the picture packet and Voice packets, check the proportional relationship between picture packets and voice packets, and compensate or fill them.
  • the data parsing module 802 is configured to parse the data into a voice stream and a video stream according to a known fixed ratio. Because it is UDP communication, it may cause a certain packet to be lost and needs some processing. Since the transmitting end is N picture packets and one voice packet are transmitted in proportion, once the receiving ratio is found to be not N:1, compensation or empty packet filling processing may be performed. If the picture is lost, you can copy the most recent picture received before compensation processing, which has little effect on the user experience. If it is a voice packet loss, it is not suitable for compensation processing, and an empty packet with the same length of time and no sound is filled to ensure the timing alignment of the picture and the voice data stream, and finally the data is divided into voice streams according to the N:1 ratio. And video streaming.
  • the data playing module 803 is configured to display the received audio and video data, that is, separately play the parsed audio stream and the video stream.
  • embodiments of the present invention further include a parameter configuration module configured to capture parameter configurations of operation and data transfer operations, and module flow control. That is to say, according to different application scenarios and network topology structures, it is determined whether the data to be transmitted is a separate voice stream, a separate video stream, or a synthesized audio and video stream; and parameter configuration for capturing voice and video frame pictures.
  • FIG. 10 is a schematic diagram of an audio and video data transmission package provided by an embodiment of the present invention, as shown in FIG. 10
  • the ratio of picture packets and voice packets on the sender side is N:1, that is, in a FIFO, there is one voice packet after every N picture packets.
  • the picture packet and voice packet at the receiving end should also be N:1. How to maintain the N:1 ratio in the case of packet loss has been described above.
  • the required voice information and the continuous picture are first saved to the FIFO (First Input First Output) according to the timing alignment manner, and UDP broadcast or multicast is shared in the local area network to each end user in the local area network.
  • FIFO First Input First Output
  • UDP broadcast or multicast is shared in the local area network to each end user in the local area network.
  • the invention adopts the Wi-Fi local area network wireless communication system, can realize real-time communication of voice and video, and does not have any mobile network communication cost, thereby improving the user experience.
  • embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention can take the form of a hardware embodiment, a software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.
  • the present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG.
  • the computer program instructions can be provided to a processor of a general purpose computer, a special purpose computer, an embedded processor, or other programmable data processing device to produce a machine such that the instructions are executed by a processor or other programmable data processing device.
  • These computer program instructions can also be stored in a bootable computer or other programmable data processing
  • the apparatus is readable in a computer readable memory in a particular manner such that instructions stored in the computer readable memory produce an article of manufacture comprising instruction means implemented in one or more flows and/or block diagrams of the flowchart The function specified in the box or in multiple boxes.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps that are configured to implement the functions specified in one or more blocks of the flowchart or in a block or blocks of the flowchart.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

Disclosed are a method and device for realizing multimedia broadcasting of a terminal, which relate to the technical field of communications. The method comprises the following steps: establishing a peer-to-peer wireless local area network comprising a sending terminal and a receiving terminal; processing, by the sending terminal, captured multimedia information into streaming media; and broadcasting, by the sending terminal, the streaming media to the receiving terminal, the streaming media being used for playing multimedia information in the streaming media after the receiving terminal receives same.

Description

一种实现终端多媒体广播的方法及装置Method and device for realizing terminal multimedia broadcasting 技术领域Technical field
本发明涉及通信技术领域，特别涉及一种实现终端多媒体广播的方法及装置。The present invention relates to the field of communications technologies, and in particular, to a method and apparatus for implementing multimedia broadcasting of a terminal.
背景技术Background technique
语音和视频是常见的通讯信息，在3G、4G时代取得了飞速的发展，已通过移动网络实现了语音数据和视频数据的远距离传输。为了降低通讯费用和流量费用，又提出了通过VOIP(Voice over Internet Protocol，IP电话)实现语音数据的远距离传输，以及通过家庭Wi-Fi网关实现移动终端的数据业务，解决视频等大数据的传输。以上是目前语音数据和视频数据主要的应用场景。Voice and video are common communication information. They have achieved rapid development in the 3G and 4G eras, and have realized long-distance transmission of voice data and video data through mobile networks. In order to reduce the communication cost and the traffic cost, it is proposed to realize the long-distance transmission of voice data through VOIP (Voice over Internet Protocol), and realize the data service of the mobile terminal through the home Wi-Fi gateway, and solve the big data such as video. transmission. The above is the main application scenario of current voice data and video data.
另外，在某些局部范围内需要实现语音和视频的共享，比如：在一个教室内，老师需要把语音传递给每个听众，同时还需要将PowerPoint显示的内容共享，此时最重要的是需要实时传递语音数据和视频数据。如果在这种情况下，还是通过移动网络实现数据的实时传递的话，由于需要传输数据的时间长，且数据量大，因此所需费用很高。In addition, the sharing of voice and video needs to be realized in some local areas. For example, in a classroom, the teacher needs to deliver the voice to each listener, and also needs to share the content displayed by the PowerPoint. At this time, the most important thing is that Transmit voice data and video data in real time. In this case, if the data is transmitted in real time through the mobile network, the time required for transmitting the data is long and the amount of data is large, so the cost is high.
发明内容Summary of the invention
为解决现有存在的技术问题，本发明实施例提供了一种实现终端多媒体广播的方法及装置。In order to solve the existing technical problems, the embodiments of the present invention provide a method and an apparatus for implementing multimedia broadcasting of a terminal.
根据本发明实施例的一个方面，提供了一种实现终端多媒体广播的方法，包括以下步骤：According to an aspect of an embodiment of the present invention, a method for implementing multimedia broadcasting of a terminal includes the following steps:
建立包括发送终端和接收终端的对等无线局域网； Establishing a peer-to-peer wireless local area network including a transmitting terminal and a receiving terminal;
所述发送终端将捕获的多媒体信息处理成流媒体；The transmitting terminal processes the captured multimedia information into a streaming media;
所述发送终端把所述流媒体广播给所述接收终端，所述流媒体用于所述接收终端收到后，播放所述流媒体中的多媒体信息。The transmitting terminal broadcasts the streaming media to the receiving terminal, and the streaming media is used to play the multimedia information in the streaming media after being received by the receiving terminal.
在本发明一个实施例中，所述的发送终端将捕获的多媒体信息处理成流媒体包括：In an embodiment of the present invention, the transmitting terminal processing the captured multimedia information into the streaming media includes:
在所捕获的多媒体信息上添加语音时间戳信息和图片时间戳信息；Adding voice timestamp information and picture timestamp information to the captured multimedia information;
对所述添加的语音时间戳信息和图片时间戳信息按照1：N的比例，将所捕获的多媒体信息处理成流媒体；And the captured multimedia time information and the picture time stamp information are processed into a streaming media according to a ratio of 1:N;
其中所述N是指正整数。Wherein N is a positive integer.
在本发明一个实施例中，所述建立对等无线局域网包括：In an embodiment of the invention, the establishing a peer-to-peer wireless local area network includes:
通过无线路由器将所述发送终端和所述接收终端连接到对等无线局域网中，使所述发送终端的流媒体经由无线路由器广播到所述局域网中的接收终端。The transmitting terminal and the receiving terminal are connected to a peer-to-peer wireless local area network by a wireless router, and the streaming media of the transmitting terminal is broadcasted to a receiving terminal in the local area network via a wireless router.
根据本发明实施例的另一方面，提供了一种实现终端多媒体广播的方法，包括以下步骤：According to another aspect of an embodiment of the present invention, a method for implementing terminal multimedia broadcasting is provided, including the following steps:
建立包括发送终端和接收终端的对等无线局域网；Establishing a peer-to-peer wireless local area network including a transmitting terminal and a receiving terminal;
所述接收终端接收所述发送终端广播的流媒体；Receiving, by the receiving terminal, the streaming media broadcast by the sending terminal;
所述接收终端接收所述流媒体后，播放所述流媒体中的多媒体信息。After receiving the streaming media, the receiving terminal plays the multimedia information in the streaming media.
在本发明一个实施例中，在所述接收终端接收所述流媒体后，该方法还包括：In an embodiment of the present invention, after the receiving terminal receives the streaming media, the method further includes:
对所接收到的流媒体进行解析，得到所述流媒体中的多媒体信息；Parsing the received streaming media to obtain multimedia information in the streaming media;
根据所得到的多媒体信息，判断所述多媒体信息中的语音信息和图片信息是否丢包；Determining, according to the obtained multimedia information, whether the voice information and the picture information in the multimedia information are lost;
若判断结果为语音信息丢包，则以同样时间长度的无声音空包进行填充； If the result of the judgment is that the voice information is lost, the voice is filled with a voiceless empty packet of the same length of time;
若判断结果为图片信息丢包，则复制前一张图片的信息进行补偿。If the result of the judgment is that the picture information is lost, the information of the previous picture is copied to compensate.
根据本发明实施例的另一方面，提供了一种实现终端多媒体广播的装置，包括：According to another aspect of the embodiments of the present invention, an apparatus for implementing multimedia broadcasting of a terminal is provided, including:
建立模块，配置为建立包括发送终端和接收终端的对等无线局域网；Establishing a module configured to establish a peer-to-peer wireless local area network including the transmitting terminal and the receiving terminal;
处理模块，配置为所述发送终端将捕获的多媒体信息处理成流媒体；a processing module, configured to process, by the sending terminal, the captured multimedia information into a streaming media;
广播模块，配置为所述发送终端把所述流媒体广播给所述接收终端，所述流媒体用于所述接收终端收到后，播放所述流媒体中的多媒体信息。The broadcast module is configured to broadcast, by the sending terminal, the streaming media to the receiving terminal, where the streaming media is used by the receiving terminal to play the multimedia information in the streaming media.
在本发明一个实施例中，所述的处理模块包括：In an embodiment of the invention, the processing module includes:
添加时间戳单元，配置为在所捕获的多媒体信息上添加语音时间戳信息和图片时间戳信息；Adding a timestamp unit, configured to add voice timestamp information and picture timestamp information to the captured multimedia information;
处理单元，配置为对所述添加的语音时间戳信息和图片时间戳信息按照1：N的比例，将所捕获的多媒体信息处理成流媒体；The processing unit is configured to process the captured multimedia information into a streaming media according to a ratio of 1:N to the added voice timestamp information and the picture timestamp information;
其中所述N是指正整数。Wherein N is a positive integer.
在本发明一个实施例中，所述建立模块建立所述对等无线局域网包括：In an embodiment of the present invention, the establishing module establishing the peer-to-peer wireless local area network includes:
通过无线路由器将所述发送终端和所述接收终端连接到对等无线局域网中，使所述发送终端的流媒体经由无线路由器广播到所述局域网中的接收终端。The transmitting terminal and the receiving terminal are connected to a peer-to-peer wireless local area network by a wireless router, and the streaming media of the transmitting terminal is broadcasted to a receiving terminal in the local area network via a wireless router.
根据本发明实施例的另一方面，提供了一种实现终端多媒体广播的装置，包括：According to another aspect of the embodiments of the present invention, an apparatus for implementing multimedia broadcasting of a terminal is provided, including:
建立模块，配置为建立包括发送终端和接收终端的对等无线局域网；Establishing a module configured to establish a peer-to-peer wireless local area network including the transmitting terminal and the receiving terminal;
接收模块，配置为所述接收终端接收所述发送终端广播的流媒体；a receiving module, configured to receive, by the receiving terminal, a streaming media broadcast by the sending terminal;
播放模块，配置为所述接收终端接收所述流媒体后，分别播放所述流媒体中的多媒体信息。The playing module is configured to play the multimedia information in the streaming media after the receiving terminal receives the streaming media.
在本发明一个实施例中，所述的播放模块还包括：In an embodiment of the present invention, the playing module further includes:
解析子单元，配置为对所接收到的流媒体进行解析，得到所述流媒体 中的多媒体信息；Parsing the subunit, configured to parse the received streaming media to obtain the streaming media Multimedia information;
判断子单元，配置为根据所得到的多媒体信息，判断所述多媒体信息中的语音信息和图片信息是否丢包；The determining subunit is configured to determine, according to the obtained multimedia information, whether the voice information and the picture information in the multimedia information are lost;
填充子单元，配置为若判断结果为语音信息丢包，则以同样时间长度的无声音空包进行填充；Filling the subunit, configured to fill the voice packet with the same length of time if the result of the judgment is that the voice information is lost;
补偿子单元，配置为若判断结果为图片信息丢包，则复制前一张图片信息进行补偿。The compensation subunit is configured to copy the previous picture information to compensate if the result of the determination is that the picture information is lost.
与现有技术相比较，本发明实施例的有益效果在于：Compared with the prior art, the beneficial effects of the embodiments of the present invention are:
本发明实施例可以根据不同需求，利用智能终端捕捉语音和图片信息，组成类似流媒体数据或者单独的语音流，使之可以共享给局域网中每个用户，可以解决大部分人员的内部通讯，信息传递，而不需要增加任何的硬件费用，具有广泛的应用场景。The embodiment of the present invention can use the intelligent terminal to capture voice and picture information according to different needs, and form similar streaming media data or a separate voice stream, so that it can be shared to each user in the local area network, and can solve internal communication and information of most people. Delivered without the need to add any hardware costs, with a wide range of application scenarios.
附图说明DRAWINGS
图1是本发明实施例提供的一种实现终端多媒体广播的方法流程图；FIG. 1 is a flowchart of a method for implementing multimedia broadcasting of a terminal according to an embodiment of the present invention;
图2是本发明实施例提供的另一种实现终端多媒体广播的方法流程图；2 is a flowchart of another method for implementing multimedia broadcasting of a terminal according to an embodiment of the present invention;
图3是本发明实施例提供的一种实现终端多媒体广播的装置示意图；3 is a schematic diagram of an apparatus for implementing multimedia broadcasting of a terminal according to an embodiment of the present invention;
图4是本发明实施例提供的另一种实现终端多媒体广播的装置示意图；4 is a schematic diagram of another apparatus for implementing multimedia broadcasting of a terminal according to an embodiment of the present invention;
图5是本发明实施例提供的终端的第一拓扑结构示意图；FIG. 5 is a schematic diagram of a first topology structure of a terminal according to an embodiment of the present disclosure;
图6是本发明实施例提供的终端的第二拓扑结构示意图；FIG. 6 is a schematic diagram of a second topology structure of a terminal according to an embodiment of the present disclosure;
图7是本发明实施例提供的发送终端的结构示意图；FIG. 7 is a schematic structural diagram of a transmitting terminal according to an embodiment of the present disclosure;
图8是本发明实施例提供的接收终端的结构示意图；FIG. 8 is a schematic structural diagram of a receiving terminal according to an embodiment of the present disclosure;
图9是本发明实施例提供的语音和图片数据采集时间示意图；FIG. 9 is a schematic diagram of time collection of voice and picture data according to an embodiment of the present invention; FIG.
图10是本发明实施例提供的音视频数据传输包示意图。 FIG. 10 is a schematic diagram of an audio and video data transmission package according to an embodiment of the present invention.
具体实施方式detailed description
以下结合附图对本发明的优选实施例进行详细说明，应当理解，以下所说明的优选实施例仅用于说明和解释本发明，并不用于限定本发明。The preferred embodiments of the present invention are described in detail below with reference to the accompanying drawings.
图1显示了本发明实施例提供的一种实现终端多媒体广播的方法流程图，如图1所示，包括以下步骤：FIG. 1 is a flowchart of a method for implementing multimedia broadcasting of a terminal according to an embodiment of the present invention. As shown in FIG. 1 , the method includes the following steps:
步骤S101：建立包括发送终端和接收终端的对等无线局域网；Step S101: Establish a peer-to-peer wireless local area network including a transmitting terminal and a receiving terminal;
所述建立对等无线局域网包括：通过无线路由器将所述发送终端和所述接收终端连接到对等无线局域网中，使所述发送终端的流媒体经由无线路由器广播到所述局域网中的接收终端。The establishing a peer-to-peer wireless local area network includes: connecting the sending terminal and the receiving terminal to a peer-to-peer wireless local area network by using a wireless router, and causing the streaming media of the sending terminal to broadcast to a receiving terminal in the local area network via a wireless router .
步骤S102：所述发送终端将捕获的多媒体信息处理成流媒体；Step S102: The transmitting terminal processes the captured multimedia information into a streaming media.
步骤S103：所述发送终端把所述流媒体广播给所述接收终端，使所述接收终端在收到所述流媒体后，在所述接收终端播放所述流媒体中的多媒体信息。Step S103: The transmitting terminal broadcasts the streaming media to the receiving terminal, so that the receiving terminal plays the multimedia information in the streaming media at the receiving terminal after receiving the streaming media.
其中，所述的发送终端将捕获的多媒体信息处理成流媒体包括：在所捕获的多媒体信息上添加语音时间戳信息和图片时间戳信息；对所述添加的语音时间戳信息和图片时间戳信息按照1：N的比例，将所捕获的多媒体信息处理成流媒体；其中所述N是指正整数。The processing, by the sending terminal, the captured multimedia information into the streaming media, includes: adding a voice timestamp information and a picture timestamp information to the captured multimedia information; and adding the added voice timestamp information and the image timestamp information The captured multimedia information is processed into a streaming medium in a ratio of 1:N; wherein the N is a positive integer.
图2显示了本发明实施例提供的另一种实现终端多媒体广播的方法流程图，如图2所示，包括以下步骤：FIG. 2 is a flowchart of another method for implementing multimedia broadcasting of a terminal according to an embodiment of the present invention. As shown in FIG. 2, the method includes the following steps:
步骤S201：建立包括发送终端和接收终端的对等无线局域网；Step S201: Establish a peer-to-peer wireless local area network including the sending terminal and the receiving terminal;
步骤S202：所述接收终端接收所述发送终端广播的流媒体；Step S202: The receiving terminal receives the streaming media broadcast by the sending terminal.
步骤S203：所述接收终端接收所述流媒体后，播放所述流媒体中的语音和图片等多媒体信息。Step S203: After receiving the streaming media, the receiving terminal plays multimedia information such as voice and picture in the streaming media.
在所述接收终端接收所述流媒体后，还包括：对所接收到的流媒体进行解析，得到所述流媒体中的多媒体信息；根据所得到的多媒体信息，判 断所述多媒体信息中的语音信息和图片信息是否丢包；若判断结果为语音信息丢包，则以同样时间长度的无声音的空包，即：不包括语音信息的空包进行填充；若判断结果为图片信息丢包，则复制前一张图片信息进行补偿。After the receiving terminal receives the streaming media, the method further includes: parsing the received streaming media to obtain multimedia information in the streaming media; and determining, according to the obtained multimedia information, And whether the voice information and the picture information in the multimedia information are lost; if the result of the judgment is that the voice information is lost, the voiceless empty packet of the same length of time, that is, an empty packet not including the voice information is filled; If the result of the judgment is that the picture information is lost, the previous picture information is copied for compensation.
图3显示了本发明实施例提供的一种实现终端多媒体广播的装置示意图，如图3所示，包括：FIG. 3 is a schematic diagram of an apparatus for implementing multimedia broadcasting of a terminal according to an embodiment of the present invention. As shown in FIG. 3, the method includes:
建立模块301，配置为建立包括发送终端和接收终端的对等无线局域网；The establishing module 301 is configured to establish a peer-to-peer wireless local area network including the sending terminal and the receiving terminal;
处理模块302，配置为所述发送终端将捕获的多媒体信息处理成流媒体；The processing module 302 is configured to process, by the sending terminal, the captured multimedia information into a streaming media;
广播模块303，配置为所述发送终端把所述流媒体广播给所述接收终端，所述流媒体用于所述接收终端收到后，播放所述流媒体中的多媒体信息。The broadcast module 303 is configured to broadcast, by the sending terminal, the streaming media to the receiving terminal, where the streaming media is used by the receiving terminal to play the multimedia information in the streaming media.
其中，所述的处理模块302包括：The processing module 302 includes:
添加时间戳单元，配置为在所捕获的多媒体信息上添加语音时间戳信息和图片时间戳信息；Adding a timestamp unit, configured to add voice timestamp information and picture timestamp information to the captured multimedia information;
处理单元，配置为对所述添加的语音时间戳信息和图片时间戳信息按照1：N的比例，将所捕获的多媒体信息处理成流媒体；其中所述N是指正整数。The processing unit is configured to process the captured multimedia information into a streaming media according to a ratio of 1:N to the added voice timestamp information and the picture timestamp information; wherein the N is a positive integer.
其中，所述建立对等无线局域网包括：通过无线路由器将所述发送终端和所述接收终端连接到对等无线局域网中，使所述发送终端的流媒体经由无线路由器广播到所述局域网中的接收终端。The establishing a peer-to-peer wireless local area network includes: connecting the sending terminal and the receiving terminal to a peer-to-peer wireless local area network by using a wireless router, and causing the streaming media of the sending terminal to be broadcasted to the local area network via a wireless router. Receiving terminal.
图4显示了本发明实施例提供的另一种实现终端多媒体广播的装置示意图，如图4所示，包括：FIG. 4 is a schematic diagram of another apparatus for implementing multimedia broadcasting of a terminal according to an embodiment of the present invention. As shown in FIG. 4, the method includes:
建立模块401，配置为建立包括发送终端和接收终端的对等无线局域 网；The establishing module 401 is configured to establish a peer-to-peer wireless local area including the transmitting terminal and the receiving terminal network;
接收模块402，配置为所述接收终端接收所述发送终端广播的流媒体；The receiving module 402 is configured to receive, by the receiving terminal, the streaming media broadcast by the sending terminal;
播放模块403，配置为所述接收终端接收所述流媒体后，播放所述流媒体中的多媒体信息。The playing module 403 is configured to play the multimedia information in the streaming media after the receiving terminal receives the streaming media.
其中所述播放模块403包括：The play module 403 includes:
解析子单元，配置为对所接收到的流媒体进行解析，得到所述流媒体中的多媒体信息；The parsing subunit is configured to parse the received streaming media to obtain multimedia information in the streaming media;
判断子单元，配置为根据所得到的多媒体信息，判断所述多媒体信息中的语音信息和图片信息是否丢包；The determining subunit is configured to determine, according to the obtained multimedia information, whether the voice information and the picture information in the multimedia information are lost;
填充子单元，配置为若判断结果为语音信息丢包，则以同样时间长度的无声音空包进行填充；Filling the subunit, configured to fill the voice packet with the same length of time if the result of the judgment is that the voice information is lost;
补偿子单元，配置为若判断结果为图片信息丢包，则复制前一张图片信息进行补偿。The compensation subunit is configured to copy the previous picture information to compensate if the result of the determination is that the picture information is lost.
本发明实施例为了能够让局域网中的每个终端都具有UDP(User Datagram Protocol，用户数据报协议)广播和UDP接收功能，需要构建对等的局域网节点，而不管终端是否是作为Wi-Fi热点使用，都必须要保证局域网中的每个智能终端都具有UDP广播或者多播功能，具体构建的对等网络方式如图5和图6所示。In order to enable each terminal in the local area network to have a UDP (User Datagram Protocol) broadcast and UDP receiving function, the embodiment of the present invention needs to construct a peer-to-peer LAN node regardless of whether the terminal is a Wi-Fi hotspot. To use, it is necessary to ensure that each intelligent terminal in the local area network has UDP broadcast or multicast function, and the specific peer-to-peer network mode is shown in FIG. 5 and FIG. 6.
图5显示了本发明实施例提供的终端的第一拓扑结构示意图，如图5所示，Wi-Fi热点是专用无线猫，其他终端连接到该局域网，所有终端的UDP广播或者多播都会通过Wi-Fi无线路由器广播到局域网的每个终端，从而构成所有终端是对等的局域网。FIG. 5 is a schematic diagram showing a first topology of a terminal according to an embodiment of the present invention. As shown in FIG. 5, a Wi-Fi hotspot is a dedicated wireless cat, and other terminals are connected to the local area network, and UDP broadcast or multicast of all terminals passes. The Wi-Fi wireless router broadcasts to each terminal of the local area network, thereby constituting a local area network in which all terminals are peers.
图6显示了本发明实施例提供的终端的第二拓扑结构示意图，如图6所示，当Wi-Fi热点是移动终端，其他移动终端连接该局域网，由于Wi-Fi热点移动终端作为路由器使用，与其他局域网终端相比不是对等的，因为 只用一个方式无法让UDP广播或者多播在每个终端上实现。必须对作为热点的终端和非热点终端分别作处理。由于终端作为热点时，有很多参数需要设置，所以建立UDP广播或者多播通讯的时候，需要把热点参数考虑进去，才能实现UDP广播或者多播，非热点终端按常规处理就行。如此处理之后，就能实现该拓扑结构的所有终端是对等的。FIG. 6 is a schematic diagram showing a second topology structure of a terminal according to an embodiment of the present invention. As shown in FIG. 6, when a Wi-Fi hotspot is a mobile terminal, other mobile terminals are connected to the local area network, and the Wi-Fi hotspot mobile terminal is used as a router. , is not equivalent to other LAN terminals, because UDP broadcast or multicast cannot be implemented on each terminal in one way. Terminals that are hotspots and non-hotspot terminals must be treated separately. When the terminal is used as a hotspot, there are many parameters to be set. Therefore, when establishing UDP broadcast or multicast communication, the hotspot parameters need to be taken into consideration to realize UDP broadcast or multicast, and non-hotspot terminals can be processed as usual. After doing so, all terminals that implement the topology are peer-to-peer.
图7显示了本发明实施例提供的发送终端的结构示意图，如图7所示，包括语音和视频捕捉模块701、数据预处理模块702以及数据发送模块703；其中，FIG. 7 is a schematic structural diagram of a transmitting terminal according to an embodiment of the present invention. As shown in FIG. 7, the method includes a voice and video capturing module 701, a data pre-processing module 702, and a data sending module 703.
所述语音和视频捕捉模块701，配置为利用智能终端捕捉音频流和视频流需要的帧图片，也就是说，配置为捕捉语音和屏幕图片信息。具体地说，所述语音和视频捕捉模块701包括：屏幕图片捕捉子模块和语音捕捉子模块；其中，The voice and video capture module 701 is configured to capture a frame picture required by the audio stream and the video stream by using the smart terminal, that is, configured to capture voice and screen picture information. Specifically, the voice and video capture module 701 includes: a screen picture capture sub-module and a voice capture sub-module;
所述屏幕图片捕捉子模块，配置为每隔一小段时间采集所述终端上的屏幕图片，并保存在视频缓冲区，并增加时间戳信息，作为后续视频帧数据源；The screen picture capturing sub-module is configured to collect a screen image on the terminal every short period of time, save it in a video buffer, and add timestamp information as a data source of a subsequent video frame;
所述语音捕捉子模块，配置为在一段时间连续捕捉所述终端接收到的语音信息，并保存到语音缓冲区，该连续时间的开始时间戳和结束时间戳需要跟屏幕图片采集时间戳匹配，即要求时序对齐。The voice capture sub-module is configured to continuously capture the voice information received by the terminal for a period of time and save the voice information to the voice buffer, and the start time stamp and the end time stamp of the continuous time need to match the screen image collection time stamp. That is, timing alignment is required.
所述数据预处理模块702，配置为连续捕捉屏幕图片和语音的视频化合成处理，即把屏幕图片信息和语音信息按一定比例存储于发送缓冲区中。也就是说，把连续的帧图片合成视频流，然后根据时序对齐，加入音频流，合成完整的流媒体，作为流媒体服务器的数据源，或者简单把音频流和视频流混合在一起传输，就是按顺序把数据放入UDP通讯发送缓冲区中，如图9所示。The data pre-processing module 702 is configured to continuously capture video synthesis processing of the screen picture and the voice, that is, store the screen picture information and the voice information in a transmission buffer in a certain proportion. That is to say, the continuous frame picture is synthesized into a video stream, and then according to the timing alignment, the audio stream is added, the complete stream media is synthesized, and the data source of the streaming media server is simply mixed, and the audio stream and the video stream are simply mixed and transmitted. Put the data into the UDP communication send buffer in order, as shown in Figure 9.
所述数据发送模块703，配置为在对等网络基础上，依次从缓冲区取出 数据通过UDP Client端进行广播或者多播，使局域网中的每个终端都可以收到该数据。也就是说，从发送缓冲区中取出数据，在局域网进行UDP广播或者多播。由于UDP广播没有重传机制，也就不会有缓冲区拥塞行为，即发送缓冲区写入数据量大于发送数据量，导致缓冲区溢出现象。The data sending module 703 is configured to sequentially take out the buffer on the basis of the peer-to-peer network. The data is broadcast or multicast through the UDP client, so that each terminal in the LAN can receive the data. That is to say, the data is taken out from the transmission buffer, and UDP broadcast or multicast is performed on the local area network. Since there is no retransmission mechanism in UDP broadcast, there is no buffer congestion behavior, that is, the amount of data written in the transmit buffer is larger than the amount of transmitted data, resulting in buffer overflow.
图8显示了本发明实施例提供的接收终端的结构示意图，如图8所示，包括数据接收模块801、数据解析模块802以及数据播放模块803；其中，FIG. 8 is a schematic structural diagram of a receiving terminal according to an embodiment of the present invention. As shown in FIG. 8, the data receiving module 801, the data analyzing module 802, and the data playing module 803 are included.
所述数据接收模块801，配置为通过UDP Server接收UDP广播或多播数据，并把数据存入接收缓冲区；也就是说，把UDP广播接收到的数据存在接收缓冲区，并区分图片包和语音包，检查图片包和语音包的比例关系，进行补偿或者填充处理。The data receiving module 801 is configured to receive UDP broadcast or multicast data through the UDP server, and store the data in the receiving buffer; that is, the data received by the UDP broadcast exists in the receiving buffer, and distinguishes the picture packet and Voice packets, check the proportional relationship between picture packets and voice packets, and compensate or fill them.
所述数据解析模块802，配置为按照已知固定比例把数据解析成语音流和视频流。由于是UDP通讯，可能会造成某个数据包丢失，需要进行一定的处理。由于发送端是N个图片包和1个语音包按比例进行发送，所以一旦发现接收比例不是N:1，可能进行补偿或者空包填充处理。如果是图片丢包，可以复制之前收到的最近的一张图片进行补偿处理，该处理对用户体验影响不大。如果是语音丢包，则不适合进行补偿处理，就将一个具有同样时间长度、且没有声音的空包进行填充，保证图片和语音数据流时序对齐，最后按照N：1比例把数据分成语音流和视频流。The data parsing module 802 is configured to parse the data into a voice stream and a video stream according to a known fixed ratio. Because it is UDP communication, it may cause a certain packet to be lost and needs some processing. Since the transmitting end is N picture packets and one voice packet are transmitted in proportion, once the receiving ratio is found to be not N:1, compensation or empty packet filling processing may be performed. If the picture is lost, you can copy the most recent picture received before compensation processing, which has little effect on the user experience. If it is a voice packet loss, it is not suitable for compensation processing, and an empty packet with the same length of time and no sound is filled to ensure the timing alignment of the picture and the voice data stream, and finally the data is divided into voice streams according to the N:1 ratio. And video streaming.
所述数据播放模块803，配置为显示接收到的音视频数据，即把解析出来的音频流和视频流进行单独播放。The data playing module 803 is configured to display the received audio and video data, that is, separately play the parsed audio stream and the video stream.
此外，本发明实施例还包括参数配置模块，配置为捕捉操作和数据传输操作的参数配置，以及模块流程控制。也就是说，根据不同的应用场景和网络拓扑结构，确定需要传输的数据，是单独的语音流，还是单独的视频流，或者合成的音视频流；以及捕捉语音，视频帧图片的参数配置。In addition, embodiments of the present invention further include a parameter configuration module configured to capture parameter configurations of operation and data transfer operations, and module flow control. That is to say, according to different application scenarios and network topology structures, it is determined whether the data to be transmitted is a separate voice stream, a separate video stream, or a synthesized audio and video stream; and parameter configuration for capturing voice and video frame pictures.
图10显示了本发明实施例提供的音视频数据传输包示意图，如图10 所示，发送端的图片包和语音包比例是N:1，即在一个FIFO里边，每N个图片包之后有一个语音包。接收端的图片包和语音包也应该是N:1，如何在丢包的情况下，保持N:1比例上文已描述。FIG. 10 is a schematic diagram of an audio and video data transmission package provided by an embodiment of the present invention, as shown in FIG. 10 As shown, the ratio of picture packets and voice packets on the sender side is N:1, that is, in a FIFO, there is one voice packet after every N picture packets. The picture packet and voice packet at the receiving end should also be N:1. How to maintain the N:1 ratio in the case of packet loss has been described above.
从以上的描述中，可以看出，在本发明实施例中，根据实际情况，把需要的语音信息和连续图片按照时序对齐方式先保存到FIFO(First Input First Output，先入先出队列)，通过UDP广播或多播使之在局域网中共享给局域网中每个终端用户。改变投影仪的共享模式，对共享用户没有严格的地理位置要求，极大的提高语音和视频共享用户体验。From the above description, it can be seen that, in the embodiment of the present invention, according to the actual situation, the required voice information and the continuous picture are first saved to the FIFO (First Input First Output) according to the timing alignment manner, and UDP broadcast or multicast is shared in the local area network to each end user in the local area network. Changing the sharing mode of the projector does not have strict geographic location requirements for shared users, greatly improving the user experience of voice and video sharing.
综上所述，本发明实施例具有以下技术效果：In summary, the embodiments of the present invention have the following technical effects:
本发明采用Wi-Fi局域网无线通讯系统，既能实现语音和视频的实时通讯，又没有任何的移动网络通讯费用，提高了用户体验。The invention adopts the Wi-Fi local area network wireless communication system, can realize real-time communication of voice and video, and does not have any mobile network communication cost, thereby improving the user experience.
本领域内的技术人员应明白，本发明的实施例可提供为方法、系统、或计算机程序产品。因此，本发明可采用硬件实施例、软件实施例、或结合软件和硬件方面的实施例的形式。而且，本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器和光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention can take the form of a hardware embodiment, a software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生配置为实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. The computer program instructions can be provided to a processor of a general purpose computer, a special purpose computer, an embedded processor, or other programmable data processing device to produce a machine such that the instructions are executed by a processor or other programmable data processing device. Means for implementing the functions specified in a block or blocks of a flow or a flow and/or a block diagram of a flow chart.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理 设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions can also be stored in a bootable computer or other programmable data processing The apparatus is readable in a computer readable memory in a particular manner such that instructions stored in the computer readable memory produce an article of manufacture comprising instruction means implemented in one or more flows and/or block diagrams of the flowchart The function specified in the box or in multiple boxes.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供配置为实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps that are configured to implement the functions specified in one or more blocks of the flowchart or in a block or blocks of the flowchart.
以上所述，仅为本发明的较佳实施例而已，并非配置为限定本发明的保护范围。 The above is only the preferred embodiment of the present invention and is not intended to limit the scope of the present invention.

Claims (10)

  1. 一种实现终端多媒体广播的方法，该方法包括以下步骤：A method for implementing terminal multimedia broadcasting, the method comprising the following steps:
    建立包括发送终端和接收终端的对等无线局域网；Establishing a peer-to-peer wireless local area network including a transmitting terminal and a receiving terminal;
    所述发送终端将捕获的多媒体信息处理成流媒体；The transmitting terminal processes the captured multimedia information into a streaming media;
    所述发送终端把所述流媒体广播给所述接收终端，所述流媒体用于所述接收终端收到后，播放所述流媒体中的多媒体信息。The transmitting terminal broadcasts the streaming media to the receiving terminal, and the streaming media is used to play the multimedia information in the streaming media after being received by the receiving terminal.
  2. 根据权利要求1所述的方法，其中，所述的发送终端将捕获的多媒体信息处理成流媒体，包括：The method of claim 1, wherein the transmitting terminal processes the captured multimedia information into streaming media, including:
    在所捕获的多媒体信息上添加语音时间戳信息和图片时间戳信息；Adding voice timestamp information and picture timestamp information to the captured multimedia information;
    对所述添加的语音时间戳信息和图片时间戳信息按照1：N的比例，将所捕获的多媒体信息处理成流媒体；And the captured multimedia time information and the picture time stamp information are processed into a streaming media according to a ratio of 1:N;
    其中，所述N是指正整数。Wherein N is a positive integer.
  3. 根据权利要求1所述的方法，其中，所述建立对等无线局域网，包括：The method of claim 1 wherein said establishing a peer to peer wireless local area network comprises:
    通过无线路由器将所述发送终端和所述接收终端连接到对等无线局域网中，使所述发送终端的流媒体经由无线路由器广播到所述局域网中的接收终端。The transmitting terminal and the receiving terminal are connected to a peer-to-peer wireless local area network by a wireless router, and the streaming media of the transmitting terminal is broadcasted to a receiving terminal in the local area network via a wireless router.
  4. 一种实现终端多媒体广播的方法，该方法包括以下步骤：A method for implementing terminal multimedia broadcasting, the method comprising the following steps:
    建立包括发送终端和接收终端的对等无线局域网；Establishing a peer-to-peer wireless local area network including a transmitting terminal and a receiving terminal;
    所述接收终端接收所述发送终端广播的流媒体；Receiving, by the receiving terminal, the streaming media broadcast by the sending terminal;
    所述接收终端接收所述流媒体后，播放所述流媒体中的多媒体信息。After receiving the streaming media, the receiving terminal plays the multimedia information in the streaming media.
  5. 根据权利要求4所述的方法，其中，在所述接收终端接收所述流媒体后，该方法还包括：The method of claim 4, wherein after the receiving terminal receives the streaming media, the method further comprises:
    对所接收到的流媒体进行解析，得到所述流媒体中的多媒体信息；Parsing the received streaming media to obtain multimedia information in the streaming media;
    根据所得到的多媒体信息，判断所述多媒体信息中的语音信息和图片 信息是否丢包；Determining voice information and pictures in the multimedia information according to the obtained multimedia information Whether the information is lost;
    若判断结果为语音信息丢包，则以同样时间长度的无声音的空包进行填充；If the result of the judgment is that the voice information is lost, the voice is filled with a voiceless empty packet of the same length of time;
    若判断结果为图片信息丢包，则复制前一张图片的信息进行补偿。If the result of the judgment is that the picture information is lost, the information of the previous picture is copied to compensate.
  6. 一种实现终端多媒体广播的装置，该装置包括：An apparatus for implementing terminal multimedia broadcasting, the apparatus comprising:
    建立模块，配置为建立包括发送终端和接收终端的对等无线局域网；Establishing a module configured to establish a peer-to-peer wireless local area network including the transmitting terminal and the receiving terminal;
    处理模块，配置为所述发送终端将捕获的多媒体信息处理成流媒体；a processing module, configured to process, by the sending terminal, the captured multimedia information into a streaming media;
    广播模块，配置为所述发送终端把所述流媒体广播给所述接收终端，所述流媒体用于所述接收终端收到后，播放所述流媒体中的多媒体信息。The broadcast module is configured to broadcast, by the sending terminal, the streaming media to the receiving terminal, where the streaming media is used by the receiving terminal to play the multimedia information in the streaming media.
  7. 根据权利要求6所述的装置，其中，所述的处理模块还包括：The device of claim 6, wherein the processing module further comprises:
    添加时间戳单元，配置为在所捕获的多媒体信息上添加语音时间戳信息和图片时间戳信息；Adding a timestamp unit, configured to add voice timestamp information and picture timestamp information to the captured multimedia information;
    处理单元，配置为对所述添加的语音时间戳信息和图片时间戳信息按照1：N的比例，将所捕获的多媒体信息处理成流媒体；The processing unit is configured to process the captured multimedia information into a streaming media according to a ratio of 1:N to the added voice timestamp information and the picture timestamp information;
    其中，所述N是指正整数。Wherein N is a positive integer.
  8. 根据权利要求6所述的装置，其中，所述建立模块建立所述对等无线局域网，包括：The apparatus of claim 6, wherein the establishing module establishes the peer to peer wireless local area network, comprising:
    通过无线路由器将所述发送终端和所述接收终端连接到对等无线局域网中，使所述发送终端的流媒体经由无线路由器广播到所述局域网中的接收终端。The transmitting terminal and the receiving terminal are connected to a peer-to-peer wireless local area network by a wireless router, and the streaming media of the transmitting terminal is broadcasted to a receiving terminal in the local area network via a wireless router.
  9. 一种实现终端多媒体广播的装置，该装置包括：An apparatus for implementing terminal multimedia broadcasting, the apparatus comprising:
    建立模块，配置为建立包括发送终端和接收终端的对等无线局域网；Establishing a module configured to establish a peer-to-peer wireless local area network including the transmitting terminal and the receiving terminal;
    接收模块，配置为所述接收终端接收所述发送终端广播的流媒体；a receiving module, configured to receive, by the receiving terminal, a streaming media broadcast by the sending terminal;
    播放模块，配置为所述接收终端接收所述流媒体后，播放所述流媒体中的多媒体信息。 The playing module is configured to play the multimedia information in the streaming media after the receiving terminal receives the streaming media.
  10. 根据权利要求9所述的装置，其中，所述的播放模块还包括：The device of claim 9, wherein the playing module further comprises:
    解析子单元，配置为对所接收到的流媒体进行解析，得到所述流媒体中的多媒体信息；The parsing subunit is configured to parse the received streaming media to obtain multimedia information in the streaming media;
    判断子单元，配置为根据所得到的多媒体信息，判断所述多媒体信息中的语音信息和图片信息是否丢包；The determining subunit is configured to determine, according to the obtained multimedia information, whether the voice information and the picture information in the multimedia information are lost;
    填充子单元，配置为若判断结果为语音信息丢包，则以同样时间长度的无声音的空包进行填充；Filling the subunit, configured to fill the voice packet with the same length of time if the result of the judgment is that the voice information is lost;
    补偿子单元，配置为若判断结果为图片信息丢包，则复制前一张图片的信息进行补偿。 The compensation subunit is configured to compensate the information of the previous picture if the result of the judgment is that the picture information is lost.
PCT/CN2014/088659 2014-08-22 2014-10-15 Method and device for realizing multimedia broadcasting of terminal WO2015117355A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410419099.9 2014-08-22
CN201410419099.9A CN105357590A (en) 2014-08-22 2014-08-22 Method and device for achieving terminal multimedia broadcast

Publications (1)

Publication Number Publication Date
WO2015117355A1 true WO2015117355A1 (en) 2015-08-13

Family

ID=53777180

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/088659 WO2015117355A1 (en) 2014-08-22 2014-10-15 Method and device for realizing multimedia broadcasting of terminal

Country Status (2)

Country Link
CN (1) CN105357590A (en)
WO (1) WO2015117355A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110049531A (en) * 2019-04-22 2019-07-23 Oppo广东移动通信有限公司 Network resources locating method and relevant apparatus

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107659835A (en) * 2016-07-25 2018-02-02 中兴通讯股份有限公司 Screen sharing method, equipment and system
CN109905654B (en) * 2017-12-11 2021-03-02 日立楼宇技术（广州）有限公司 Method, device and equipment for acquiring elevator car video and storage medium
CN111526374B (en) * 2019-02-01 2022-05-10 广州虎牙信息科技有限公司 Live broadcast-based bullet screen processing method, stream pulling method and device
CN110324643B (en) * 2019-04-24 2021-02-02 网宿科技股份有限公司 Video recording method and system
KR20220123670A (en) * 2020-01-02 2022-09-08 가브리엘 라비 Method and system for supporting communication of a plurality of client communication devices in a wireless local area network
CN113014544B (en) * 2021-01-25 2023-02-10 阳光凯讯(北京)科技有限公司 Method and device for establishing centerless media link based on webRtc

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101867574A (en) * 2010-05-19 2010-10-20 中兴通讯股份有限公司 Method and system for realizing video sharing, and mobile terminal
WO2012159333A1 (en) * 2011-05-20 2012-11-29 中兴通讯股份有限公司 Method and system for implementing video conference and broadband mobile hotspot device
CN103209248A (en) * 2012-01-11 2013-07-17 三星电子（中国）研发中心 Mobile phone terminal and method for sharing multi-media content
CN103561281A (en) * 2013-10-25 2014-02-05 Tcl集团股份有限公司 Multimedia data sharing method and device
CN103826208A (en) * 2014-01-22 2014-05-28 深圳市同洲电子股份有限公司 Wireless interaction method, terminal and system

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8134931B2 (en) * 2007-07-10 2012-03-13 Qualcomm Incorporated Apparatus and method of generating and maintaining orthogonal connection identifications (CIDs) for wireless networks
US8041375B2 (en) * 2007-10-31 2011-10-18 Qualcomm Incorporated Methods and apparatus for use in peer to peer communications devices and/or systems relating to rate scheduling, traffic scheduling, rate control, and/or power control
CN101741715B (en) * 2008-11-20 2013-03-20 华为技术有限公司 Method for sending message, access routing node device and data cache system
CN101594594B (en) * 2009-06-30 2013-02-27 中兴通讯股份有限公司 Local area network system for realizing streaming media switch among peer-to-peer devices and realization method thereof
US9949305B2 (en) * 2009-10-02 2018-04-17 Blackberry Limited Methods and apparatus for peer-to-peer communications in a wireless local area network
US8891939B2 (en) * 2009-12-22 2014-11-18 Citrix Systems, Inc. Systems and methods for video-aware screen capture and compression
CN101964842A (en) * 2010-09-13 2011-02-02 复旦大学 Mobile phone terminal-based self-organized video synchronous sharing player
KR101719165B1 (en) * 2010-10-27 2017-03-23 삼성전자주식회사 METHOD AND APPARATUS FOR A TRANSMISSION/RECEPTION OF A WLAN NETWORK SHARING DATA IN A Wi-Fi P2P GROUP
KR101763171B1 (en) * 2011-06-13 2017-08-14 삼성전자주식회사 Apparatus and method for connecting peer to peer between a mobile terminal
US9021121B2 (en) * 2011-06-17 2015-04-28 Lenovo (Singapore) Pte. Ltd. Setting a rate of data transmission in a peer-to-peer mode
CN102291388A (en) * 2011-07-12 2011-12-21 宋健 Method for sharing contents and applications of computer with television based on home network
CN102638774A (en) * 2012-03-31 2012-08-15 王方淇 Method and system for synchronously sharing mobile terminal data
KR20140003960A (en) * 2012-07-02 2014-01-10 삼성전자주식회사 File sharing method of peer to peer system and apparatus thereof
CN102932745A (en) * 2012-09-07 2013-02-13 佳都新太科技股份有限公司 Personal multimedia broadcasting system based on mobile WIFI (Wireless Fidelity) hotspot
US9756115B2 (en) * 2012-11-08 2017-09-05 Gpvtl Canada Inc. System and method of secure file sharing using P2P
CN103841450A (en) * 2012-11-20 2014-06-04 株式会社Ntt都科摩 Wireless internet device, multimedia broadcast access device and method
CN103248964B (en) * 2013-04-07 2016-04-06 同济大学 Based on the Vehicular video transmission system of RTP/RTCP
CN103297522A (en) * 2013-05-31 2013-09-11 东蓝数码股份有限公司 Method for resource sharing by peer-to-peer technology based on wireless local area network
CN103517033B (en) * 2013-09-16 2017-02-22 天脉聚源(北京)传媒科技有限公司 Video conference processing method and mobile terminals
CN103491153A (en) * 2013-09-17 2014-01-01 天脉聚源(北京)传媒科技有限公司 Method, equipment and peer-to-peer network system for data sharing

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101867574A (en) * 2010-05-19 2010-10-20 中兴通讯股份有限公司 Method and system for realizing video sharing, and mobile terminal
WO2012159333A1 (en) * 2011-05-20 2012-11-29 中兴通讯股份有限公司 Method and system for implementing video conference and broadband mobile hotspot device
CN103209248A (en) * 2012-01-11 2013-07-17 三星电子（中国）研发中心 Mobile phone terminal and method for sharing multi-media content
CN103561281A (en) * 2013-10-25 2014-02-05 Tcl集团股份有限公司 Multimedia data sharing method and device
CN103826208A (en) * 2014-01-22 2014-05-28 深圳市同洲电子股份有限公司 Wireless interaction method, terminal and system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110049531A (en) * 2019-04-22 2019-07-23 Oppo广东移动通信有限公司 Network resources locating method and relevant apparatus
CN110049531B (en) * 2019-04-22 2021-05-04 Oppo广东移动通信有限公司 Network resource sharing method and related device

Also Published As

Publication number Publication date
CN105357590A (en) 2016-02-24

Similar Documents

Publication Publication Date Title
WO2015117355A1 (en) Method and device for realizing multimedia broadcasting of terminal
WO2020192152A1 (en) Video transmission method, root node, child node, p2p server, and system
US20190089760A1 (en) Systems and methods for real-time content creation and sharing in a decentralized network
US8988486B2 (en) Adaptive video communication channel
CN102075728B (en) The method and system of a kind of shared audio frequency and/or video
WO2020259448A1 (en) Data processing method and apparatus, computer-readable storage medium, and electronic device
CN105610824B (en) A kind of screen sharing method based on screen mirror image and RTSP Streaming Media frame
KR20160067126A (en) Method and apparatus for content delivery
CN105491393A (en) Method for implementing multi-user live video business
CN107819809B (en) Method and device for synchronizing content
CN105392020A (en) Internet video direct broadcasting method and system
WO2020006912A1 (en) Method and device for analyzing network transmission quality, computer equipment and storage medium
CN103797810A (en) Synchronized wireless display devices
CN105072506B (en) The transmission method and system of live teaching broadcast video
EP2827596A1 (en) Transmitting and receiving method of multimedia video data and corresponding device
CN108616334A (en) Message transmitting method and device, system, storage medium, electronic device
CN103248964A (en) Vehicle-mounted video transmission system based on Real Time Protocol (RTP)/RTCP (Real-time Transport Control Protocol)
KR20120035881A (en) Method of scalable http streaming in representation switching of http streaming
JP2015529044A (en) Method and apparatus for distributing transfer characteristic information of multimedia data
CN101242513A (en) Dual-stream transmission method in video conference and video conference system
CN112616065A (en) Screen image initiating method and device, computer equipment, readable storage medium and screen image presenting system
CN110943977A (en) Multimedia service data transmission method, server, equipment and storage medium
Abdullah et al. Survey of transportation of adaptive multimedia streaming service in internet
KR102138075B1 (en) Method and apparatus for transceiving data packet for multimedia data in variable size
JP4544029B2 (en) Portable terminal, streaming communication system, streaming communication method, and streaming communication program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14881751

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14881751

Country of ref document: EP

Kind code of ref document: A1