CN108063745B - A kind of video call method and its system based on Android device - Google Patents

A kind of video call method and its system based on Android device Download PDF

Info

Publication number
CN108063745B
CN108063745B CN201610983683.6A CN201610983683A CN108063745B CN 108063745 B CN108063745 B CN 108063745B CN 201610983683 A CN201610983683 A CN 201610983683A CN 108063745 B CN108063745 B CN 108063745B
Authority
CN
China
Prior art keywords
server
data packet
video
android device
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610983683.6A
Other languages
Chinese (zh)
Other versions
CN108063745A (en
Inventor
杨乌拉
张美聪
杨春晖
王艳辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hainan Qiantang Shilian Information Technology Co.,Ltd.
Original Assignee
Visionvera Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Visionvera Information Technology Co Ltd filed Critical Visionvera Information Technology Co Ltd
Priority to CN201610983683.6A priority Critical patent/CN108063745B/en
Publication of CN108063745A publication Critical patent/CN108063745A/en
Application granted granted Critical
Publication of CN108063745B publication Critical patent/CN108063745B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets

Abstract

The embodiment of the invention provides a kind of video call method and its system based on Android device, this method comprises: acquisition video source data and audio source data;Video source data and audio source data are encoded, the first video frame and the first audio frame are respectively formed;First video frame and the first audio frame are converted into the first data packet;First data packet is sent to view networked server by multimedia server;The second data packet that view networked server is sent is received by multimedia server;The second data packet is parsed, the second video frame and the second audio frame are generated;Second video frame and the second audio frame are decoded;The second video frame and the second audio frame after broadcast decoder.Android device in the embodiment of the present invention is carried out data transmission by multimedia server with depending on networked server, and the limitation in video calling place is got rid of, and user's operation is more convenient;And coding compression is carried out to the data of transmission in data transmission procedure, data transmission bauds is fast.

Description

A kind of video call method and its system based on Android device
Technical field
The present invention relates to view networking technology fields, more particularly to a kind of video call method based on Android device and one Video call system of the kind based on Android device.
Background technique
With the fast development of the network technology, depending on working application (e.g., video conference, video teaching etc.) in the life of user Living, work, study etc. are widely available.In the application of view networking, due to regarding the limitation of networking protocol, view connection is generallyd use Network termination carries out video conference or video teaching.Conventional view networked terminals present position is typically all fixation, and user can only Video conference or video teaching etc. are carried out in fixed place, user experience effect is poor.
Summary of the invention
In view of the above problems, it proposes the embodiment of the present invention and overcomes the above problem or at least partly in order to provide one kind A kind of video call method based on Android device and a kind of corresponding video based on Android device to solve the above problems is logical Telephone system.
To solve the above-mentioned problems, the embodiment of the invention discloses a kind of video call method based on Android device, institutes Method is stated to be applied in view networking, which comprises
Acquire video source data and audio source data;
The video source data and audio source data are encoded, the first video frame and the first audio frame are respectively formed;
First video frame and first audio frame are converted into the first data packet;
First data packet is sent to view networked server by multimedia server.
Preferably, a kind of video call method based on Android device further include:
The second data packet that the view networked server is sent is received by the multimedia server;
Second data packet is parsed, the second video frame and the second audio frame are generated;
Second video frame and second audio frame are decoded;
Second video frame and second audio frame after broadcast decoder.
Preferably, described the step of first data packet is sent to view networked server by multimedia server, Include:
First data packet is sent to the multimedia server by ICP/IP protocol;
The multimedia server is networked by the way that received first data packet is sent to the view depending on networking protocol Server.
Preferably, described that second data packet for regarding networked server transmission is received by the multimedia server Step, comprising:
The multimedia server is by receiving second data that the view networked server is sent depending on networking protocol Packet;
Second data packet that the multimedia server is sent is received by ICP/IP protocol.
Preferably, described that the video source data and audio source data are encoded, be respectively formed the first video frame and The step of first audio frame, comprising:
The video source data is encoded by H263 coding method or H264 coding method, forms the first video Frame;
The audio source data is encoded, the first audio frame of AAC format is formed;The audio-source data format is PCM format.
Preferably, it is described by first data packet by multimedia server be sent to view networked server the step of it Afterwards, further includes:
It is described that first data packet that the multimedia server sends over is received depending on networked server;
It is described that first data packet is converted into view networking data depending on networked server;
It is described to play out described be sent to depending on networking data depending on networked terminals depending on networked server.
The present invention also provides a kind of video call system based on Android device, the system is applied in view networking, It include: Android device, multimedia server and view networked server;The Android device connects the multimedia server, institute It states multimedia server and connects the view networked server;
The Android device includes:
Acquisition module, for acquiring video source data and audio source data;
Coding module is respectively formed the first video frame for encoding to the video source data and audio source data With the first audio frame;
Conversion module, for first video frame and first audio frame to be converted to the first data packet;
First sending module, for first data packet to be sent to view networked server by multimedia server.
Preferably, the Android device further include:
First receiving module, for receiving the second number that the view networked server is sent by the multimedia server According to packet;
Parsing module generates the second video frame and the second audio frame for parsing second data packet;
Decoder module, for being decoded to second video frame and second audio frame;
Playing module, for after broadcast decoder second video frame and second audio frame.
Preferably, the Android device connects the multimedia server by ICP/IP protocol;The multimedia service Device connects the view networked server by view networking protocol.
Preferably, the Android device includes mobile phone and tablet computer.
The embodiment of the present invention includes following advantages:
The embodiment of the present invention application view networking characteristic, Android device by multimedia server and view networked server into The transmission of row data, realizes video calling, gets rid of the limitation in video calling place, user's operation is more convenient;And in data Coding compression is carried out to the data of transmission in transmission process, data transmission bauds is fast, even if network signal is not strong or bandwidth stream Measure it is weak in the case where, can also play out glibly.
Detailed description of the invention
Fig. 1 is a kind of networking schematic diagram of view networking of the invention;
Fig. 2 is a kind of hardware structural diagram of node server of the invention;
Fig. 3 is a kind of hardware structural diagram of access switch of the invention;
Fig. 4 is the hardware structural diagram that a kind of Ethernet association of the invention turns gateway;
Fig. 5 is a kind of step flow chart of video call method embodiment one based on Android device of the invention;
Fig. 6 is a kind of step flow chart of video call method embodiment two based on Android device of the invention;
Fig. 7 is a kind of structural block diagram of video call system embodiment one based on Android device of the invention;
Fig. 8 is a kind of structural block diagram of video call system embodiment two based on Android device of the invention.
Specific embodiment
In order to make the foregoing objectives, features and advantages of the present invention clearer and more comprehensible, with reference to the accompanying drawing and specific real Applying mode, the present invention is described in further detail.
It is the important milestone of network Development depending on networking, is a real-time network, can be realized HD video real-time Transmission, Push numerous Internet applications to HD video, high definition is face-to-face.
Real-time high-definition video switching technology is used depending on networking, it can be such as high in a network platform by required service Clear video conference, Intellectualized monitoring analysis, emergency command, digital broadcast television, delay TV, the Web-based instruction, shows video monitoring Field live streaming, VOD program request, TV Mail, individual character records (PVR), Intranet (manages) channel by oneself, intelligent video Broadcast Control, information publication All be incorporated into a system platform etc. services such as tens of kinds of videos, voice, picture, text, communication, data, by TV or Computer realizes that high-definition quality video plays.
Embodiment in order to enable those skilled in the art to better understand the present invention is introduced to depending on networking below:
Depending on networking, applied portion of techniques is as described below:
Network technology (Network Technology)
Traditional ethernet (Ethernet) is improved depending on the network technology innovation networked, with potential huge on network Video flow.(Circuit is exchanged different from simple network packet packet switch (Packet Switching) or lattice network Switching), Streaming demand is met using Packet Switching depending on networking technology.Has grouping depending on networking technology Flexible, the simple and low price of exchange, is provided simultaneously with the quality and safety assurance of circuit switching, it is virtually electric to realize the whole network switch type The seamless connection of road and data format.
Switching technology (Switching Technology)
Two advantages of asynchronous and packet switch that Ethernet is used depending on networking eliminate Ethernet under the premise of complete compatible and lack It falls into, has the end-to-end seamless connection of the whole network, direct user terminal, directly carrying IP data packet.User data is in network-wide basis It is not required to any format conversion.It is the more advanced form of Ethernet depending on networking, is a real-time exchange platform, can be realized at present mutually The whole network large-scale high-definition realtime video transmission that networking cannot achieve pushes numerous network video applications to high Qinghua, unitizes.
Server technology (Server Technology)
It is different from traditional server, its Streaming Media depending on the server technology in networking and unified video platform Transmission be built upon it is connection-oriented on the basis of, data-handling capacity is unrelated with flow, communication time, single network layer energy Enough transmitted comprising signaling and data.For voice and video business, handled depending on networking and unified video platform Streaming Media Complexity many simpler than data processing, efficiency substantially increase hundred times or more than traditional server.
Reservoir technology (Storage Technology)
The ultrahigh speed reservoir technology of unified video platform in order to adapt to the media content of vast capacity and super-flow and Using state-of-the-art real time operating system, the programme information in server instruction is mapped to specific hard drive space, media Content is no longer pass through server, and moment is directly delivered to user terminal, and user waits typical time less than 0.2 second.It optimizes Sector distribution greatly reduces the mechanical movement of hard disc magnetic head tracking, and resource consumption only accounts for the 20% of the internet ad eundem IP, but The concurrent flow greater than 3 times of traditional disk array is generated, overall efficiency promotes 10 times or more.
Network security technology (Network Security Technology)
Depending on the structural design networked by servicing independent licence system, equipment and the modes such as user data is completely isolated every time The network security problem that puzzlement internet has thoroughly been eradicated from structure, does not need antivirus applet, firewall generally, has prevented black The attack of visitor and virus, structural carefree secure network is provided for user.
It services innovative technology (Service Innovation Technology)
Business and transmission are fused together by unified video platform, whether single user, private user or a net The sum total of network is all only primary automatic connection.User terminal, set-top box or PC are attached directly to unified video platform, obtain rich The multimedia video service of rich colorful various forms.Unified video platform is traditional to substitute with table schema using " menu type " Complicated applications programming, considerably less code, which can be used, can be realized complicated application, realize the new business innovation of " endless ".
Networking depending on networking is as described below:
It is a kind of central controlled network structure depending on networking, which can be Tree Network, Star network, ring network etc. class Type, but centralized control node is needed to control whole network in network on this basis.
As shown in Figure 1, being divided into access net and Metropolitan Area Network (MAN) two parts depending on networking.
The equipment of access mesh portions can be mainly divided into 3 classes: node server, access switch, terminal (including various machines Top box, encoding board, memory etc.).Node server is connected with access switch, and access switch can be with multiple terminal phases Even, and it can connect Ethernet.
Wherein, node server is the node that centralized control functions are played in access net, can control access switch and terminal. Node server can directly be connected with access switch, can also directly be connected with terminal.
Similar, the equipment of metropolitan area mesh portions can also be divided into 3 classes: metropolitan area server, node switch, node serve Device.Metropolitan area server is connected with node switch, and node switch can be connected with multiple node servers.
Wherein, node server is the node server for accessing mesh portions, i.e. node server had both belonged to access wet end Point, and belong to metropolitan area mesh portions.
Metropolitan area server is the node that centralized control functions are played in Metropolitan Area Network (MAN), can control node switch and node serve Device.Metropolitan area server can be directly connected to node switch, can also be directly connected to node server.
It can be seen that be entirely a kind of central controlled network structure of layering depending on networking network, and node server and metropolitan area The network controlled under server can be the various structures such as tree-shaped, star-like, cyclic annular.
Visually claim, access mesh portions can form unified video platform (part in virtual coil), and multiple unified videos are flat Platform can form view networking;Each unified video platform can be interconnected by metropolitan area and wide area depending on networking.
Classify depending on networked devices
1.1 embodiment of the present invention can be mainly divided into 3 classes: server depending on the equipment in networking, interchanger (including ether Net gateway), terminal (including various set-top boxes, encoding board, memory etc.).Depending on networking can be divided on the whole Metropolitan Area Network (MAN) (or National net, World Wide Web etc.) and access net.
1.2 equipment for wherein accessing mesh portions can be mainly divided into 3 classes: node server, access switch (including ether Net gateway), terminal (including various set-top boxes, encoding board, memory etc.).
The specific hardware structure of each access network equipment are as follows:
Node server:
As shown in Fig. 2, mainly including Network Interface Module 201, switching engine module 202, CPU module 203, disk array Module 204;
Wherein, Network Interface Module 201, the Bao Jun that CPU module 203, disk array module 204 are come in enter switching engine Module 202;Switching engine module 202 look into the operation of address table 205 to the packet come in, to obtain the navigation information of packet; And the packet is stored according to the navigation information of packet the queue of corresponding pack buffer 206;If the queue of pack buffer 206 is close It is full, then it abandons;All pack buffer queues of 202 poll of switching engine mould, are forwarded: 1) port if meeting the following conditions It is less than to send caching;2) the queue package counting facility is greater than zero.Disk array module 204 mainly realizes the control to hard disk, including The operation such as initialization, read-write to hard disk;CPU module 203 is mainly responsible between access switch, terminal (not shown) Protocol processes, to address table 205 (including descending protocol packet address table, uplink protocol package address table, data packet addressed table) Configuration, and, the configuration to disk array module 204.
Access switch:
As shown in figure 3, mainly including Network Interface Module (downstream network interface module 301, uplink network interface module 302), switching engine module 303 and CPU module 304;
Wherein, the packet (upstream data) that downstream network interface module 301 is come in enters packet detection module 305;Packet detection mould Whether mesh way address (DA), source address (SA), type of data packet and the packet length of the detection packet of block 305 meet the requirements, if met, It then distributes corresponding flow identifier (stream-id), and enters switching engine module 303, otherwise abandon;Uplink network interface mould The packet (downlink data) that block 302 is come in enters switching engine module 303;The data packet that CPU module 204 is come in enters switching engine Module 303;Switching engine module 303 look into the operation of address table 306 to the packet come in, to obtain the navigation information of packet; If the packet into switching engine module 303 is that downstream network interface is gone toward uplink network interface, in conjunction with flow identifier (stream-id) packet is stored in the queue of corresponding pack buffer 307;If the queue of the pack buffer 307 is close full, It abandons;If the packet into switching engine module 303 is not that downstream network interface is gone toward uplink network interface, according to packet Navigation information is stored in the data packet queue of corresponding pack buffer 307;If the queue of the pack buffer 307 is close full, Then abandon.
All pack buffer queues of 303 poll of switching engine module, are divided to two kinds of situations in embodiments of the present invention:
If the queue is that downstream network interface is gone toward uplink network interface, meets the following conditions and be forwarded: 1) It is less than that the port sends caching;2) the queue package counting facility is greater than zero;3) token that rate control module generates is obtained;
If the queue is not that downstream network interface is gone toward uplink network interface, meets the following conditions and is forwarded: 1) it is less than to send caching for the port;2) the queue package counting facility is greater than zero.
Rate control module 208 is configured by CPU module 204, to all downlink networks in programmable interval Interface generates token toward the pack buffer queue that uplink network interface is gone, to control the code rate of forwarded upstream.
CPU module 304 is mainly responsible for the protocol processes between node server, the configuration to address table 306, and, Configuration to rate control module 308.
Ethernet association turns gateway:
As shown in figure 4, mainly including Network Interface Module (downstream network interface module 401, uplink network interface module 402), switching engine module 403, CPU module 404, packet detection module 405, rate control module 408, address table 406, Bao Huan Storage 407 and MAC adding module 409, MAC removing module 410.
Wherein, the data packet that downstream network interface module 401 is come in enters packet detection module 405;Packet detection module 405 is examined Ethernet mac DA, ethernet mac SA, Ethernet length or frame type, the view networking mesh way address of measured data packet DA, whether meet the requirements depending on networking source address SA, depending on networking data Packet type and packet length, corresponding stream is distributed if meeting Identifier (stream-id);Then, MAC DA, MAC SA, length or frame type are subtracted by MAC removing module 410 (2byte), and enter corresponding receive and cache, otherwise abandon;
Downstream network interface module 401 detects the transmission caching of the port, according to the view of packet networking mesh if there is Bao Ze Address D A knows the ethernet mac DA of corresponding terminal, adds the ethernet mac DA of terminal, Ethernet assists the MAC for turning gateway SA, Ethernet length or frame type, and send.
The function that Ethernet association turns other modules in gateway is similar with access switch.
Terminal:
It mainly include Network Interface Module, Service Processing Module and CPU module;For example, set-top box mainly connects including network Mouth mold block, video/audio encoding and decoding engine modules, CPU module;Encoding board mainly includes Network Interface Module, video encoding engine Module, CPU module;Memory mainly includes Network Interface Module, CPU module and disk array module.
The equipment of 1.3 metropolitan area mesh portions can be mainly divided into 2 classes: node server, node switch, metropolitan area server. Wherein, node switch mainly includes Network Interface Module, switching engine module and CPU module;Metropolitan area server mainly includes Network Interface Module, switching engine module and CPU module are constituted.
2, networking data package definition is regarded
2.1 access network data package definitions
Access net data packet mainly include following sections: destination address (DA), source address (SA), reserve bytes, payload(PDU)、CRC。
As shown in the table, the data packet for accessing net mainly includes following sections:
DA SA Reserved Payload CRC
Wherein:
Destination address (DA) is made of 8 bytes (byte), and first character section indicates type (such as the various associations of data packet Discuss packet, multicast packet, unicast packet etc.), be up to 256 kinds of possibility, the second byte to the 6th byte is metropolitan area net address, Seven, the 8th bytes are access net address;
Source address (SA) is also to be made of 8 bytes (byte), is defined identical as destination address (DA);
Reserve bytes are made of 2 bytes;
The part payload has different length according to the type of different datagrams, is if it is various protocol packages 64 bytes are 32+1024=1056 bytes if it is single group unicast packets words, are not restricted to above 2 kinds certainly;
CRC is made of 4 bytes, and calculation method follows the Ethernet CRC algorithm of standard.
2.2 Metropolitan Area Network (MAN) packet definitions
The topology of Metropolitan Area Network (MAN) is pattern, may there is 2 kinds, connection even of more than two kinds, i.e. node switching between two equipment It can all can exceed that 2 kinds between machine and node server, node switch and node switch, node switch and node server Connection.But the metropolitan area net address of metropolitan area network equipment is uniquely, to close to accurately describe the connection between metropolitan area network equipment System, introduces parameter in embodiments of the present invention: label, uniquely to describe a metropolitan area network equipment.
(Multi-Protocol Label Switch, multiprotocol label are handed over by the definition of label and MPLS in this specification Change) label definition it is similar, it is assumed that between equipment A and equipment B there are two connection, then data packet from equipment A to equipment B just There are 2 labels, data packet also there are 2 labels from equipment B to equipment A.Label is divided into label, outgoing label, it is assumed that data packet enters The label (entering label) of equipment A is 0x0000, and the label (outgoing label) when this data packet leaves equipment A may reform into 0x0001.The networking process of Metropolitan Area Network (MAN) is to enter network process under centralized control, also means that address distribution, the label of Metropolitan Area Network (MAN) Distribution be all to be dominated by metropolitan area server, node switch, node server be all passively execute, this point with The label distribution of MPLS is different, and the distribution of the label of MPLS is the result that interchanger, server are negotiated mutually.
As shown in the table, the data packet of Metropolitan Area Network (MAN) mainly includes following sections:
DA SA Reserved Label Payload CRC
That is destination address (DA), source address (SA), reserve bytes (Reserved), label, payload (PDU), CRC.Its In, the format of label, which can refer to, such as gives a definition: label is 32bit, wherein high 16bit retains, only with low 16bit, its position Set is between the reserve bytes and payload of data packet.
Based on the above-mentioned characteristic of view networking, one of the core concepts of the embodiments of the present invention is proposed, in the embodiment of the present invention Android device carried out data transmission by multimedia server with depending on networked server, and coding pressure is carried out to audio, video data Contracting transmission, decoding play, and realize video calling.Wherein, Android device is carried out by ICP/IP protocol and multimedia server Connection, multimedia server depending on networking protocol with depending on networked server by being attached;
Referring to Fig. 5, the step of showing a kind of video call method embodiment one based on Android device of the invention stream Cheng Tu, this method are applied in view networking, and the embodiment of the present invention is illustrated from Android device side, and the method specifically can be with Include the following steps:
Step 501, video source data and audio source data are acquired.
In the concrete realization, video source data and audio source data can be acquired by the camera in Android device.
Step 502, the video source data and audio source data are encoded, is respectively formed the first video frame and first Audio frame.
In embodiments of the present invention, the video source data is compiled by H263 coding method or H264 coding method Code forms the first video frame.
In the concrete realization, collected video source data is put into first and is sent in buffering queue, then in transmission When slice is split plus sequence number to sps, pps of video source data, frame per second, code rate, code stream, to complete to video The coding of source data.
Collected audio-source data format is PCM format.After encoding to audio source data, AAC format is formed First audio frame.
To the process that video source data and audio source data are encoded, and to video source data and audio source data into The process of row compression.After the source data collected is carried out compressed encoding, then to be transmitted, data transmission bauds is fast, even if In the case where network signal is not strong or bandwidth traffic is weak, can also play out glibly.
Step 503, first video frame and first audio frame are converted into the first data packet.
Step 504, first data packet is sent to view networked server by multimedia server.
In a preferred example of an embodiment of the present invention, the step 504 can specifically include:
Sub-step 11, by TCP/IP (Transmission Control Protocol/Internet Protocol, Transmission control protocol/Internet Protocol also known as network communication protocol) first data packet is sent to the multimedia Server;
Sub-step 12, the multimedia server is by being sent to institute for received first data packet depending on networking protocol State view networked server.
It is a carrier for being different from internet depending on networking, the equipment (referred to as " Android device ") with Android system is general Be carried out data transmission by internet, so Android device first have to will by ICP/IP protocol connect streaming media server, Then streaming media server by view networking protocol connection view networked server, realize Android device and view networked server it Between data transmission, to carry out video calling (such as Web conference).
In the concrete realization, after receiving the first data packet depending on networked server, the first data packet can be sent to other Android device or view networked terminals (such as open-minded, the boxes product such as sea think of) for video calling.Depending on networked server by first The method that data packet is sent to view networked terminals, can specifically include:
Step 21, described that first data packet that the multimedia server sends over is received depending on networked server;
Step 22, described that first data packet is converted into view networking data depending on networked server;
Step 23, described to play out described be sent to depending on networking data depending on networked terminals depending on networked server.
It should be noted that view networked terminals pass through view networking protocol connection view networked server.
Referring to Fig. 6, the step of showing a kind of video call method embodiment two based on Android device of the invention stream Cheng Tu, this method can be applied in view networking.Method described in one through the foregoing embodiment, can be realized Android device will adopt The source data coding compression collected, is sent to view networked server by multimedia server.The embodiment of the present invention two is from Android The side of equipment is illustrated, and illustrates that the data received are sent to Android by multimedia server depending on networked server The method of equipment, this method can specifically include:
Step 601, the second data packet that the view networked server is sent is received by the multimedia server.
In a preferred example of an embodiment of the present invention, the step 601 can specifically include:
Sub-step 31, the multimedia server is by receiving the described of the view networked server transmission depending on networking protocol Second data packet;
Sub-step 32 receives second data packet that the multimedia server is sent by ICP/IP protocol.
Step 602, second data packet is parsed, the second video frame and the second audio frame are generated.
Step 603, second video frame and second audio frame are decoded.
In a preferred example of an embodiment of the present invention, video frame and audio frame are solved using the method for hard decoder Code.The mode of hard decoder can reduce the occupancy of cpu, greatly improve the fluency of playing audio-video.
Step 604, second video frame after broadcast decoder and second audio frame.
In the concrete realization, the video frame and audio frame that will be generated after parsing, are put into video buffer queue and audio respectively In buffering queue, video frame and audio frame then are read out from video buffer queue and Audio Buffer queue respectively, after decoding It plays out.
It in the concrete realization, can be by being sent to Streaming Media clothes depending on networked server depending on the collected data of networked terminals It is engaged on device, the Android device for video calling is then sent to by streaming media server.
Android device includes the equipment that mobile phone, tablet computer etc. are equipped with Android system.
It should be noted that for simple description, therefore, it is stated as a series of action groups for embodiment of the method It closes, but those skilled in the art should understand that, embodiment of that present invention are not limited by the describe sequence of actions, because according to According to the embodiment of the present invention, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art also should Know, the embodiments described in the specification are all preferred embodiments, and the related movement not necessarily present invention is implemented Necessary to example.
Referring to Fig. 7, a kind of structural frames of video call system embodiment one based on Android device of the invention are shown Figure, the system are applied in view networking, comprising: Android device 1, multimedia server 2 and view networked server 3;The Android Equipment 1 connects the multimedia server 2 by ICP/IP protocol;The multimedia server 2 passes through view networking protocol connection The view networked server 3.
The Android device 1 includes:
Acquisition module 701, for acquiring video source data and audio source data.
Coding module 702 is respectively formed the first video for encoding to the video source data and audio source data Frame and the first audio frame.
In embodiments of the present invention, the video source data is compiled by H263 coding method or H264 coding method Code forms the first video frame.
Collected audio-source data format is PCM format.After encoding to audio source data, AAC format is formed First audio frame.
Conversion module 703, for first video frame and first audio frame to be converted to the first data packet;
First sending module 704, for first data packet to be sent to view the Internet services by multimedia server Device.
The multimedia server 2 includes:
Second receiving module, for receiving first data packet that the Android device is sent by ICP/IP protocol;
Second sending module, for being networked by the way that received first data packet is sent to the view depending on networking protocol Server.
Referring to Fig. 8, a kind of structural frames of video call system embodiment two based on Android device of the invention are shown Figure, the system are applied in view networking, comprising: Android device 1, multimedia server 2 and view networked server 3;The Android Equipment 1 connects the multimedia server 2 by ICP/IP protocol;The multimedia server 2 passes through view networking protocol connection The view networked server 3.
The Android device 1 further include:
First receiving module 801, for receiving that the view networked server is sent by the multimedia server Two data packets;
Parsing module 802 generates the second video frame and the second audio frame for parsing second data packet;
Decoder module 803, for being decoded to second video frame and second audio frame;
Playing module 804, for after broadcast decoder second video frame and second audio frame.
The multimedia server 2 further include:
Third receiving module, for by receiving second data that the view networked server is sent depending on networking protocol Packet;
Third sending module, for received second data packet to be sent to Android device by ICP/IP protocol.
In conclusion the characteristic of application view networking of the embodiment of the present invention, Android device are joined by multimedia server and view Network server carries out data transmission, and realizes video calling, gets rid of the limitation in video calling place, user's operation is more convenient.
For device (system) embodiment, since it is basically similar to the method embodiment, so the comparison of description is simple Single, the relevent part can refer to the partial explaination of embodiments of method.
All the embodiments in this specification are described in a progressive manner, the highlights of each of the examples are with The difference of other embodiments, the same or similar parts between the embodiments can be referred to each other.
It should be understood by those skilled in the art that, the embodiment of the embodiment of the present invention can provide as method, apparatus or calculate Machine program product.Therefore, the embodiment of the present invention can be used complete hardware embodiment, complete software embodiment or combine software and The form of the embodiment of hardware aspect.Moreover, the embodiment of the present invention can be used one or more wherein include computer can With in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of program code The form of the computer program product of implementation.
The embodiment of the present invention be referring to according to the method for the embodiment of the present invention, terminal device (system) and computer program The flowchart and/or the block diagram of product describes.It should be understood that flowchart and/or the block diagram can be realized by computer program instructions In each flow and/or block and flowchart and/or the block diagram in process and/or box combination.It can provide these Computer program instructions are set to general purpose computer, special purpose computer, Embedded Processor or other programmable data processing terminals Standby processor is to generate a machine, so that being held by the processor of computer or other programmable data processing terminal devices Capable instruction generates for realizing in one or more flows of the flowchart and/or one or more blocks of the block diagram The device of specified function.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing terminal devices In computer-readable memory operate in a specific manner, so that instruction stored in the computer readable memory generates packet The manufacture of command device is included, which realizes in one side of one or more flows of the flowchart and/or block diagram The function of being specified in frame or multiple boxes.
These computer program instructions can also be loaded into computer or other programmable data processing terminal devices, so that Series of operation steps are executed on computer or other programmable terminal equipments to generate computer implemented processing, thus The instruction executed on computer or other programmable terminal equipments is provided for realizing in one or more flows of the flowchart And/or in one or more blocks of the block diagram specify function the step of.
Although the preferred embodiment of the embodiment of the present invention has been described, once a person skilled in the art knows bases This creative concept, then additional changes and modifications can be made to these embodiments.So the following claims are intended to be interpreted as Including preferred embodiment and fall into all change and modification of range of embodiment of the invention.
Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation Between there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaning Covering non-exclusive inclusion, so that process, method, article or terminal device including a series of elements not only wrap Those elements are included, but also including other elements that are not explicitly listed, or further includes for this process, method, article Or the element that terminal device is intrinsic.In the absence of more restrictions, being wanted by what sentence "including a ..." limited Element, it is not excluded that there is also other identical elements in process, method, article or the terminal device for including the element.
Android device is based on to a kind of video call method based on Android device provided by the present invention and one kind above Video call system, be described in detail, specific case used herein to the principle of the present invention and embodiment into Elaboration is gone, the above description of the embodiment is only used to help understand the method for the present invention and its core ideas;Meanwhile for this The those skilled in the art in field, according to the thought of the present invention, there will be changes in the specific implementation manner and application range, In conclusion the contents of this specification are not to be construed as limiting the invention.

Claims (5)

1. a kind of video call method based on Android device, which is characterized in that the method is applied in view networking, the side Method includes:
The Android device acquisition video source data and audio source data;
The Android device encodes the video source data and audio source data, is respectively formed the first video frame and first Audio frame;
First video frame and first audio frame are converted to the first data packet by the Android device;
First data packet is sent to view networked server by multimedia server by the Android device;
The Android device receives the second data packet that the view networked server is sent by the multimedia server;
The Android device parses second data packet, generates the second video frame and the second audio frame;
The Android device is decoded second video frame and second audio frame;
Second video frame and second audio frame after the Android device broadcast decoder;
It is described that first data packet that the multimedia server sends over is received depending on networked server;
It is described that first data packet is converted into view networking data depending on networked server;
It is described to play out described be sent to depending on networking data depending on networked terminals depending on networked server;
Wherein, first data packet is sent to the step of view networked server by the Android device by multimedia server Suddenly, comprising:
First data packet is sent to the multimedia server by ICP/IP protocol by the Android device;
The multimedia server is by being sent to the view the Internet services for received first data packet depending on networking protocol Device;
The Android device receives the step for the second data packet that the view networked server is sent by the multimedia server Suddenly, comprising:
The multimedia server is by receiving second data packet that the view networked server is sent depending on networking protocol;
The Android device receives second data packet that the multimedia server is sent by ICP/IP protocol.
2. the method according to claim 1, wherein described carry out the video source data and audio source data The step of encoding, being respectively formed the first video frame and the first audio frame, comprising:
The video source data is encoded by H263 coding method or H264 coding method, forms the first video frame;
The audio source data is encoded, the first audio frame of AAC format is formed;The audio-source data format is PCM Format.
3. a kind of video call system based on Android device, which is characterized in that the system is applied in view networking, comprising: Android device, multimedia server and view networked server;The Android device connects the multimedia server, more matchmakers Body server connects the view networked server;
The Android device includes:
Acquisition module, for acquiring video source data and audio source data;
Coding module is respectively formed the first video frame and for encoding to the video source data and audio source data One audio frame;
Conversion module, for first video frame and first audio frame to be converted to the first data packet;
First sending module, for first data packet to be sent to view networked server by multimedia server;
First receiving module, for receiving the second data that the view networked server is sent by the multimedia server Packet;
Parsing module generates the second video frame and the second audio frame for parsing second data packet;
Decoder module, for being decoded to second video frame and second audio frame;
Playing module, for after broadcast decoder second video frame and second audio frame;
The view networked server, first data packet sended over for receiving the multimedia server will be described First data packet is converted to view networking data, and described be sent to depending on networking data is played out depending on networked terminals;
The multimedia server includes:
Second receiving module, for receiving first data packet that the Android device is sent by ICP/IP protocol;
Second sending module, for by the way that received first data packet is sent to the view the Internet services depending on networking protocol Device;
Third receiving module, for by receiving second data packet that the view networked server is sent depending on networking protocol;
Third sending module, for received second data packet to be sent to Android device by ICP/IP protocol.
4. system according to claim 3, which is characterized in that the Android device is connected described more by ICP/IP protocol Media server;The multimedia server connects the view networked server by view networking protocol.
5. according to the described in any item systems of claim 3-4, which is characterized in that the Android device includes mobile phone and plate electricity Brain.
CN201610983683.6A 2016-11-08 2016-11-08 A kind of video call method and its system based on Android device Active CN108063745B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610983683.6A CN108063745B (en) 2016-11-08 2016-11-08 A kind of video call method and its system based on Android device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610983683.6A CN108063745B (en) 2016-11-08 2016-11-08 A kind of video call method and its system based on Android device

Publications (2)

Publication Number Publication Date
CN108063745A CN108063745A (en) 2018-05-22
CN108063745B true CN108063745B (en) 2019-03-01

Family

ID=62137453

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610983683.6A Active CN108063745B (en) 2016-11-08 2016-11-08 A kind of video call method and its system based on Android device

Country Status (1)

Country Link
CN (1) CN108063745B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110611645B (en) * 2018-06-15 2022-02-22 视联动力信息技术股份有限公司 Communication method and system of video telephone
CN110740428B (en) * 2018-07-18 2022-06-07 视联动力信息技术股份有限公司 Data processing method and device for individual equipment
CN110213235A (en) * 2019-04-30 2019-09-06 视联动力信息技术股份有限公司 The method and system of iOS device and view networked terminals video calling
CN110087020B (en) * 2019-04-30 2021-09-21 视联动力信息技术股份有限公司 Method and system for realizing video networking conference by iOS equipment
CN110505204A (en) * 2019-07-17 2019-11-26 视联动力信息技术股份有限公司 A kind of immediate voice communication method, device, electronic equipment and readable storage medium storing program for executing
CN111669534A (en) * 2020-04-28 2020-09-15 视联动力信息技术股份有限公司 Communication method, first client and instant communication system

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080100694A1 (en) * 2006-10-27 2008-05-01 Microsoft Corporation Distributed caching for multimedia conference calls
US20100149301A1 (en) * 2008-12-15 2010-06-17 Microsoft Corporation Video Conferencing Subscription Using Multiple Bit Rate Streams
CN101610385B (en) * 2009-07-16 2011-12-07 中兴通讯股份有限公司 System for realizing wireless video conference and method
CN101610455B (en) * 2009-07-16 2012-10-10 中兴通讯股份有限公司 Method for realizing member management in wireless video conference and system thereof
CN102215371A (en) * 2010-04-02 2011-10-12 宁波Gqy视讯股份有限公司 Coded orthogonal frequency division multiplexing (COFDM)-technology-based wireless mobile video conference system
US8744420B2 (en) * 2010-04-07 2014-06-03 Apple Inc. Establishing a video conference during a phone call
CN101984728B (en) * 2010-10-22 2013-10-02 惠州Tcl移动通信有限公司 Method and visual communication terminal for achieving visual conversation based on bluetooth earphone
CN102325246B (en) * 2011-10-18 2014-05-07 Tcl集团股份有限公司 Video conference system as well as video conference server and mobile communication terminal
CN102611871A (en) * 2012-01-13 2012-07-25 深圳市同洲电子股份有限公司 Method, system and mobile terminal for video communication and digital television receiving terminal
CN103686072B (en) * 2013-11-15 2015-09-23 北京视联动力国际信息技术有限公司 Depending on networked video method for supervising and system, association turns server and looks networked server
CN103701658B (en) * 2013-11-18 2016-05-04 北京视联动力国际信息技术有限公司 A kind of network condition method of testing and device of looking networking
CN105024868A (en) * 2014-04-17 2015-11-04 北京视联动力国际信息技术有限公司 Network quality detection method and network quality detection system for video Internet
CN205142396U (en) * 2015-10-27 2016-04-06 邦彦技术股份有限公司 Desk -top meeting equipment of portable audio frequency and video and system

Also Published As

Publication number Publication date
CN108063745A (en) 2018-05-22

Similar Documents

Publication Publication Date Title
CN108234421B (en) A kind of method and system regarding networked terminals and the intercommunication of internet terminal audio data
CN106341515B (en) A kind of monitoring method and device of terminal
CN108063745B (en) A kind of video call method and its system based on Android device
CN108111474B (en) A kind of sound mixing method and device
CN109788232A (en) A kind of summary of meeting recording method of video conference, device and system
CN108616328A (en) A kind of audio/video flow loss recovery method and audio/video flow transmitting terminal and receiving terminal
CN108881135A (en) It is a kind of based on view networking information transferring method, device and system
CN108124165A (en) A kind of code stream recording method and its system based on regarding networking
CN108243343B (en) A kind of point distribution statistical method and its server based on view networking
CN110113299A (en) Data transmission method, device, signal server and computer-readable medium
CN110460804A (en) Conferencing data sending method, system, equipment and computer readable storage medium
CN110049346A (en) A kind of method and system of net cast
CN109191808A (en) A kind of alarm method and system based on view networking
CN109151610A (en) A kind for the treatment of method and apparatus receiving web camera picture
CN108881818A (en) A kind of transmission method and device of video data
CN108881819A (en) A kind of transmission method and device of audio data
CN110149305A (en) A kind of method and transfer server of the multi-party playing audio-video based on view networking
CN110166833A (en) A kind of video stream transcoding method and device
CN109729184A (en) A kind of method and apparatus of view networking service processing
CN109640027A (en) Call method and device
CN109491783A (en) A kind of acquisition methods and system of memory usage
CN108966003A (en) A kind of method and apparatus of TV data processing
CN108989831A (en) A kind of network REC method and apparatus of multi-code stream
CN108574819B (en) A kind of terminal device and a kind of method of video conference
CN110149497A (en) A kind of view networked data transmission method, apparatus, system and readable storage medium storing program for executing

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 100000 Dongcheng District, Beijing, Qinglong Hutong 1, 1103 house of Ge Hua building.

Applicant after: Video Link Power Information Technology Co., Ltd.

Address before: 100000 Beijing Dongcheng District gogoa building A1103-1113

Applicant before: BEIJING VISIONVERA INTERNATIONAL INFORMATION TECHNOLOGY CO., LTD.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20201230

Address after: 570105 room 1201, Central International Plaza, 77 Binhai street, Longhua District, Haikou City, Hainan Province

Patentee after: Hainan Qiantang Shilian Information Technology Co.,Ltd.

Address before: 100000 Dongcheng District, Beijing, Qinglong Hutong 1, 1103 house of Ge Hua building.

Patentee before: VISIONVERA INFORMATION TECHNOLOGY Co.,Ltd.

TR01 Transfer of patent right