CN108063745A - A kind of video call method and its system based on Android device - Google Patents
A kind of video call method and its system based on Android device Download PDFInfo
- Publication number
- CN108063745A CN108063745A CN201610983683.6A CN201610983683A CN108063745A CN 108063745 A CN108063745 A CN 108063745A CN 201610983683 A CN201610983683 A CN 201610983683A CN 108063745 A CN108063745 A CN 108063745A
- Authority
- CN
- China
- Prior art keywords
- server
- video
- data packet
- data
- audio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
An embodiment of the present invention provides a kind of video call method and its system based on Android device, this method includes：Gather video source data and audio source data；Video source data and audio source data are encoded, are respectively formed the first video frame and the first audio frame；First video frame and the first audio frame are converted into the first data packet；First data packet is sent to by multimedia server regarding networked server；The second data packet for regarding networked server and sending is received by multimedia server；The second data packet is parsed, generates the second video frame and the second audio frame；Second video frame and the second audio frame are decoded；The second video frame and the second audio frame after broadcast decoder.Android device in the embodiment of the present invention, with carrying out data transmission depending on networked server, has broken away from the limitation in video calling place, user's operation is more convenient by multimedia server；And coding compression is carried out to the data of transmission in data transmission procedure, data transmission bauds is fast.
Description
Technical field
The present invention relates to regarding networking technology field, more particularly to a kind of video call method based on Android device and one
Video call system of the kind based on Android device.
Background technology
With the fast development of the network technology, depending on working application (e.g., video conference, video teaching etc.) in the life of user
Living, work, study etc. are widely available.In the application regarding networking, due to regarding the limitation of networking protocol, generally use regards connection
Network termination carries out video conference or video teaching.Conventional is typically fixed regarding networked terminals present position, and user can only
Video conference or video teaching etc. are carried out in fixed place, user experience effect is poor.
The content of the invention
In view of the above problems, it is proposed that the embodiment of the present invention overcomes the above problem or at least partly in order to provide one kind
A kind of video call method based on Android device and a kind of corresponding video based on Android device to solve the above problems leads to
Telephone system.
To solve the above-mentioned problems, the embodiment of the invention discloses a kind of video call method based on Android device, institutes
Method is stated to be applied to regard in networking, the described method includes：
Gather video source data and audio source data；
The video source data and audio source data are encoded, are respectively formed the first video frame and the first audio frame；
First video frame and first audio frame are converted into the first data packet；
First data packet is sent to by multimedia server regarding networked server.
Preferably, a kind of video call method based on Android device further includes：
Second data packet sent regarding networked server is received by the multimedia server；
Second data packet is parsed, generates the second video frame and the second audio frame；
Second video frame and second audio frame are decoded；
Second video frame and second audio frame after broadcast decoder.
Preferably, described the step of being sent to first data packet regarding networked server by multimedia server,
Including：
First data packet is sent to by the multimedia server by ICP/IP protocol；
The multimedia server is networked by the way that first data packet of reception is sent to described regard depending on networking protocol
Server.
Preferably, it is described that second data packet sent regarding networked server is received by the multimedia server
Step, including：
The multimedia server receives second data sent regarding networked server by regarding networking protocol
Bag；
Second data packet of the multimedia server transmission is received by ICP/IP protocol.
Preferably, it is described that the video source data and audio source data are encoded, be respectively formed the first video frame and
The step of first audio frame, including：
The video source data is encoded by H263 coding methods or H264 coding methods, forms the first video
Frame；
The audio source data is encoded, forms the first audio frame of AAC forms；The audio-source data format is
PCM format.
Preferably, described the step of being sent to first data packet regarding networked server by multimedia server it
Afterwards, further include：
First data packet sended over depending on the networked server reception multimedia server；
It is described to be converted to first data packet regarding networking data depending on networked server；
It is described to play out described be sent to depending on networking data depending on networked terminals depending on networked server.
The present invention also provides a kind of video call system based on Android device, the system is applied to regard in networking,
Including：Android device, multimedia server and regarding networked server；The Android device connects the multimedia server, institute
It is described regarding networked server to state multimedia server connection；
The Android device includes：
Acquisition module, for gathering video source data and audio source data；
Coding module for being encoded to the video source data and audio source data, is respectively formed the first video frame
With the first audio frame；
Modular converter, for first video frame and first audio frame to be converted to the first data packet；
First sending module, for being sent to first data packet regarding networked server by multimedia server.
Preferably, the Android device further includes：
First receiving module receives second number sent regarding networked server for passing through the multimedia server
According to bag；
Parsing module for parsing second data packet, generates the second video frame and the second audio frame；
Decoder module, for being decoded to second video frame and second audio frame；
Playing module, for second video frame after broadcast decoder and second audio frame.
Preferably, the Android device connects the multimedia server by ICP/IP protocol；The multimedia service
By regarding, networking protocol connection is described to regard networked server to device.
Preferably, the Android device includes mobile phone and tablet computer.
The embodiment of the present invention includes advantages below：
The embodiment of the present invention apply regarding networking characteristic, Android device by multimedia server with regarding networked server into
Row data transmission realizes video calling, has broken away from the limitation in video calling place, user's operation is more convenient；And in data
Coding compression is carried out to the data of transmission in transmission process, data transmission bauds is fast, even if network signal is not strong or bandwidth stream
Measure it is weak in the case of, can also play out glibly.
Description of the drawings
Fig. 1 is a kind of networking schematic diagram for regarding networking of the present invention；
Fig. 2 is a kind of hardware architecture diagram of node server of the present invention；
Fig. 3 is a kind of hardware architecture diagram of access switch of the present invention；
Fig. 4 is that a kind of Ethernet association of the present invention turns the hardware architecture diagram of gateway；
Fig. 5 is a kind of step flow chart of video call method embodiment one based on Android device of the present invention；
Fig. 6 is a kind of step flow chart of video call method embodiment two based on Android device of the present invention；
Fig. 7 is a kind of structure diagram of video call system embodiment one based on Android device of the present invention；
Fig. 8 is a kind of structure diagram of video call system embodiment two based on Android device of the present invention.
Specific embodiment
In order to make the foregoing objectives, features and advantages of the present invention clearer and more comprehensible, it is below in conjunction with the accompanying drawings and specific real
Applying mode, the present invention is described in further detail.
It is the important milestone of network Development depending on networking, is a real-time network, can realize HD video real-time Transmission,
Push numerous the Internet, applications to HD video, high definition is face-to-face.
It, can be such as high in a network platform by required service depending on networking using real-time high-definition video switching technology
Clear video conference, video monitoring, emergency command, digital broadcast television, delay TV, the Web-based instruction, show Intellectualized monitoring analysis
Field live streaming, VOD program requests, TV Mail, individual character recording (PVR), Intranet (manage) channel, intelligent video Broadcast Control, information issue by oneself
The services such as etc. tens of kinds videos, voice, picture, word, communication, data are all incorporated into a system platform, by TV or
Computer realizes that high-definition quality video plays.
For those skilled in the art is made to more fully understand the embodiment of the present invention, below to being introduced depending on networking：
Depending on networking, applied portion of techniques is as described below：
Network technology (Network Technology)
Network technology innovation depending on networking improves traditional ethernet (Ethernet), potential huge on network to face
Video flow.(Circuit is exchanged different from simple network packet packet switch (Packet Switching) or lattice network
Switching), Streaming demands are met using Packet Switching depending on networking technology.Possesses grouping depending on networking technology
Flexible, the simple and low price exchanged, is provided simultaneously with quality and the safety assurance of circuit switching, it is virtually electric to realize the whole network switch type
Road and the seamless connection of data format.
Switching technology (Switching Technology)
Two advantages of asynchronous and packet switch of Ethernet are used depending on networking, eliminating Ethernet on the premise of full compatibility lacks
It falls into, possesses the end-to-end seamless connection of the whole network, direct user terminal directly carries IP data packets.User data is in network-wide basis
It is not required to any format conversion.It is the higher level form of Ethernet depending on networking, is a real-time exchange platform, can realizes at present mutually
The whole network large-scale high-definition realtime video transmission that networking can not be realized pushes numerous Internet video applications to high Qinghua, unitizes.
Server technology (Server Technology)
It is different from traditional server, its Streaming Media depending on the server technology in networking and unified video platform
Transmission be built upon it is connection-oriented on the basis of, data-handling capacity is unrelated with flow, communication time, and single network layer is with regard to energy
Enough include signaling and data transmission.For voice and video business, handled depending on networking and unified video platform Streaming Media
Complexity many simpler than data processing, efficiency substantially increase hundred times or more than traditional server.
Reservoir technology (Storage Technology)
The ultrahigh speed reservoir technology of unified video platform in order to adapt to the media content of vast capacity and super-flow and
State-of-the-art real time operating system is employed, the programme information in server instruction is mapped to specific hard drive space, media
Content is no longer pass through server, and moment is directly delivered to user terminal, and user waits typical time to be less than 0.2 second.It optimizes
Sector distribution greatly reduces the mechanical movement of hard disc magnetic head tracking, and resource consumption only accounts for the 20% of ad eundem IP internets, but
The concurrent flow more than 3 times of traditional disk array is generated, overall efficiency promotes 10 times or more.
Network security technology (Network Security Technology)
Structural design depending on networking by servicing independent licence system, equipment and the modes such as user data is completely isolated every time
The network security problem of puzzlement internet has thoroughly been eradicated from structure, antivirus applet, fire wall is generally not required, has prevented black
Visitor and the attack of virus, provide structural carefree secure network to the user.
Service innovative technology (Service Innovation Technology)
Business and transmission are merged by unified video platform, whether single user, private user or a net
The sum total of network is all only once to connect automatically.User terminal, set-top box or PC are attached directly to unified video platform, obtain rich
The multimedia video service of rich colorful various forms.Unified video platform is traditional to substitute with table schema using " menu type "
Complicated applications program, and can use considerably less code that complicated application can be realized, and realize the new business innovation of " endless ".
Networking depending on networking is as described below：
It is a kind of central controlled network structure depending on networking, which can be Tree Network, Star network, ring network etc. class
Type, but centralized control node is needed to control whole network in network on this basis.
As shown in Figure 1, it is divided into access net and Metropolitan Area Network (MAN) two parts depending on networking.
The equipment of access mesh portions can be mainly divided into 3 classes：Node server, access switch, terminal is (including various machines
Top box, encoding board, memory etc.).Node server is connected with access switch, and access switch can be with multiple terminal phases
Even, and Ethernet can be connected.
Wherein, node server is the node that centralized control functions are played in access net, can control access switch and terminal.
Node server can directly be connected with access switch, can also directly be connected with terminal.
Similar, the equipment of metropolitan area mesh portions can also be divided into 3 classes：Metropolitan area server, node switch, node serve
Device.Metropolitan area server is connected with node switch, and node switch can be connected with multiple node servers.
Wherein, node server is the node server for accessing mesh portions, i.e. node server had both belonged to access wet end
Point, and belong to metropolitan area mesh portions.
Metropolitan area server is the node that centralized control functions are played in Metropolitan Area Network (MAN), can control node switch and node serve
Device.Metropolitan area server can be directly connected to node switch, can also be directly connected to node server.
It can be seen that be entirely a kind of central controlled network structure of layering depending on networking network, and node server and metropolitan area
The network controlled under server can be the various structures such as tree-shaped, star-like, annular.
Visually claim, access mesh portions can form unified video platform (empty thiol point), and multiple unified videos are put down
Platform can be formed regarding networking；Each unified video platform can be interconnected by metropolitan area and wide area depending on networking.
Classify depending on networked devices
1.1 embodiment of the present invention can be mainly divided into 3 classes depending on the equipment in networking：Server, interchanger is (including ether
Net gateway), terminal (including various set-top boxes, encoding board, memory etc.).Depending on networking can be divided on the whole Metropolitan Area Network (MAN) (or
National net, World Wide Web etc.) and access net.
1.2 equipment for wherein accessing mesh portions can be mainly divided into 3 classes：Node server, access switch is (including ether
Net gateway), terminal (including various set-top boxes, encoding board, memory etc.).
The particular hardware structure of each access network equipment is：
Node server：
As shown in Fig. 2, mainly include Network Interface Module 201, switching engine module 202, CPU module 203, disk array
Module 204；
Wherein, Network Interface Module 201, the Bao Jun that CPU module 203, disk array module 204 are come in enter switching engine
Module 202；Switching engine module 202 to the bag come in look into the operation of address table 205, so as to obtain the navigation information of bag；
And the bag is stored according to the navigation information of bag the queue of corresponding pack buffer 206；If the queue of pack buffer 206 approaches
It is full, then it abandons；All pack buffer queues of 202 poll of switching engine mould, are forwarded to if meeting the following conditions：1) port
Send caching less than；2) the queue package counting facility is more than zero.Disk array module 204 mainly realizes the control to hard disk, including
The operations such as initialization, read-write to hard disk；CPU module 203 is mainly responsible between access switch, terminal (not shown)
Protocol processes, to address table 205 (including descending protocol packet address table, uplink protocol package address table, data packet addressed table)
Configuration and, the configuration to disk array module 204.
Access switch：
As shown in figure 3, mainly include Network Interface Module (downstream network interface module 301, uplink network interface module
302), switching engine module 303 and CPU module 304；
Wherein, the bag (upstream data) that downstream network interface module 301 is come in enters bag detection module 305；Bag detection mould
Whether mesh way address (DA), source address (SA), type of data packet and the packet length of the detection bag of block 305 meet the requirements, if met,
Corresponding flow identifier (stream-id) is then distributed, and into switching engine module 303, is otherwise abandoned；Uplink network interface mould
The bag (downlink data) that block 302 is come in enters switching engine module 303；The data packet that CPU module 204 is come in enters switching engine
Module 303；Switching engine module 303 to the bag come in look into the operation of address table 306, so as to obtain the navigation information of bag；
It is gone if the bag into switching engine module 303 is downstream network interface toward uplink network interface, with reference to flow identifier
(stream-id) bag is stored in the queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full,
It abandons；If the bag into switching engine module 303 is not that downstream network interface is gone toward uplink network interface, according to bag
Navigation information is stored in the data packet queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full,
Then abandon.
All pack buffer queues of 303 poll of switching engine module, are divided to two kinds of situations in embodiments of the present invention：
It is gone if the queue is downstream network interface toward uplink network interface, meets the following conditions and be forwarded to：1)
The port send caching less than；2) the queue package counting facility is more than zero；3) token that rate control module generates is obtained；
It is gone if the queue is not downstream network interface toward uplink network interface, meets the following conditions and be forwarded to：
1) port send caching less than；2) the queue package counting facility is more than zero.
Rate control module 208 is configured by CPU module 204, to all downlink networks in programmable interval
The pack buffer queue that interface is gone toward uplink network interface generates token, to control the code check of forwarded upstream.
CPU module 304 is mainly responsible for the protocol processes between node server, configuration to address table 306 and,
Configuration to rate control module 308.
Ethernet association turns gateway：
As shown in figure 4, mainly include Network Interface Module (downstream network interface module 401, uplink network interface module
402), switching engine module 403, CPU module 404, bag detection module 405, rate control module 408, address table 406, Bao Huan
Storage 407 and MAC add modules 409, MAC removing modules 410.
Wherein, the data packet that downstream network interface module 401 is come in enters bag detection module 405；Bag detection module 405 is examined
The ethernet mac DA of measured data bag, ethernet mac SA, Ethernet length or frame type, regarding networking mesh way address
DA, whether meet the requirements depending on networking source address SA, depending on networking data Packet type and packet length, corresponding stream is distributed if meeting
Identifier (stream-id)；Then, MAC DA, MAC SA, length or frame type are subtracted by MAC removing modules 410
(2byte), and enter corresponding order caching, otherwise abandon；
Downstream network interface module 401 detects the transmission caching of the port, if there is Bao Ze regarding with networking mesh according to bag
Address D A knows the ethernet mac DA of corresponding terminal, adds the ethernet mac DA of terminal, Ethernet assists the MAC for turning gateway
SA, Ethernet length or frame type, and send.
The function that Ethernet association turns other modules in gateway is similar with access switch.
Terminal：
Mainly include Network Interface Module, Service Processing Module and CPU module；For example, set-top box mainly connects including network
Mouth mold block, video/audio encoding and decoding engine modules, CPU module；Encoding board mainly includes Network Interface Module, video encoding engine
Module, CPU module；Memory mainly includes Network Interface Module, CPU module and disk array module.
The equipment of 1.3 metropolitan area mesh portions can be mainly divided into 2 classes：Node server, node switch, metropolitan area server.
Wherein, node switch mainly includes Network Interface Module, switching engine module and CPU module；Metropolitan area server mainly includes
Network Interface Module, switching engine module and CPU module are formed.
2nd, regarding networking data package definition
2.1 access network data package definitions
Accessing the data packet of net mainly includes following sections：Destination address (DA), source address (SA), reserve bytes,
payload(PDU)、CRC。
As shown in the table, accessing the data packet of net mainly includes following sections：
| DA | SA | Reserved | Payload | CRC |
Wherein：
Destination address (DA) is made of 8 bytes (byte), and first character section represents type (such as the various associations of data packet
Discuss bag, multicast packet, unicast packet etc.), be up to 256 kinds of possibility, the second byte to the 6th byte is metropolitan area net address,
Seven, the 8th bytes are access net address；
Source address (SA) is also to be made of 8 bytes (byte), is defined identical with destination address (DA)；
Reserve bytes are made of 2 bytes；
Payload parts have different length according to the type of different datagrams, if being if various protocol packages
64 bytes, if single group unicast packets words be 32+1024=1056 byte, be not restricted to certainly more than 2 kinds；
CRC is made of 4 bytes, and computational methods follow the Ethernet CRC algorithm of standard.
2.2 Metropolitan Area Network (MAN) packet definitions
The topology of Metropolitan Area Network (MAN) is pattern, may there is 2 kinds, connection even of more than two kinds, i.e. node switching between two equipment
2 kinds can be all can exceed that between machine and node server, node switch and node switch, node switch and node server
Connection.But the metropolitan area net address of metropolitan area network equipment is unique, is closed to accurately describe the connection between metropolitan area network equipment
System, introduces parameter in embodiments of the present invention：Label uniquely describes a metropolitan area network equipment.
(Multi-Protocol Label Switch, multiprotocol label are handed over by the definition of label and MPLS in this specification
Change) label definition it is similar, it is assumed that between device A and equipment B there are two connection, then data packet slave device A to equipment B just
There are 2 labels, data packet slave device B to device A also there are 2 labels.Label is divided into label, outgoing label, it is assumed that data packet enters
The label (entering label) of device A is 0x0000, and the label (outgoing label) when this data packet leaves device A may reform into
0x0001.The networking flow of Metropolitan Area Network (MAN) is to enter network process under centralized Control, also means that address distribution, the label of Metropolitan Area Network (MAN)
Distribution is all dominated by metropolitan area server, and node switch, node server are all passive execution, this point with
The label distribution of MPLS is different, and the distribution of the label of MPLS is the result that interchanger, server are consulted mutually.
As shown in the table, the data packet of Metropolitan Area Network (MAN) mainly includes following sections：
| DA | SA | Reserved | Label | Payload | CRC |
That is destination address (DA), source address (SA), reserve bytes (Reserved), label, payload (PDU), CRC.Its
In, the form of label may be referred to be defined as below：Label is 32bit, wherein high 16bit retains, only with low 16bit, its position
Put is between the reserve bytes and payload of data packet.
Based on the above-mentioned characteristic regarding networking, it is proposed that one of the core concepts of the embodiments of the present invention, in the embodiment of the present invention
Android device coding pressure is carried out with carrying out data transmission depending on networked server, and to audio, video data by multimedia server
Contracting transmission, decoding play, and realize video calling.Wherein, Android device is carried out by ICP/IP protocol and multimedia server
Connection, multimedia server by depending on networking protocol with being attached depending on networked server；
With reference to Fig. 5, a kind of the step of video call method embodiment one based on Android device for showing the present invention, flows
Cheng Tu, this method are applied to regard in networking, and the embodiment of the present invention is illustrated from Android device one side, and the method specifically can be with
Include the following steps：
Step 501, video source data and audio source data are gathered.
In the concrete realization, can video source data and audio source data be gathered by the camera in Android device.
Step 502, the video source data and audio source data are encoded, is respectively formed the first video frame and first
Audio frame.
In embodiments of the present invention, the video source data is compiled by H263 coding methods or H264 coding methods
Code forms the first video frame.
In the concrete realization, the video source data collected is put into first and sent in buffering queue, then in transmission
When section is split to sps, pps of video source data, frame per second, code check, code stream plus sequence number, so as to complete to video
The coding of source data.
The audio-source data format collected is PCM format.After being encoded to audio source data, AAC forms are formed
First audio frame.
The process that encoded to video source data and audio source data and to video source data and audio source data into
The process of row compression.After the source data collected is compressed coding, then it is transmitted, data transmission bauds is fast, even if
It is not strong or in the case that bandwidth traffic is weak in network signal, it can also play out glibly.
Step 503, first video frame and first audio frame are converted into the first data packet.
Step 504, first data packet is sent to by multimedia server regarding networked server.
In a kind of preferable example of the embodiment of the present invention, the step 504 can specifically include：
Sub-step 11, by TCP/IP (Transmission Control Protocol/Internet Protocol,
Transmission control protocol/Internet Protocol also known as network communication protocol) first data packet is sent to the multimedia
Server；
Sub-step 12, the multimedia server by first data packet of reception depending on networking protocol by being sent to institute
It states regarding networked server.
It is a carrier for being different from internet depending on networking, the equipment with Android system is (referred to as " Android device ") general
It is to be carried out data transmission by internet, so Android device first has to connect streaming media server by ICP/IP protocol,
Then streaming media server by regard networking protocol connection regard networked server, realize Android device with regarding networked server it
Between data transmission, so as to carry out video calling (such as Web conference).
In the concrete realization, after receiving the first data packet depending on networked server, the first data packet can be sent to other
For the Android device of video calling or regarding networked terminals (such as open-minded, the boxes product such as sea think of).Depending on networked server by first
Data packet is sent to the method regarding networked terminals, can specifically include：
Step 21, first data packet sended over depending on the networked server reception multimedia server；
Step 22, it is described to be converted to first data packet regarding networking data depending on networked server；
Step 23, it is described to play out described be sent to depending on networking data depending on networked terminals depending on networked server.
It should be noted that networked server is regarded by regarding networking protocol connection depending on networked terminals.
With reference to Fig. 6, a kind of the step of video call method embodiment two based on Android device for showing the present invention, flows
Cheng Tu, this method can be applied to regard in networking.By the method described in above-described embodiment one, it can realize that Android device will adopt
The source data coding compression collected, is sent to by multimedia server regarding networked server.The embodiment of the present invention two is from Android
The one side of equipment illustrates, and illustrates that the data received are sent to Android by multimedia server depending on networked server
The method of equipment, this method can specifically include：
Step 601, second data packet sent regarding networked server is received by the multimedia server.
In a kind of preferable example of the embodiment of the present invention, the step 601 can specifically include：
Sub-step 31, the multimedia server receive described regard described in networked server transmission by regarding networking protocol
Second data packet；
Sub-step 32 receives second data packet of the multimedia server transmission by ICP/IP protocol.
Step 602, second data packet is parsed, generates the second video frame and the second audio frame.
Step 603, second video frame and second audio frame are decoded.
In a kind of preferable example of the embodiment of the present invention, video frame and audio frame are solved using the method for hard decoder
Code.The mode of hard decoder can reduce the occupancy of cpu, greatly improve the fluency of playing audio-video.
Step 604, second video frame after broadcast decoder and second audio frame.
In the concrete realization, the video frame and audio frame that will be generated after parsing, are put into video buffer queue and audio respectively
In buffering queue, video frame and audio frame then are read out from video buffer queue and Audio Buffer queue respectively, after decoding
It plays out.
In the concrete realization, can be taken depending on the data that networked terminals collect by being sent to Streaming Media depending on networked server
It is engaged on device, the Android device for video calling is then sent to by streaming media server.
Android device includes the equipment that mobile phone, tablet computer etc. are equipped with Android system.
It should be noted that for embodiment of the method, in order to be briefly described, therefore it is all expressed as to a series of action group
It closes, but those skilled in the art should know, the embodiment of the present invention and from the limitation of described sequence of movement, because according to
According to the embodiment of the present invention, some steps may be employed other orders or be carried out at the same time.Secondly, those skilled in the art also should
Know, embodiment described in this description belongs to preferred embodiment, and the involved action not necessarily present invention is implemented
Necessary to example.
Reference Fig. 7 shows a kind of structural frames of video call system embodiment one based on Android device of the present invention
Figure, the system are applied to regard in networking, including：Android device 1, multimedia server 2 and regarding networked server 3；The Android
Equipment 1 connects the multimedia server 2 by ICP/IP protocol；The multimedia server 2 is connected by regarding networking protocol
It is described to regard networked server 3.
The Android device 1 includes：
Acquisition module 701, for gathering video source data and audio source data.
Coding module 702 for being encoded to the video source data and audio source data, is respectively formed the first video
Frame and the first audio frame.
In embodiments of the present invention, the video source data is compiled by H263 coding methods or H264 coding methods
Code forms the first video frame.
The audio-source data format collected is PCM format.After being encoded to audio source data, AAC forms are formed
First audio frame.
Modular converter 703, for first video frame and first audio frame to be converted to the first data packet；
First sending module 704, for being sent to first data packet regarding the Internet services by multimedia server
Device.
The multimedia server 2 includes：
Second receiving module, for passing through first data packet that ICP/IP protocol receives the Android device and sends；
Second sending module, for being networked by the way that first data packet of reception is sent to described regard depending on networking protocol
Server.
Reference Fig. 8 shows a kind of structural frames of video call system embodiment two based on Android device of the present invention
Figure, the system are applied to regard in networking, including：Android device 1, multimedia server 2 and regarding networked server 3；The Android
Equipment 1 connects the multimedia server 2 by ICP/IP protocol；The multimedia server 2 is connected by regarding networking protocol
It is described to regard networked server 3.
The Android device 1 further includes：
First receiving module 801, for pass through the multimedia server receive it is described sent regarding networked server the
Two data packets；
Parsing module 802 for parsing second data packet, generates the second video frame and the second audio frame；
Decoder module 803, for being decoded to second video frame and second audio frame；
Playing module 804, for second video frame after broadcast decoder and second audio frame.
The multimedia server 2 further includes：
3rd receiving module, for receiving second data sent regarding networked server by regarding networking protocol
Bag；
Second data packet of reception is sent to Android device by the 3rd sending module for passing through ICP/IP protocol.
In conclusion the embodiment of the present invention applies the characteristic regarding networking, Android device is by multimedia server with regarding connection
Network server carries out data transmission, and realizes video calling, has broken away from the limitation in video calling place, user's operation is more convenient.
For device (system) embodiment, since it is basicly similar to embodiment of the method, so the comparison of description is simple
Single, the relevent part can refer to the partial explaination of embodiments of method.
Each embodiment in this specification is described by the way of progressive, the highlights of each of the examples are with
The difference of other embodiment, just to refer each other for identical similar part between each embodiment.
It should be understood by those skilled in the art that, the embodiment of the embodiment of the present invention can be provided as method, apparatus or calculate
Machine program product.Therefore, the embodiment of the present invention can be used complete hardware embodiment, complete software embodiment or combine software and
The form of the embodiment of hardware aspect.Moreover, the embodiment of the present invention can be used one or more wherein include computer can
With in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of program code
The form of the computer program product of implementation.
The embodiment of the present invention be with reference to according to the method for the embodiment of the present invention, terminal device (system) and computer program
The flowchart and/or the block diagram of product describes.It should be understood that it can realize flowchart and/or the block diagram by computer program instructions
In each flow and/or block and flowchart and/or the block diagram in flow and/or box combination.These can be provided
Computer program instructions are set to all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing terminals
Standby processor is to generate a machine so that is held by the processor of computer or other programmable data processing terminal equipments
Capable instruction generation is used to implement in one flow of flow chart or multiple flows and/or one box of block diagram or multiple boxes
The device for the function of specifying.
These computer program instructions, which may also be stored in, can guide computer or other programmable data processing terminal equipments
In the computer-readable memory to work in a specific way so that the instruction being stored in the computer-readable memory generates bag
The manufacture of command device is included, which realizes in one flow of flow chart or multiple flows and/or one side of block diagram
The function of being specified in frame or multiple boxes.
These computer program instructions can be also loaded into computer or other programmable data processing terminal equipments so that
Series of operation steps is performed on computer or other programmable terminal equipments to generate computer implemented processing, thus
The instruction offer performed on computer or other programmable terminal equipments is used to implement in one flow of flow chart or multiple flows
And/or specified in one box of block diagram or multiple boxes function the step of.
Although the preferred embodiment of the embodiment of the present invention has been described, those skilled in the art once know base
This creative concept can then make these embodiments other change and modification.So appended claims are intended to be construed to
Including preferred embodiment and fall into all change and modification of range of embodiment of the invention.
Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by
One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation
Between there are any actual relationship or orders.Moreover, term " comprising ", "comprising" or its any other variant meaning
Covering non-exclusive inclusion, so that process, method, article or terminal device including a series of elements are not only wrapped
Those elements are included, but also including other elements that are not explicitly listed or are further included as this process, method, article
Or the element that terminal device is intrinsic.In the absence of more restrictions, it is wanted by what sentence "including a ..." limited
Element, it is not excluded that also there are other identical elements in the process including the element, method, article or terminal device.
Android device is based on to a kind of video call method based on Android device provided by the present invention and one kind above
Video call system, be described in detail, specific case used herein to the principle of the present invention and embodiment into
Elaboration is gone, the explanation of above example is only intended to help to understand the method and its core concept of the present invention；Meanwhile for this
The those skilled in the art in field, thought according to the invention, there will be changes in specific embodiments and applications,
In conclusion this specification content should not be construed as limiting the invention.
Claims (10)
1. a kind of video call method based on Android device, which is characterized in that the method is applied to regard in networking, the side
Method includes：
Gather video source data and audio source data；
The video source data and audio source data are encoded, are respectively formed the first video frame and the first audio frame；
First video frame and first audio frame are converted into the first data packet；
First data packet is sent to by multimedia server regarding networked server.
2. it according to the method described in claim 1, it is characterized in that, further includes：
Second data packet sent regarding networked server is received by the multimedia server；
Second data packet is parsed, generates the second video frame and the second audio frame；
Second video frame and second audio frame are decoded；
Second video frame and second audio frame after broadcast decoder.
3. according to the method described in claim 1, it is characterized in that, described pass through multimedia server by first data packet
The step of being sent to regarding networked server, including：
First data packet is sent to by the multimedia server by ICP/IP protocol；
The multimedia server is described regarding the Internet services by being sent to first data packet of reception depending on networking protocol
Device.
4. according to the method described in claim 2, it is characterized in that, described regard connection by the way that multimedia server reception is described
The step of the second data packet that network server is sent, including：
The multimedia server receives second data packet sent regarding networked server by regarding networking protocol；
Second data packet of the multimedia server transmission is received by ICP/IP protocol.
5. according to the method described in claim 1, it is characterized in that, described carry out the video source data and audio source data
The step of encoding, being respectively formed the first video frame and the first audio frame, including：
The video source data is encoded by H263 coding methods or H264 coding methods, forms the first video frame；
The audio source data is encoded, forms the first audio frame of AAC forms；The audio-source data format is PCM
Form.
6. according to the method described in claim 1, it is characterized in that, described pass through multimedia server by first data packet
It is sent to after the step of networked server, further includes：
First data packet sended over depending on the networked server reception multimedia server；
It is described to be converted to first data packet regarding networking data depending on networked server；
It is described to play out described be sent to depending on networking data depending on networked terminals depending on networked server.
7. a kind of video call system based on Android device, which is characterized in that the system is applied to regard in networking, including：
Android device, multimedia server and regarding networked server；The Android device connects the multimedia server, more matchmakers
The connection of body server is described to regard networked server；
The Android device includes：
Acquisition module, for gathering video source data and audio source data；
Coding module for being encoded to the video source data and audio source data, is respectively formed the first video frame and
One audio frame；
Modular converter, for first video frame and first audio frame to be converted to the first data packet；
First sending module, for being sent to first data packet regarding networked server by multimedia server.
8. system according to claim 7, which is characterized in that the Android device further includes：
First receiving module, for receiving second data sent regarding networked server by the multimedia server
Bag；
Parsing module for parsing second data packet, generates the second video frame and the second audio frame；
Decoder module, for being decoded to second video frame and second audio frame；
Playing module, for second video frame after broadcast decoder and second audio frame.
9. system according to claim 7, which is characterized in that the Android device is connected described more by ICP/IP protocol
Media server；By regarding, networking protocol connection is described to regard networked server to the multimedia server.
10. according to claim 7-9 any one of them systems, which is characterized in that the Android device includes mobile phone and tablet
Computer.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610983683.6A CN108063745B (en) | 2016-11-08 | 2016-11-08 | A kind of video call method and its system based on Android device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610983683.6A CN108063745B (en) | 2016-11-08 | 2016-11-08 | A kind of video call method and its system based on Android device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108063745A true CN108063745A (en) | 2018-05-22 |
| CN108063745B CN108063745B (en) | 2019-03-01 |
Family
ID=62137453
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610983683.6A Active CN108063745B (en) | 2016-11-08 | 2016-11-08 | A kind of video call method and its system based on Android device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108063745B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110087020A (en) * | 2019-04-30 | 2019-08-02 | 视联动力信息技术股份有限公司 | A kind of iOS device carries out the realization method and system of view networking meeting |
| CN110213235A (en) * | 2019-04-30 | 2019-09-06 | 视联动力信息技术股份有限公司 | The method and system of iOS device and view networked terminals video calling |
| CN110505204A (en) * | 2019-07-17 | 2019-11-26 | 视联动力信息技术股份有限公司 | A kind of immediate voice communication method, device, electronic equipment and readable storage medium storing program for executing |
| CN110611645A (en) * | 2018-06-15 | 2019-12-24 | 视联动力信息技术股份有限公司 | Communication method and system of video telephone |
| CN110740428A (en) * | 2018-07-18 | 2020-01-31 | 视联动力信息技术股份有限公司 | Data processing method and device for individual equipment |
| CN111669534A (en) * | 2020-04-28 | 2020-09-15 | 视联动力信息技术股份有限公司 | Communication method, first client and instant communication system |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080100694A1 (en) * | 2006-10-27 | 2008-05-01 | Microsoft Corporation | Distributed caching for multimedia conference calls |
| CN101610455A (en) * | 2009-07-16 | 2009-12-23 | 中兴通讯股份有限公司 | Realize the method and system of member management in a kind of wireless video conference |
| US20100149301A1 (en) * | 2008-12-15 | 2010-06-17 | Microsoft Corporation | Video Conferencing Subscription Using Multiple Bit Rate Streams |
| CN101984728A (en) * | 2010-10-22 | 2011-03-09 | 惠州Tcl移动通信有限公司 | Method and visual communication terminal for achieving visual conversation based on bluetooth earphone |
| CN102215371A (en) * | 2010-04-02 | 2011-10-12 | 宁波Gqy视讯股份有限公司 | Coded orthogonal frequency division multiplexing (COFDM)-technology-based wireless mobile video conference system |
| CN102325246A (en) * | 2011-10-18 | 2012-01-18 | Tcl集团股份有限公司 | Video conference system as well as video conference server and mobile communication terminal |
| US20120105571A1 (en) * | 2009-07-16 | 2012-05-03 | Zte Corporation | System and Method for Realizing Wireless Video Conference |
| CN102611871A (en) * | 2012-01-13 | 2012-07-25 | 深圳市同洲电子股份有限公司 | Method, system and mobile terminal for video communication and digital television receiving terminal |
| CN103686072A (en) * | 2013-11-15 | 2014-03-26 | 北京视联动力国际信息技术有限公司 | Video internet video monitoring method and system, protocol conversion server, and video internet server |
| CN103701658A (en) * | 2013-11-18 | 2014-04-02 | 北京视联动力国际信息技术有限公司 | Network condition testing method and device for articulated naturality web |
| CN104270597A (en) * | 2010-04-07 | 2015-01-07 | 苹果公司 | Establishing A Video Conference During A Phone Call |
| CN105024868A (en) * | 2014-04-17 | 2015-11-04 | 北京视联动力国际信息技术有限公司 | Network quality detection method and network quality detection system for video Internet |
| CN205142396U (en) * | 2015-10-27 | 2016-04-06 | 邦彦技术股份有限公司 | Desk -top meeting equipment of portable audio frequency and video and system |
-
2016
- 2016-11-08 CN CN201610983683.6A patent/CN108063745B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080100694A1 (en) * | 2006-10-27 | 2008-05-01 | Microsoft Corporation | Distributed caching for multimedia conference calls |
| US20100149301A1 (en) * | 2008-12-15 | 2010-06-17 | Microsoft Corporation | Video Conferencing Subscription Using Multiple Bit Rate Streams |
| US20120105571A1 (en) * | 2009-07-16 | 2012-05-03 | Zte Corporation | System and Method for Realizing Wireless Video Conference |
| CN101610455A (en) * | 2009-07-16 | 2009-12-23 | 中兴通讯股份有限公司 | Realize the method and system of member management in a kind of wireless video conference |
| CN102215371A (en) * | 2010-04-02 | 2011-10-12 | 宁波Gqy视讯股份有限公司 | Coded orthogonal frequency division multiplexing (COFDM)-technology-based wireless mobile video conference system |
| CN104270597A (en) * | 2010-04-07 | 2015-01-07 | 苹果公司 | Establishing A Video Conference During A Phone Call |
| CN101984728A (en) * | 2010-10-22 | 2011-03-09 | 惠州Tcl移动通信有限公司 | Method and visual communication terminal for achieving visual conversation based on bluetooth earphone |
| CN102325246A (en) * | 2011-10-18 | 2012-01-18 | Tcl集团股份有限公司 | Video conference system as well as video conference server and mobile communication terminal |
| CN102611871A (en) * | 2012-01-13 | 2012-07-25 | 深圳市同洲电子股份有限公司 | Method, system and mobile terminal for video communication and digital television receiving terminal |
| CN103686072A (en) * | 2013-11-15 | 2014-03-26 | 北京视联动力国际信息技术有限公司 | Video internet video monitoring method and system, protocol conversion server, and video internet server |
| CN103701658A (en) * | 2013-11-18 | 2014-04-02 | 北京视联动力国际信息技术有限公司 | Network condition testing method and device for articulated naturality web |
| CN105024868A (en) * | 2014-04-17 | 2015-11-04 | 北京视联动力国际信息技术有限公司 | Network quality detection method and network quality detection system for video Internet |
| CN205142396U (en) * | 2015-10-27 | 2016-04-06 | 邦彦技术股份有限公司 | Desk -top meeting equipment of portable audio frequency and video and system |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110611645A (en) * | 2018-06-15 | 2019-12-24 | 视联动力信息技术股份有限公司 | Communication method and system of video telephone |
| CN110611645B (en) * | 2018-06-15 | 2022-02-22 | 视联动力信息技术股份有限公司 | Communication method and system of video telephone |
| CN110740428A (en) * | 2018-07-18 | 2020-01-31 | 视联动力信息技术股份有限公司 | Data processing method and device for individual equipment |
| CN110740428B (en) * | 2018-07-18 | 2022-06-07 | 视联动力信息技术股份有限公司 | Data processing method and device for individual equipment |
| CN110087020A (en) * | 2019-04-30 | 2019-08-02 | 视联动力信息技术股份有限公司 | A kind of iOS device carries out the realization method and system of view networking meeting |
| CN110213235A (en) * | 2019-04-30 | 2019-09-06 | 视联动力信息技术股份有限公司 | The method and system of iOS device and view networked terminals video calling |
| CN110505204A (en) * | 2019-07-17 | 2019-11-26 | 视联动力信息技术股份有限公司 | A kind of immediate voice communication method, device, electronic equipment and readable storage medium storing program for executing |
| CN111669534A (en) * | 2020-04-28 | 2020-09-15 | 视联动力信息技术股份有限公司 | Communication method, first client and instant communication system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108063745B (en) | 2019-03-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108234421B (en) | A kind of method and system regarding networked terminals and the intercommunication of internet terminal audio data | |
| CN108121588B (en) | A kind of method and its view networking access server of access external resource | |
| CN108063741A (en) | A kind of transport protocol conversion method and apparatus | |
| CN108063745B (en) | A kind of video call method and its system based on Android device | |
| CN108173804A (en) | It is a kind of to access the method for internet and regarding connection cat client by regarding networking | |
| CN108243153A (en) | A kind of method and apparatus in the broadcasting TV programme in networking | |
| CN108243173A (en) | A kind of RTMP video pushing methods and device based on regarding networking | |
| CN108810456A (en) | A kind of monitoring video flow transfers method and system | |
| CN107959819A (en) | A kind of method and apparatus for realizing video conferencing system Dispatching monitor and control system | |
| CN108206911A (en) | A kind of camera long-range control method and association turn server | |
| CN108462727A (en) | A kind of data transmission method and device | |
| CN108124165A (en) | A kind of code stream recording method and its system based on regarding networking | |
| CN108616328A (en) | A kind of audio/video flow loss recovery method and audio/video flow transmitting terminal and receiving terminal | |
| CN108173895A (en) | A kind of communication means and device | |
| CN108881135A (en) | It is a kind of based on view networking information transferring method, device and system | |
| CN108989078A (en) | A kind of view networking interior joint equipment fault detection method and device | |
| CN108632559A (en) | A kind of video data handling procedure and device | |
| CN108111474A (en) | A kind of sound mixing method and device | |
| CN107888401A (en) | A kind of method and system of the monitoring regarding networked terminals cpu busy percentage in real time | |
| CN108616487A (en) | Based on the sound mixing method and device regarding networking | |
| CN109547163A (en) | A kind of control method and device of message transmission rate | |
| CN110049346A (en) | A kind of method and system of net cast | |
| CN108809921A (en) | A kind of audio-frequency processing method regards networked server and regards networked terminals | |
| CN108243343A (en) | A kind of point bit distribution statistical method and its server based on regarding networking | |
| CN109151610A (en) | A kind for the treatment of method and apparatus receiving web camera picture |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 100000 Dongcheng District, Beijing, Qinglong Hutong 1, 1103 house of Ge Hua building. Applicant after: Video Link Power Information Technology Co., Ltd. Address before: 100000 Beijing Dongcheng District gogoa building A1103-1113 Applicant before: BEIJING VISIONVERA INTERNATIONAL INFORMATION TECHNOLOGY CO., LTD. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20201230 Address after: 570105 room 1201, Central International Plaza, 77 Binhai street, Longhua District, Haikou City, Hainan Province Patentee after: Hainan Qiantang Shilian Information Technology Co.,Ltd. Address before: 100000 Dongcheng District, Beijing, Qinglong Hutong 1, 1103 house of Ge Hua building. Patentee before: VISIONVERA INFORMATION TECHNOLOGY Co.,Ltd. |
|
| TR01 | Transfer of patent right |