CN106534756A - Mobile terminal real-time video and audio communication control system and method - Google Patents

Mobile terminal real-time video and audio communication control system and method Download PDF

Info

Publication number
CN106534756A
CN106534756A CN201610934981.6A CN201610934981A CN106534756A CN 106534756 A CN106534756 A CN 106534756A CN 201610934981 A CN201610934981 A CN 201610934981A CN 106534756 A CN106534756 A CN 106534756A
Authority
CN
China
Prior art keywords
video
mobile terminal
control centre
audio
audio signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610934981.6A
Other languages
Chinese (zh)
Inventor
罗承志
汪义臣
罗志红
黄旭源
杜刚
龙磊明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ling Ke Science And Technology Ltd Of Shenzhen
Original Assignee
Ling Ke Science And Technology Ltd Of Shenzhen
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ling Ke Science And Technology Ltd Of Shenzhen filed Critical Ling Ke Science And Technology Ltd Of Shenzhen
Priority to CN201610934981.6A priority Critical patent/CN106534756A/en
Publication of CN106534756A publication Critical patent/CN106534756A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • H04N7/152Multipoint control units therefor

Abstract

The invention discloses a mobile terminal real-time video and audio communication control system and method. The system comprises a mobile terminal which is provided with a video and audio encoding module used for encoding acquired video and audio signals; a control center which is provided with a codec used for outputting the video and audio information after the received video and audio information is decoded and a forwarding module used for forwarding the received video and audio information; and a cloud server which is provided with a user management module, a mobile terminal equipment management module and a PTP server and is connected and communicates with the mobile terminal and the control center through a network, wherein the mobile terminal and the control center obtain IP addresses of each other and correlation information through the PTP server and realize direct communication. According to the invention, the mobile terminal can be taken as a video and audio source and a forwarding device for performing real-time video and audio interaction with the control center, the system is simple, and the practicality is high.

Description

A kind of real-time video and audio communication control system of mobile terminal and method
Technical field
The present invention relates to video and audio frequency technology applications field, more particularly to a kind of real-time video and audio communication control system of mobile terminal and Method.
Background technology
In the today's society that information technology is flourishing, mobile terminal has been requisite instrument in people's daily life, and Carry out implementing video and audio communication being the daily conventional means with people's communication exchange of people using mobile terminal.And current various security protections Also overall application, in various places, for these control centres, is needed for the control centres such as monitoring, video and audio intercommunication, Real-Time Scheduling Special photographic head is wanted as video and audio source etc., and these photographic head often fixation is immovable, and can not be with other Control centre and video terminal realize real-time information transmission mutual etc..At present, mobile terminal safety monitoring, video and audio intercommunication, There are many limitation in application in the control centres such as Real-Time Scheduling, sound can only be regarded to control centre's transmission by hardware device Frequency evidence, mobile terminal cannot captured in real-time video and audio is transmitted to control centre as video and audio input source, it is impossible to control Center carries out implementation information mutually, and mobile terminal also cannot be as forwarding unit in the controlling between the heart and other mobile terminals Carry out video/audio transmission.
The content of the invention
The purpose of the present invention is the defect existed for above-mentioned prior art, there is provided a kind of real-time video and audio of mobile terminal is led to News control system and method.
The real-time video and audio communication control system of mobile terminal that the present invention is provided includes:Mobile terminal, is provided with video and audio volume Code module, for the video/audio signal for collecting is encoded;Control centre, be provided with codec, for receiving Audiovisual information is exported after being decoded;And forwarding module, for the audiovisual information for receiving is forwarded;Cloud service Device, is provided with user management module, mobile terminal device management module and PTP servers, by network and mobile terminal and control Center connection communication, mobile terminal and control centre obtain the IP address and relevant information of other side by PTP servers and realize Direction communication.
The control centre is provided with mosaic screen, and the video/audio signal of the codec decoding sends to mosaic screen and shows.
The forwarding module of the control centre is forwarded to one or more terminal units simultaneously by adaptive routing algorithm Real-time video and audio is carried out, the real-time intercommunication and scheduling of control centre and multiple terminal devices is realized.
Described mobile terminal also includes forwarding module, for will collect or the video/audio signal that receives to one or Multiple mobile terminals are forwarded.
Present invention also offers a kind of real-time video and audio communicating control method of mobile terminal, comprises the following steps:
Step 1:Mobile terminal gathers video/audio signal, and the video/audio signal is compiled by video encoding module Code;
Step 2:Cloud Server is set up, user management module, mobile terminal device management module and PTP are set in Cloud Server Server, is obtained by PTP servers with mobile terminal and control centre's connection communication, mobile terminal and control centre by network The IP address and relevant information for obtaining other side realizes direction communication;
Step 3:Control centre receives the video/audio signal that mobile terminal sends, and will be received by the codec of control centre Video/audio signal decoding after output and/or forward.
Step 4:The mosaic screen of the control centre receives the video/audio signal of the codec decoding and shows.
Step 5:Video/audio signal is forwarded to one or more by adaptive routing algorithm by the control centre simultaneously Terminal unit carries out real-time video and audio, realizes the real-time intercommunication and scheduling of control centre and multiple terminal devices.
Described mobile terminal also includes collecting or the video/audio signal that receives is to one or more mobile terminals Forwarded.
Described control centre is Surveillance center or command centre or control centre or conference system.
Compared with prior art, the invention has the beneficial effects as follows:
1st, mobile terminal can transmit video and audio to control centre and stored or solved as a video and audio input source in real time Code shows;
2nd, mobile terminal can carry out real time information simultaneously mutually as an intercommunication or controlling equipment and control centre;
3rd, relative to the system such as traditional safety monitoring and intercommunication, scheduling, the system without the need for special equipment, general mobile phone, flat board Computer just can the information exchange function such as video and audio in real time;In some special occasions, not imaging first-class occasion can also be real Existing video and audio real-time Transmission and monitoring and scheduling etc.;
4th, the system video and audio transmission directly communicates information to equipment using PTP modes, i.e. equipment, it is not necessary to through server Transfer, has saved server input and bandwidth requirement, meanwhile, good economy performance, effect are good;
5th, while mobile terminal is as video/audio signal collection terminal, it is also possible to as the transfer end of signal transmission, so, just non- The bandwidth resources of often big saving, meanwhile, allowing is having very many users to need while when seeing same video/audio signal, being not required to All all stream taken from some equipment simultaneously, and directly can take stream from neighbouring equipment, can really realize much larger number The video and audio transmission of scale, realizes the work such as ultra-large video conference, teaching.
Description of the drawings
Fig. 1 is the real-time video and audio communication control system structural representation of mobile terminal of the present invention;
System structure diagrams of the Fig. 2 for the embodiment of the present invention one;
System structure diagrams of the Fig. 3 for the embodiment of the present invention two;
Fig. 4 is an optimum binary tree schematic diagram of adaptive routing algorithm of the present invention;
System structure diagrams of the Fig. 5 for the embodiment of the present invention three;
Fig. 6 is the flow chart of the real-time video and audio communicating control method of mobile terminal of the present invention.
Specific embodiment
With reference to the accompanying drawings and examples invention is described in detail.
As shown in figure 1, the real-time video and audio communication control system of mobile terminal that the present invention is provided includes:Mobile terminal, if There is video encoding module, for the video/audio signal for collecting is encoded;Control centre, is provided with codec, is used for Export after the audiovisual information for receiving is decoded;And forwarding module, for the audiovisual information for receiving is carried out turning Send out;Cloud Server, is provided with user management module, mobile terminal device management module and PTP servers, whole with mobile by network End and control centre's connection communication, mobile terminal and control centre obtain the IP address of other side and related letter by PTP servers Cease and realize direction communication.
Mobile terminal is connected to network, such as LAN or the Internet etc. by various ways such as WIFI or GRPS or bluetooths, Mobile terminal is generally without fixed ip address;Control centre passes through wired by the character matrix that some codecs are constituted The modes such as LAN or wireless WIFI are connected to network, and generally, character matrix is connected to LAN, then is connected by router The Internet is connected to, equipment is typically without fixed ip address;Cloud Server can be trust server in machine room, have fixed IP, or Using virtual server, there is fixed ip address, or have fixed domain name, dynamic IP is resolved to by DDNS server.So move Dynamic terminal and control centre reach intercommunication by network and server.
Mobile terminal is transmitted video/audio signal to control centre or control centre as signal input part collection video and audio Etc. the working method passed to mobile terminal:
1st step:Mobile terminal passes through device management server of the network connection in Cloud Server and logs in registration, at this moment cloud clothes Just already registered with the IP address and relevant information for getting well mobile terminal in device;
2nd step:By network connection is to Cloud Server and is registered, at this moment, cloud takes device just volume solution to codec The IP address and relevant information of code device;
3rd step:The list of devices of mobile terminal accessing Cloud Server, obtains IP address or the other information of codec, then Directly connection request is sent to the corresponding equipment of the IP address of codec, set up a communication channel in request by after; Or it is reverse, codec sends to mobile terminal and asks and be attached;
4th step:Mobile terminal directly sends audio frequency and video to codec by communication channel after local video and audio is encoded Stream or audio-video document;
5th step:Codec directly sends audio frequency and video to mobile terminal, to realize that real-time audio and video is interacted.
Embodiment 1
As shown in Fig. 2 in the real-time video and audio communication control system of mobile terminal of the present embodiment offer, control centre is additionally provided with spelling Screen is connect, the video/audio signal of codec decoding can send to mosaic screen and be shown.
The present embodiment realizes the video and audio of mobile terminal device and is displayed on the mosaic screen of control centre.
Embodiment 2
As shown in figure 3, in the real-time video and audio communication control system of mobile terminal of the present embodiment offer, mobile terminal device is provided with 2 or more than 2, each mobile terminal is by network and server and control centre's connection communication.The forwarding mould of control centre Block is simultaneously forwarded to one or more terminal units by adaptive routing algorithm and carries out real-time video and audio, realize control centre with The real-time intercommunication of multiple terminal devices and scheduling.Each mobile terminal also includes forwarding module, for collecting or receiving Video/audio signal is forwarded to one or more mobile terminals.The present embodiment realizes control centre in real time and multiple mobile whole End carries out real-time audio and video intercommunication and scheduling.
Control centre receives the video/audio signal that mobile terminal sends, and will be received by the codec of control centre Output and/or forwarding after video/audio signal decoding.As shown in figure 4, the adaptive routing algorithm that the present invention is used is specific as follows:
A, B, C, D, E, F, G represent mobile terminal device, and arbitrary equipment is both receiving side signal, while and can be used as signal Forwarding side.
As B, C, D, E, F, G equipment will receive the information of A equipment, according to situations such as Internet resources, arbitrary equipment simultaneously After the information for receiving A equipment, any other equipment can be transmitted to, such as above-mentioned B device is transmitted to F, G after information is received Equipment, G equipment are transmitted to E equipment after information is received, and C equipment is transmitted to D equipment after A facility informations are received.
Specifically forwarding principle is:When an equipment needs to receive another equipment, the equipment can be first tested through all The path of information transmitting terminal equipment is likely to be breached, sees that the time of which paths is most short, meanwhile, according to the resource occupation of respective equipment Situation, automatically selects and is forwarded by which equipment.As E equipment will receive A facility informations, according to algorithm, it is determined that resource ratio In the case of example optimum, forward from A through B again and win the confidence breath through G forwardings, G, realize optimization security.
Embodiment 3
As shown in figure 5, the real-time video and audio communication control system of mobile terminal that the present embodiment is provided can realize mobile terminal simultaneously The video and audio of equipment is displayed on the mosaic screen of control centre, and the real-time and multiple mobile terminal of control centre carries out real-time sound and regards Frequency intercommunication and scheduling.
Fig. 6 is the flow chart of the real-time video and audio communicating control method of mobile terminal that the present invention is provided, and is specifically included following Step:
Step 1:Mobile terminal gathers video/audio signal, and the video/audio signal is compiled by video encoding module Code;
Step 2:Cloud Server is set up, user management module, mobile terminal device management module and PTP are set in Cloud Server Server, is obtained by PTP servers with mobile terminal and control centre's connection communication, mobile terminal and control centre by network The IP address and relevant information for obtaining other side realizes direction communication;
Step 3:Control centre receives the video/audio signal that mobile terminal sends, and will be received by the codec of control centre Video/audio signal decoding after output and/or forward.
The real-time video and audio communicating control method of mobile terminal that embodiment 1 is provided is further comprising the steps of:
Step 4:The mosaic screen of control centre receives the video/audio signal of the codec decoding and shows.
The real-time video and audio communicating control method of mobile terminal that embodiment 2 is provided is further comprising the steps of:
Step 5:Video/audio signal is forwarded to one or more terminal units by adaptive routing algorithm by control centre simultaneously Real-time video and audio is carried out, the real-time intercommunication and scheduling of control centre and multiple terminal devices is realized.
Wherein, mobile terminal also includes entering the video/audio signal for collecting or receive to one or more mobile terminals Row forwarding.
The real-time video and audio communicating control method of mobile terminal that embodiment 3 is provided is further comprising the steps of:
Step 4:The mosaic screen of control centre receives the video/audio signal of the codec decoding and shows;
Step 5:Video/audio signal is forwarded to one or more terminal units by adaptive routing algorithm by control centre simultaneously Real-time video and audio is carried out, the real-time intercommunication and scheduling of control centre and multiple terminal devices is realized.
Described control centre can be Surveillance center or command centre or control centre or conference system.
Mobile terminal of the present invention can be used as a video and audio input source, and transmitting video and audio to control centre in real time is carried out Storage decodes display;Mobile terminal can carry out real time information simultaneously mutually as an intercommunication or controlling equipment with control centre; Relative to the system such as traditional safety monitoring and intercommunication, scheduling, without the need for special equipment, general mobile phone, panel computer are just for the system Can the information exchange function such as video and audio in real time;In some special occasions, do not image first-class occasion and can also realize regarding sound Frequency real-time Transmission and monitoring and scheduling etc.;The transmission of the system video and audio directly communicates information to set using PTP modes, i.e. equipment It is standby, it is not necessary to through transit server, server input and bandwidth requirement has been saved, meanwhile, good economy performance, effect are good;It is mobile While terminal is as video/audio signal collection terminal, it is also possible to as the transfer end of signal transmission, so, just very big saving Bandwidth resources, meanwhile, allowing is having very many users to need while when seeing same video/audio signal, it is not necessary to which whole is simultaneously All take stream from some equipment, and directly can take stream from neighbouring equipment, can really realize much larger number scale regarding sound Keep pouring in defeated, realize the work such as ultra-large video conference, teaching.
Above-described embodiment is merely to illustrate the specific embodiment of the present invention.It should be pointed out that general for this area For logical technical staff, without departing from the inventive concept of the premise, some deformations and change can also be made, these deformation and Change should all belong to protection scope of the present invention.

Claims (10)

1. the real-time video and audio communication control system of a kind of mobile terminal, it is characterised in that include:
Mobile terminal, is provided with video encoding module, for the video/audio signal for collecting is encoded;
Control centre, is provided with codec, for exporting after the audiovisual information for receiving is decoded;And forwarding module, For the audiovisual information for receiving is forwarded;
Cloud Server, is provided with user management module, mobile terminal device management module and PTP servers, by network and movement Terminal and control centre's connection communication, mobile terminal and control centre obtain the IP address of other side and related by PTP servers Information simultaneously realizes direction communication.
2. the system as claimed in claim 1, it is characterised in that the control centre is provided with mosaic screen, the codec solution The video/audio signal of code sends to mosaic screen and shows.
3. the system as claimed in claim 1, it is characterised in that the forwarding module of the control centre is calculated by self adaptation route Method is forwarded to one or more terminal units simultaneously and carries out real-time video and audio, realizes that control centre is real-time with multiple terminal devices Intercommunication and scheduling.
4. the system as claimed in claim 1, it is characterised in that described mobile terminal also includes forwarding module, for adopting The video/audio signal for collecting or receiving is forwarded to one or more mobile terminals.
5. the system as claimed in claim 1, it is characterised in that described control centre is Surveillance center or command centre or tune Degree center or conference system.
6. the real-time video and audio communicating control method of a kind of mobile terminal, it is characterised in that comprise the following steps:
Step 1:Mobile terminal gathers video/audio signal, and the video/audio signal is compiled by video encoding module Code;
Step 2:Cloud Server is set up, user management module, mobile terminal device management module and PTP are set in Cloud Server Server, is obtained by PTP servers with mobile terminal and control centre's connection communication, mobile terminal and control centre by network The IP address and relevant information for obtaining other side realizes direction communication;
Step 3:Control centre receives the video/audio signal that mobile terminal sends, and will be received by the codec of control centre Video/audio signal decoding after output and/or forward.
7. method as claimed in claim 6, it is characterised in that comprise the following steps:
Step 4:The mosaic screen of the control centre receives the video/audio signal of the codec decoding and shows.
8. method as claimed in claim 6, it is characterised in that further comprising the steps of:
Step 5:Video/audio signal is forwarded to one or more terminals by adaptive routing algorithm by the control centre simultaneously Equipment carries out real-time video and audio, realizes the real-time intercommunication and scheduling of control centre and multiple terminal devices.
9. method as claimed in claim 6, it is characterised in that described mobile terminal also includes to collect or receiving Video/audio signal is forwarded to one or more mobile terminals.
10. method as claimed in claim 6, it is characterised in that described control centre be Surveillance center or command centre or Control centre or conference system.
CN201610934981.6A 2016-11-01 2016-11-01 Mobile terminal real-time video and audio communication control system and method Pending CN106534756A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610934981.6A CN106534756A (en) 2016-11-01 2016-11-01 Mobile terminal real-time video and audio communication control system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610934981.6A CN106534756A (en) 2016-11-01 2016-11-01 Mobile terminal real-time video and audio communication control system and method

Publications (1)

Publication Number Publication Date
CN106534756A true CN106534756A (en) 2017-03-22

Family

ID=58291871

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610934981.6A Pending CN106534756A (en) 2016-11-01 2016-11-01 Mobile terminal real-time video and audio communication control system and method

Country Status (1)

Country Link
CN (1) CN106534756A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107395413A (en) * 2017-07-19 2017-11-24 湖南竞投智能信息技术有限公司 A kind of real-time rescue based on audio frequency and video, processing and scheduling system
TWI817148B (en) * 2021-06-24 2023-10-01 創意門有限公司 Vehicle multi-point long-distance real-time information recording system and method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1633109A (en) * 2005-01-20 2005-06-29 杨金钰 A flow media system
CN102065264A (en) * 2009-11-18 2011-05-18 深圳市邦彦信息技术有限公司 Video command/session system without MCU and method
US20110242270A1 (en) * 2010-03-31 2011-10-06 David Dinka Television set
CN102404538A (en) * 2010-09-07 2012-04-04 瞿初 Security system for mobile phone video and visual call based on three generation (3G)
CN103313021A (en) * 2012-03-08 2013-09-18 上海阅维信息科技有限公司 Wireless video/audio real-time transmission system of P2P transmission type
CN104639730A (en) * 2013-11-15 2015-05-20 上海信游网络科技有限公司 Mobile phone media interaction platform based on 3G network

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1633109A (en) * 2005-01-20 2005-06-29 杨金钰 A flow media system
CN102065264A (en) * 2009-11-18 2011-05-18 深圳市邦彦信息技术有限公司 Video command/session system without MCU and method
US20110242270A1 (en) * 2010-03-31 2011-10-06 David Dinka Television set
CN102404538A (en) * 2010-09-07 2012-04-04 瞿初 Security system for mobile phone video and visual call based on three generation (3G)
CN103313021A (en) * 2012-03-08 2013-09-18 上海阅维信息科技有限公司 Wireless video/audio real-time transmission system of P2P transmission type
CN104639730A (en) * 2013-11-15 2015-05-20 上海信游网络科技有限公司 Mobile phone media interaction platform based on 3G network

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107395413A (en) * 2017-07-19 2017-11-24 湖南竞投智能信息技术有限公司 A kind of real-time rescue based on audio frequency and video, processing and scheduling system
TWI817148B (en) * 2021-06-24 2023-10-01 創意門有限公司 Vehicle multi-point long-distance real-time information recording system and method

Similar Documents

Publication Publication Date Title
US9077851B2 (en) Transmission terminal, transmission system, display control method, and recording medium storing display control program
RU2662731C2 (en) Server node arrangement and method
CN109640029B (en) Method and device for displaying video stream on wall
US7996540B2 (en) Method and system for replacing media stream in a communication process of a terminal
CN109309806B (en) Video conference management method and system
RU2012147842A (en) METHOD FOR MANAGING CONFERENCE COMMUNICATION AND RELATED DEVICE AND SYSTEM
CN109714527B (en) Method and device for controlling video network camera in internet
US20070112971A1 (en) Real time video streaming and data collaboration over wireless networks
KR20060135564A (en) Interactive news gathering and media production control system
CN101110811A (en) Method for controlling media data transmission of video system
CN111225230A (en) Management method and related device for network live broadcast data
CN109547731B (en) Video conference display method and system
WO2016184001A1 (en) Video monitoring processing method and apparatus
CN110572607A (en) Video conference method, system and device and storage medium
US8872886B2 (en) Method, apparatus, and system for establishing multi-cascade channel
Xue et al. A WebRTC-based video conferencing system with screen sharing
CN109698818B (en) Method and device for acquiring online user and cross-streaming media communication
CN109525663B (en) Video data display method and system
CN106534756A (en) Mobile terminal real-time video and audio communication control system and method
CN112770078B (en) Video conference terminal fusion method and device and readable storage medium
CN112752058B (en) Method and device for adjusting attribute of video stream
CN110049100B (en) Service data processing method and system
CN110830763A (en) Monitoring video inspection method and device
CN111131751A (en) Information display method and system for video networking conference
CN110049069B (en) Data acquisition method and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20170322

RJ01 Rejection of invention patent application after publication