Pattern of fusion network media phone set terminal
Technical field
The utility model relates to the network information terminal in converged communication field, converged communication is under the integrated framework of " terminal+service ", its network service, professional providing capability are finally rendered on the network media phone set terminal according to operation mode end to end, offer the user and use.Pattern of fusion network media phone set terminal, it also is the information terminal of the integration of three networks, especially expansion supports many net IP to insert the converged communication terminal of environment, UMS, 3G intercommunication, P2P, WebCall function, and increases application and the method to set up that the indoor wireless composite aircraft provides remotely controlling functional.
Background technology
Merge the main trend that has become the information industry development, information industry is faced with new fusion general layout: promptly from the single industrial chain structure of ICT (Informationand Communication Technology), progressively to TIME (Telecom, Internet, Media andEntertainment) transformation of the multiple ecosystem of type.Industry also begins progressively to realize comprehensive fusion with informationization.In the near future, telecommunication industry (T), Internet industry (I), medium industry (M), entertainment industry (E) will produce tremendous influence each other, and be fused to new " TIME " ecosystem.
For the fixed network operator, the development of fusion can realize by the transformation of traditional operation field to information service industry; In the consumer market, huge transformation has taken place in the main composition of fixed network consumption in recent years: the serious atrophy of the ratio of traditional voice transmission, and the ratio rapid growth of new business such as broadband, multimedia consumption.Shift from consumption and to analyze, the home entertaining content service of high value and network commercial are used has had the potentiality of bringing huge income for operator, is carried on the main composition that the new consumption of pattern of fusion multimedia on the fixed network will become its income.Face in whole information industry under the overall situation of transition, one of emphasis that but the service features that across a network multimedia integration service feature that the converged communication theory is brought and management and control can be runed is the fixed network operator to be paid close attention to, and the converged communication business can be opened the key of general marketplace just, and its " convenience ", " connectivity " and " economical and efficient " make various fusion new business that more wide spreader meeting arranged.This will help the fixed network operator to improve income, reduce churn rate.
ZL200620035597.4 has announced a kind of utility model Embedded Intelligent Terminal.The technical problem that solves is: a kind of Embedded Intelligent Terminal is provided, digital TV set-top box commonly used, PVR is concentrated be one.The technical scheme that is adopted is: Embedded Intelligent Terminal comprises digital signal channel decoder, analog signal tuner, Video Decoder, audio A/D transducer, System on Chip/SoC, video coding chip, audio D/A converter, hard disk, pci bus; Digital signal decoder links to each other with System on Chip/SoC; The analog signal tuner links to each other with System on Chip/SoC by Video Decoder, audio A/D transducer respectively; Video coding chip, audio D/A converter link to each other with System on Chip/SoC respectively; Hard disk links to each other with System on Chip/SoC by pci bus.The beneficial effects of the utility model are: incorporate Embedded Intelligent Terminal, reduced in the prior art line complicated between the various device, and maximally utilise Device element.But such scheme is only to relate to Digital Television, does not relate to integration of three networks field.
ZL200410056537.6 has announced a kind of P2P communication means of carrying out in user terminal, comprise step: send a P2P communication service registration request message to a communications network system; Receive the P2P communication service registration confirmation message that this communications network system sends, comprise a P2P communication discriminating code that is used in this user terminal of sign in the off-line P2P communication in this acknowledge message at least; Store the P2P communication discriminating code of this user terminal.The P2P communication means of carrying out in communications network system comprises step: receive the P2P communication service registration request message that this user terminal sends; According to this request message, generate the P2P communication discriminating code of this user terminal; With send the P2P communication service registration confirmation message to this user terminal.But this patent has proposed the implementation model of P2P communication service.
ZL200420078125.8 and 200410041521.8 has announced a kind of network media phone set terminal and application and communication means, three separate processor are arranged, handle sound for one, handle video for one, the another one application processor is finished user interface interaction and Equipment Control function.Audio coder ﹠ decoder (codec), data processing unit, multi-medium data multiplex/demultiplex unit and network communication interface unit etc. are as DSP ancillary equipment device.
Network media phone set terminal design based on the DSP scheme has certain advantage on the algorithm of audio/video encoding/decoding, but supports operating system relatively poor, is unfavorable for adding new application such as converged communication; Based on the scheme of CPU then development agreement and new application the comparatively simply, the algorithm aspect then a little less than.The DSP scheme can realize high performance system, but the complexity of solution and cost are too high.Terminal comprises phone module and target called number is mapped as the IP phone module that corresponding gateway ip address carries out the VoIP communication, and be provided with pci bus, on pci bus, be provided with the voice/multimedia processor of Ethernet interface and CPU control, on described processing module, connect media port by the D/A conversion, be provided with professional embedded type CPU, has the ICP/IP protocol stack, the RTP of transport stream medium, the soft switch center of terminal and IP based network is carried out synchronous and asynchronous interactive communication, and provide corresponding business use to support by IP call center's platform based on the call treatment mode, by SIP communications protocol and pstn signaling, support the communication of stream media format and voice.Have the phone function: video telephone is supported in expansion; Multimedia function: online support television set, sound equipment etc.Development along with the integration of three networks and intelligence communication business, the ability that above-mentioned terminal is demanded urgently strengthening is that additional technical support need be provided the realization of converged communication business, as: the IP communications switching unit of supporting the existing general access way of three nets, digital high-definition television receives, video compression technology H.264, wideband audio (G.729x), UMS, 3G intercommunication, multi-party communication function and the application of peer-to-peer network technology etc., to improve user experience, this is that it is worth further improving improvements.
Demand is exactly the fusion of terminal for ordinary consumer! The user is indifferent to and adopts whose network insertion, but wishes AllinOne---1 complete equipment, 1 remote controller, 1 part of bill, and just can be seeing TV, surf the Net, make a phone call and other information services completely solve that this is the real demand place of user.Support that the terminal of converged communication business is a kind of product of networking, representing the theory of network calculations and resource-sharing.Merge the strategy thinking of evolution from three network services: under the background of fixed network IPization, be only to need personalized, large and complete Personal Computer (PC) terminal, still need a kind ofly can bring into play network integration advantage, make full use of the economical and practical again class PC terminal of Internet resources?
Under the promotion of converged communication technical development, the demand that people experience for terminal traffic also is excited, thereby further developing of technology produced new demand, and the basic ideas of converged communication are that user's request is divided into two classes: primary demand and specific (special) requirements.Divide operand big little in the primary demand again with operand.Allow the function that terminal this locality provides in the primary demand needs to consume a large amount of calculatings/disposal abilities (such as the audio and video stream media processing etc.), at this moment the terminal role that takes on conventional PC/ STB terminal; For little (such as the phone, transmitting-receiving Email/ message etc.) of some operands or some special functions, then by finish the role that this moment, terminal was taken on conventional communicating terminal with central platform is collaborative.Pattern of fusion network media phone set terminal will be the perfect adaptation of set-top box and IP phone, possess the ability of supporting that converged communication is used.
If pattern of fusion network media phone set terminal has possessed the processing capacity of converged communication business, the fixed network operator just can be in conjunction with its other resources advantage so, quicken to release pattern of fusion new business, for the user, possessing under the environment of broadband IP network, by pattern of fusion network media phone set terminal, the converged communication service that just can obtain to enrich.
Summary of the invention
The purpose of this utility model is: the H.264 pattern of fusion network media phone set terminal based on SIP is provided, mutual and communication process with inter-network voice, data, video fused business, and the unified abstract message body encapsulation that becomes based on converged communication of interactive information, control, state or the like, and the business and the technical interface of standard are provided, support converged communication for terminal the additional technology model of communication protocol and audio/video encoding/decoding is provided; The purpose of this utility model also is: with the converged communication service abstraction is unified message body, with mutual, finish information visit and communication between terminal and converged communication central platform according to the unified realization conversion of number parsing carrying out message body between different client's pattern of fusion network media phone set terminals simultaneously
The utility model purpose also is to provide a kind of and utilizes embedded software to realize audio/video encoding/decoding with flush bonding processor, use high performance embedded flush bonding processor to realize various functional interfaces, embedded OS and Communication Control agreement etc., increase communication processor and realize the adaptive of the multiple access medium of heterogeneous networks, software is realized PSTN-Call, IP-Call and WebCall etc. are based on the converged communication service creation of number mapping, terminal realizes the integration of three networks with the converged communication technology, the 3G intercommunication, UMS, the support method of related services such as P2P has increased and has utilized wireless Home RF technology to realize the indoor mobile and remotely controlling functional of null terminator Null machine tool.
The purpose of this utility model is achieved in that pattern of fusion network media phone set terminal, comprises audio signal I/O process chip, high-speed digital signal process chip, the adapter that inserts media, communication processor interface and embedded ARM processor and constitutes; Audio signal I/O process chip connects the port of high-speed digital signal process chip, and the adapter of multiple access media, communication processor interface all connect the port of embedded ARM processor; The high-speed digital signal process chip is connected with data terminal with the corresponding controling end of embedded ARM processor; Embedded ARM processor is to utilize embedded OS to realize the communication and the transmission control protocol of multiple communication processor interface and realize the audio/video encoding/decoding embedded ARM processor, flush bonding processor connect the multiple access media of multiple realization heterogeneous networks adapter, realize that by software PSTN-Call, IP-Call and WebCall etc. realize the integration of three networks with the converged communication technology based on converged communication service creation, the terminal of number mapping; Digital signal processing chip be finish the audio compression encoding and decoding G.711/G.729/G.723.1 with video compression coding-decoding H.264; S3C2410 finishes the high-speed digital signal process chip of Session Initiation Protocol and embedded OS and various interface such as RS232, video I/O, USB, LCD, RJ11, RJ45, Ethernet, dialing keyboard, wireless Home RF functional module is set, be provided with based on DSL and Cable Modem communication switching processing capacity module, Home RF functional module and communication switching processing capacity module connect the input/output port of flush bonding processor.
The embedded software and hardware system of pattern of fusion network media phone set terminal, mutual and communication process with fused business such as inter-network voice, data, videos, and the abstract message body encapsulation that becomes based on converged communication of unifications such as interactive information, control, state, the standard business and the technical interface that provide are for terminal realizes the reference technique model that converged communication is used provides communication protocol and audio/video encoding/decoding etc.; The information transmitter and the recipient of pattern of fusion network media phone set terminal distribute domain identifier and number unitedly, based on the whole network distribute the client number domain identifier can be implemented to the mapping (dial-up or number domain name parsing) of converged communication business domains sign and number, the comprehensive of POTS, DNS, standard techniques such as SIP, WebCall adopted in this mapping, creates and the foundation of service route with the environment for use of finishing dissimilar various fused business.
The core technology of pattern of fusion network media phone set terminal relates to voice and video compress technique, audio/video encoding and decoding technique and relevant communication protocol.As a kind of information consumption product, basic structure comprises video I/O unit, Video Codec, phonetic entry/output unit, audio coder ﹠ decoder (codec), delay unit, data processing unit, system control unit, multi-medium data multiplex/demultiplex unit and network communication interface unit.Pattern of fusion network media medium phone set terminal software can be divided into several parts such as application program module, agreement control module, audio coding decoding module, coding and decoding video module.Application program module is finished the user's human-machine interface function and the relevant value-added functionality of terminal, and the agreement control module is responsible for functions such as Signalling exchange.
1. the general framework of network media phone set terminal
Under present converged communication technology fast development trend, CPU and DSP technology are fused to SoC just day by day, and boundary therebetween is more and more fuzzyyer.A series of technical barriers have also obtained breaking through, and as: high performance embedded system, possess the voip technology of cost performance, high-quality video compression technology is H.264 with the broadband network services that can carry the converged communication business etc.
2. pattern of fusion network media phone set terminal framework
Embedded system is meant the system that application program, operating system and computer hardware are integrated.It is application-centered, and based on computer technology, and software and hardware can cutting, thereby is to satisfy the dedicated computer system that application system is strict with function, reliability, cost, volume and power consumption etc.Embedded system is made up of several major parts such as flush bonding processor, embedded ancillary equipment, embedded OS and embedded application softwares usually.Network media phone set terminal is as the special computer system of a class, and the remarkable advantages of flush bonding processor can conveniently be integrated in the device systems exactly, to adapt to constantly bringing forth new ideas and development need of converged communication technology.
The ability that network media phone set terminal is demanded urgently strengthening is to the more support of high quality audio and video, to improve user experience.Converged communication requires network media phone set terminal to support H.264 video and wideband audio (AMR-WB, G.729x wait), in addition, adopts embedded system also to make the terminal of converged communication value-added service realize becoming possibility.
Flush bonding processor has very strong disposal ability, and performance and efficient all are improved, and appears following characteristics suddenly: increase storage subsystem, and the taking into account system real-time, optimization system software, SoC can integrate video accelerator and IP kernel.(G.711, G.729), Audio Processing (AC-3), voice quality promote and Video processing H.264, and the codec hardware of software optimization and video quickens can to finish the VoIP encoding and decoding of network media phone set terminal system effectively.
The VOIP function of pattern of fusion network media phone set terminal is based upon the technical packetizing of IP, digitlization transmission technology, its basic principle is by voice compression algorithm speech data to be carried out compressed encoding to handle, then these speech datas are packed by related protocols such as IP, through IP network data packet transmission is arrived reception ground, again these VoPs are stringed together, after the decoding decompression processing, revert to original voice signal, thereby reach the purpose that transmits voice by IP network.IP telephony system becomes the analog signal conversion of plain old telephone computer can link the IP packet that the Internet transmits, and also the IP packet of receiving is converted to the analog electrical signal of sound simultaneously.Handle through the conversion of IP telephony system and compression, each plain old telephone transmission rate takies 8~11kbit/s bandwidth approximately, and therefore when using transmission rate as the bandwidth of 64kbit/s equally with common telecommunications network, the IP phone number is original 5~8 times.
H.264 make Image Compression rise to a higher stage, high-quality image transmission can be provided on lower bandwidth, the very suitable fixed network user of these characteristics measures greatly, the Access Network/relatively limited situation of backbone network IP bandwidth.At present be that H.264 the converged communication streaming media service of representative all incites somebody to action the standard as code/decode format with IPTV.Thereby pattern of fusion network media phone set terminal is introduced advanced H.264 coding techniques, the further picture quality that improves under limited bandwidth resources.H.264 standard makes the moving image compress technique rise to a higher stage, and it is H.264 application bright spot that the transmission of high-quality image is provided on lower bandwidth.
3. the design of pattern of fusion network media phone set terminal
The scope of using along with converged communication more and more widely, the function of terminal system also will become increasingly complex, network media phone set terminal lacks the shortcoming that operating system efficiently just becomes a maximum, because new function of every interpolation all may need to start anew to design, otherwise can only increase the complexity of development cost and system.Usually the energy of exploitation all concentrates on the application to single basic service, Embedded maximum characteristics can be given prominence to individual character exactly, embedded OS is incorporated in the pattern of fusion network media phone set terminal, can produce great impetus to the exploitation of system.Under the embedded system of no operating system,, all can bring the unnecessary consumption of overlapping development whenever will further developing and the function expansion.Embedded OS then can come embedded system is effectively managed by the various API that it provided.The embedded OS of using always has OS/2, Linux etc., selects Linux that many advantages are arranged.Pattern of fusion network media phone set terminal based on built-in Linux will not only have only simple voice and video function, it will merge more applications, under the prerequisite of multiple converged communication service application, it is inevitable that pattern of fusion network media phone set terminal adopts the exploitation theory of embedded OS to become.
4. pattern of fusion network media phone set terminal function structure:
4-1. basic structure and core technology, the basic structure that in the chip that the utility model constitutes, comprises:
1) video input/output module, Video Codec
2) audio frequency input/output module, audio codec
3) communication process, delay unit
4) data processing, memory cell
5) system control unit and socket unit
The core technology that the utility model relates to: 1) speech coding technology
Voice communication is the basic functions of pattern of fusion network media phone set terminal.Be subjected to the restriction of network condition, terminal can not take too big bandwidth.In order to adapt to the requirement of low code check voice communication, ITU-T has released G.72X serial voice compression.Wherein G.723.1, G.728, G.729 and G.729A, in IP phone, obtained extensive use.Pattern of fusion network media phone set terminal adopts different voice compression technique standards that different code check, time delay and voice qualities can be provided.
2) video data that video coding technique is original need take very high bandwidth, if desired must be at the code check that guarantees under the prerequisite of certain picture quality, to reduce video data as far as possible by compress technique by Network Transmission, adapting to different network bars, so the efficient of video compression algorithm has determined the picture quality and the application prospect of network media phone set terminal.
In Internet video was used, the video compression algorithm of MPEG4 form was comparatively popular at present, its code check generally at hundreds of Kbps to about the 1Mbps.H.264 be the high performance video coding and decoding technology that ITU-T releases, than H.263 having saved 50% code check, and Network Transmission had better support function with MPEG-4.Pattern of fusion network media phone set terminal adopts H.264 video compression algorithm, can be with same video compression to lower code check.
3) communication protocol
SIP (SessioninitiationProtocol) agreement is the mutual signaling of IETF in a kind of new network multimedia communication of proposition in 1999, have simply, favorable expandability, be convenient to advantages such as realization with respect to agreement H.323, be to guarantee the reliable communication of pattern of fusion network media phone set terminal on network, mainly adopt the OSIP2 communication control processor based on the pattern of fusion network media phone set terminal of IP network.
4-2. expanded function and construction module:
Converged communication is mainly finished following function towards NGN: unified CCF, media gateway access function, integrated service provide function, inter-network interconnection and interflow function, the service/application interface function of opening, support authentication and authorization function, billing function, resource access controlled function and QoS management function, agreement and interface function etc. that the application function that converged communication is new comprises:
---go into port service: at terminal environments (the multiple access medium of heterogeneous networks adaptive), monitoring is provided, functions such as coordination, and personalized service environment is provided
---enhanced multimedia session service: the call session that merges voice, data, video
---essential PSS ability: the caller sign presents (OIP), called sign presents (TIP), malicious communication tracking (MCID)
---recommend the PSS ability: calling transfer (CDIV), Call Waiting (CW), calling keep (HOLD), calling back when busy (CCBS), Messages-Waiting indication (MWI)
---optional PSS (PSTN/ISDN service analogue) ability: advice of charge (AOC), show Calls shift (ECT), reverse charging (RC)
---video telephone: be based upon the visual calling between the mobile 3G/ fixed net intelligent terminal.
---Click to Dial: terminal Web clicks in the session service environment and directly the online service resource is sent dial-up
---Web multi-party communication: call out the multi-media communication of organizing in many ways by WEB
---the enhancement mode session is waited for: allow the calling that terminal processes is real-time or preengage.
---the call function of enhancement mode: increased the merged session function, a plurality of discrepancy are called out can be integrated into a multi-party conversation.
---UMS service creation: in the terminal session service environment, provide directly online UMS Service Source is sent calling.
---resource routing policy: call identifying request and the corresponding resource domains sign batch operation of making standard automatically.
---VOD service: terminal can obtain the video flowing service of different quality as required with network environment.
---the peer-to-peer network business: terminal realizes that the application layer multicast of controllable P 2 P pattern exchanges with instant messaging
Converged communication application flow schematic block diagram as shown in Figure 1.
Along with the continuous upgrading of consumer to the terminal traffic demand, terminal will and increase extended function module by the optimization system structure, follow the application model of converged communication " terminal+service ", form the series of products that satisfy the professional multi-level demand of converged communication, bring brand-new experience to the user.
The basic application model of terminal:
1) low side pattern of fusion network media phone set terminal+application service
2) high-end pattern of fusion network media phone set terminal+application service
3) differentiated service+customization pattern of fusion network media phone set terminal
Expanded function and construction module based on the pattern of fusion network media phone set terminal of above-mentioned Design Pattern comprise:
---the service attribute control function module
Pattern of fusion network media phone set terminal is provided with the service attribute control function module, utilizes embedded OS to be realized by software: be applicable to the terminal distribution of converged communication service attributes such as the integration of three networks, 3G intercommunication, UMS, the function realization flow comprises:
1) by service attribute mandate correspondence different domain identifiers is set for dissimilar converged communication services in advance;
2) pattern of fusion network media phone set terminal by the number mapping mode send carry self domain identifier message to center service platform;
3) after center service platform is received message, inquire the pairing converged communication service business of the domain identifier that carries in this message attribute according to the default domain identifier and the corresponding relation of service attribute;
4) center service platform is given described pattern of fusion network media phone set terminal with the service attribute service assignment that inquires, and terminal is set up service-domain with corresponding domain sign converged communication business and linked.
This functional module can realize low-cost, expeditiously that converged communication system distributes control and management by service attribute to the service of pattern of fusion network media phone set terminal.
---the UMS business function module
Pattern of fusion network media phone set terminal is provided with the UMS business function module: utilize embedded OS to be realized by software, function comprises: service functions such as the UMS domain identifier obtains, professional judgement, communication switching; Realization flow comprises:
1) the UMS domain identifier with the information of converged communication service and communication abstract be unified message body, and carry out the conversion of message body between different clients and alternately according to the parsing of unified number, promptly finish the visit and the communication of information
2) terminal UMS form and interface provide unified converged communication service access service to judge and mutual standard
3), integrate integrated content and service arbitrarily, and carry out the interactive communication switching with unified message according to the UMS business norms.
In the terminal applies start-up course, at first configuration is carried out assign operation to system global variables according to the UMS business function, then to UMS service-domain registered callbacks sign, and starts the number call process.In case receive UMS service-domain sign, then call the UMS function and generate corresponding event and judge whether the processing transactions of this incident exists, then incident is put into this affairs if exist, otherwise generated new affairs, start the communication execution thread.Generate corresponding event according to interactive action simultaneously and transfer to the communication switching processing.
This functional module has been set up unified message communication interactive interface, business domains sign in terminal and has been described registration, number service
Functions such as terminal access realize the real fusion and the unification of three network services.
---the WebCall business function module
Pattern of fusion network media phone set terminal is provided with the WebCall business function module, utilize embedded OS to be realized by software, and at terminal interface service creation " hot key " is set: function comprises: number obtains, route judgement, resource searching, communication switching etc.; Realization flow comprises:
1) pattern of fusion network media phone set terminal is by service creation " hot key " dialing (number mapping mode) link WebCall business service interface, and the WebCall business function module is obtained converged communication territory identifier and call service number by service creation " hot key ".Terminal is provided with service creation " hot key " and based on the Embedded Application middleware of flush bonding processor, is to realize the reservation multi-party communication based on the WebCall technology, the function and the switching device of UMS directory search service.Pattern of fusion network media phone set terminal is by service creation " hot key " dialing (number mapping mode) link WebCall business service interface, and the WebCall business function module is obtained converged communication territory identifier and call service number by service creation " hot key ".
2) terminal WebCall business function module judgement territory identifier and call service number are sent to route, and are sent to center service platform WebCall server, have sent on-hook
3) catalogue of terminal WebCall business function module receiving center service platform WebCall server (being provided by the Internet resources search by the WebCall server) search service clawback is called out, finish pattern of fusion network media phone set terminal and recommend converged communication service catalogue number (terminal that searches or service), pattern of fusion network media phone set terminal and Directory Number are finished communication switching and application link alternately.
This functional module and service creation " hot key " coupling, can be adaptive to the generation of converged communication call back service in many ways, UMS service resources search configuration and the processing procedures such as optimization of reshuffling give the feature of user's self-organizing, can obtain the service of converged communication directory search, reservation search service and multi-party communication service by service creation " hot key ".
---the peer-to-peer network technology is used and control function module
The control of traditional communication service environment and professional supplying a pattern are concentrated, and promptly exist the communications infrastructure of an overall situation that control and the professional function that provides are provided.In the converged communication service environment, except hubbed mode, mainly present new feature: serving and the equipment of these services is provided is that distributed earth is embedded in the user terminal periphery, and these surrounding enviroment are supported the mutual of local user, object and business, and not exclusively infrastructure is controlled at the dependence center, and control provides the trend that presents peer-to-peer network self-organizing (P2P) with business.Different with P2P random choose Peer (reciprocity machine), controlled P2P agreement (Proactive network Provider Participation for P2P) can the coordination network topological data, can effectively select Peer, thereby improves the network router efficiency.Its application system realizes comprising: the application server of center service platform and center LIST SERVER are connected on the router of wide area network, the edge application server is connected on wide area network and the edge router that Access Network is connected mutually, constitutes the Content Distribution Network based on controlled reciprocity network technology (P2P); The edge LIST SERVER also is connected on the node device (edge router and terminal) that the edge application server connected.
Pattern of fusion network media phone set terminal configuration P2P uses and control function module, adopt embedded OS to divide SIP layer and P2P layer to realize based on flush bonding processor by middleware, the memory that has solidified P2P application and Control Software is provided with network interface, the encoding and decoding broadcast unit is provided with the I/O interface, the service application processing unit is by the external portable hard drive of USB2.0 interface, to support the concrete service application of P2P.。
Pattern of fusion network media phone set terminal is used with control module by the peer-to-peer network technology and is at first served to center service platform request SIP with the number mapping mode, registration of P2P-SIP platform and authentication terminal information, and call P2P domain identifier function, and other terminal is transmitted request and is set up application link in this P2P territory, edge, terminal place, when there are not the available links data of being asked in P2P territory, edge, place interior nodes equipment, then terminal is downloaded corresponding data and is offered the institute requesting terminal in center P 2P territory, the available links contact under this edge, terminal place P2P domain identifier.
Pattern of fusion network media phone set terminal APPN technical costs is little, extensibility is strong, and the suffered pressure of multicenter Platform Server is more little more for number of users.Pattern of fusion network media phone set terminal is connected with digital high-definition television, can the P2P mode receive the Media Stream of downloading from the IP the Internet, the process digital high-definition television is decoded and is converted the Media Stream that can play to and exports to digital high-definition television, its system and core technology comprise three major types, one, digital high-definition television TS flow encapsulation (coding) server, it is cut apart continuous TS media stream and is packaged into one by one quantum TS stream bag, and mark for each quantum TS stream bag, send certain pattern of fusion network media phone set terminal in the network to by network; Its two, digital high-definition television P2P management server is as the P2P-SIP management platform on the network, and the P2P node (terminal use) that adds network is registered, authenticated and authorizes; The 3rd, pattern of fusion P2P network media phone set terminal has embedded P 2 P and uses and control function module, finishes P2P transmission and digital high-definition television decoding function, the user watches glibly on television set, and downloads the HDTV (High-Definition Television) programme information by terminal circumscribed USB hard disk.
Further by the Change In Design of embedded P 2 P application software is realized new functional sequence, can be easily interactive converged communication service application such as multiple online information consulting, EPG, DRM (digital copyright management), recreation download, business communication meeting and P2P function be combined.
---pstn telephone+DSL communication switching module
Network media phone set terminal can built-in pstn telephone+DSL (comprising ADSL2+ or VDSL2+) functional module, the phone copper twisted pair that utilization is registered one's residence, the low frequency end of telephone wire is separated with front end, keep low frequency end and still carry out voice call, use the front end transmission of digital signals, the method for digital modulation guarantees that the speed of up-downgoing can satisfy the bandwidth needs of terminal traffic broadband application; Digital signal is solved from the front end of the phone copper twisted pair mode with the DSL digital decoding; Send into the microprocessor of network media phone set terminal, between network and terminal, set up two-way IP digital link, make network media phone set terminal possess the ability that directly obtains PSTN and the dual access of IP by fixed line RJ11 general-purpose interface.
---cable TV+CableModem communication switching module
Patent 200480015000.3 has been announced and has a kind ofly been realized on the net the system of broadband access comprising the coaxial distribution network side of comprehensive remittance light-gathering station, duplexing blender, splitter, HFC, the terminal access device that link to each other with HFC optical-fiber network side, the IP metropolitan area network of cable television network at cable TV.The broad band access method that also provides a kind of, comprise: the light-gathering station that comprehensively converges receives CATV light signal, data-signal and is converted to CATV radiofrequency signal and data radiofrequency signal respectively, issuing duplexing blender carries out multiplexing, issue splitter by the coaxial distribution network side of HFC again, demultiplexing goes out original signal and issues TV and terminal access device respectively; And duplexing blender receives the upward signal demultiplexing from the coaxial distribution network side joint of HFC and goes out the data radiofrequency signal, issues the IP metropolitan area network by comprehensive remittance light-gathering station.Use the present invention, can be with the broadband access of lower cost realization based on catv network.
Pattern of fusion network media phone set terminal also can built-in CableModem functional module, hfc plant after the access bidirectional rebuilding, keep the transmission of cable TV signal, the mode of IP signal with the QAM digital decoding solved, satisfy the bandwidth needs of terminal traffic broadband application; And send into the microprocessor of pattern of fusion network media phone set terminal, between network and terminal, set up two-way IP digital link.Make pattern of fusion network media phone set terminal possess the ability that directly obtains CATV and broadband IP access by the HFC general-purpose interface.
---indoor wireless composite aircraft functional module
Patent 200510122997.9 has been announced the method to set up and the device of the radio network interface of network media phone set terminal, with pattern of fusion network media phone set terminal as the basis of radio network interface, employing is at the adaptable interface module of the wireless network access device interface characteristics extension of network adaptable interface module as network media phone set terminal, and described wireless network adaptable interface module is connected with the system bus of network media phone set terminal inside.But this patent does not comprise the scheme that terminal configuration is the indoor wireless composite aircraft.
Pattern of fusion network media phone set terminal becomes indoor wireless terminal machine tool by built-in Home RF wireless communication module, band is set up wireless telecommunications by same built-in Home RF wireless communication module of the terminal handset of telephone handle and dialing keyboard and machine tool, realizes the indoor mobile communication and the remotely controlling functional of network media phone set terminal.
Converged communication means " terminal; a number; a bill; consistent business experience ", directly come from and continue and the non-embodiment that continues the fusion of two kinds of normal forms at each layer (from the physical layer to the application layer) of information technology system, be a kind of professional variation the under user's request drives in essence, communication from platform, calculate, " the 3C fusion " of consumer electronics, telecommunications to service, data, broadcasting and TV " integration of three networks ", the fusion of opening and closed service environment, and be the fusion of the network information technology normal form of representative with IP, all begun to take place and have a deep effect on the development of fixed network terminal technology and equipment.
Converged communication is to set up a flexible network by the business guiding, can in time integrate fast " TIME " is provided mixed service, the terminal fusion that the network information terminal of support converged communication business will become inevitable direction------telecommunications, broadcasting and TV and the Internet three network services of fixed network terminal device upgrade, replacement becomes new opportunity.
5. be provided with and be connected application process:
As mentioned above, pattern of fusion network media phone set terminal is realized the converged communication business by dialing, comprise: the terminal IP based network is in conjunction with the function Integrated Solution of top box of digital machine and IP phone set terminal, terminal utilizes television set as video display terminal (television field frame and sound equipment are as audio-frequency playing terminal), network integration communication service content is sent into television set (sound equipment) terminal, and realize the information interaction of converged communication by network, between pattern of fusion network media phone set terminal and the center service platform converged communication application system two interfaces are arranged, one is mutual by the IP signaling of realizing between sip proxy server and the converged communication application server, thereby sets up the Session Initiation Protocol interface of information session; Another is in network media phone set terminal and converged communication application system, the RTP coffret of setting up between buffering area agency or the information server.Network media phone set terminal is realized mutual by above-mentioned two IP signaling controls and information transmission interface and converged communication application system, thereby finishes the converged communication service application on network media phone set terminal.By flush bonding processor, embedded OS, application program support, realize basic software and hardware function (contain: the PSTN number call of simple dial-up operation or the SIP that contains the mapping of IP number call out), VOIP communication, H.264 streaming media communication and LCD incoming call/information demonstration); Network insertion part (containing 10/100Mbp Ethernet interface, DSL communication switching interface or CableModem communication switching interface), USB interface, dialing keyboard (configuration service is created " hot key ") etc. are supported by ICP/IP protocol storehouse, CODEC protocol stack software.
Lan protocol (TCP/IP) moves on flush bonding processor.In wide area network was used, I/O conducted interviews to public phone network (PSTN) by TDM bus and telecommunications I/O interface.Tdm traffic is from the output of TSI interchanger, input processor communication serial port again.The TDM time slot (channel) that processor selection is suitable also carries out signal tone and detects to determine type of call.If audio call, encode after then the speech data of this time slot being eliminated echo, handle in real time, ether/IP/UDP packing, directly send to ethernet controller again.If the voice signal detector does not detect voice signal, then enable quiet inhibition.Grouped data for receiving by LAN (comprising by DSL or CableModem expansion switching) at first unpacks and sends to wobble buffer, sends to Voice decoder then.If enabled quiet inhibition, just can generate flexible noise.Speech data is sent to time slot interchanger by the processor serial data stream and exports through telecommunications I/O interface." embedded OS " is by ICP/IP protocol, Session Initiation Protocol support performance.
Pattern of fusion network media phone set terminal is defined as the converged communication terminal product based on embedded system.The possibility of embedded system has: fixed function chipset/IP kernel, general programmable CPU processing host or local signal and the DSP towards communication able to programme.
The hardware device that the exploitation of this terminal system is used can directly be bought to relevant embedded chip solution provider, but, also need according to the hardware configuration condition at development platform of software systems customization because embedded system is the system of software and hardware height combination.The system development bag that uses merchant's embedded chip solution provider to provide, utilize the embedded operation software systems of development platform to create guide embedded application software system, customize out the systemic-function that satisfies various different demands, newly-built image file and it is downloaded in the development board solidifies.
Pattern of fusion network media phone set terminal will be designed to advance the 3C intelligent terminal of converged communications application such as the integration of three networks, 3G intercommunication.Its business interface (Service Interfaces) comprising: the UMS business interface that the converged communication application access is provided.The internet channel and the search capability that provide the application that makes the user to possess visit converged communication service resources, as generation, calling, management, message, mutual etc., business interface also comprises the common application interface that alleviates communication application program pressure.
The utility model framework interface (Framework Interfaces) provides the professional transmitting-receiving of converged communication necessary external tenability, is provided support by the business framework interface: the UMS converged communication service interaction of number call mapping mode is operated, is supported for the IP access of LAN/PSTN/HFC network; Access support for television set/sound equipment; For the connection support of null terminator Null machine tool indoor wireless, for the access support of PC peripheral hardwares such as camera/portable hard drive under the USB standard.
The utility model pattern of fusion network media phone set terminal also identifies by the service attribute control domain is set, and is provided converged communication applied business attribute assignment control and management support, the professional generation optimization of " hot key " WebCall (webpage calling), the application of peer-to-peer network technology and control etc. by the functional framework interface
The utility model framework interface makes converged communication professional by the realization of pattern of fusion network media phone set terminal one, with the cost performance of pattern of fusion network media phone set terminal, form the series terminal equipment of multiple function combinations based on the functional framework interface of service application according to " terminal+service " application model.
The utility model closes key combination: based on SIP (session initiation protocol of working out by IETF) and H.264 pattern of fusion network media phone set terminal with the correlation function of top box of digital machine and IP phone concentrated be one, support the converged communication technology to use, DSL/Cabll-Modern (a kind of technology/cable modem that digital subscriber line provides numeral to connect by copper cash) switching is supported in expansion, 3GPP communication, the service of UMS unified message, WebCall (webpage is called out and utilized), the combination of P2P (peer-to-peer network technology) etc.Network media phone set terminal main frame and handset are set set up Home RF (domestic consumer has the interoperability radio communication), make handset possess indoor mobile communication and remotely controlling functional.
The beneficial effects of the utility model:
1) the pattern of fusion network media phone set terminal system platform of finishing under the converged communication business norms can realize the converged communication application, and then carries out Internet resources by the application model of " terminal+service " and share or intercommunication.Converged communication service under the domain identifier and pattern of fusion network media phone set terminal distribute by service attribute and the domain identifier system of same standard carries out information mutual communication, enjoy the converged communication service of registration.Same converged communication service according to the design of converged communication standard can be described by domain identifier, registration and integrated.
2) the pattern of fusion network media phone set terminal based on SIP and H.264 design adopts Embedded System Design: be made up of several major parts such as flush bonding processor, embedded ancillary equipment, embedded OS and embedded application softwares, system processing power, performance and efficient all are improved.
3) pattern of fusion network media phone set terminal has utilized " terminal+service " business model as the basis, carries out the systemic-function expansion in the integration of three networks, 3G intercommunication and fields such as UMS, WebCall, P2P.
4) pattern of fusion network media phone set terminal is provided with the condition that " hot key " possesses the professional generation of establishment WebCall, in addition: Home RF radio communication main frame and handset are set, possess indoor mobile communication and distant control function, the convenient use.
Function of the present utility model: operating function: PSTN dialing, the mapping of IP number, " hot key " are called out, cordless telephone provides distant control function; The phone function: the PSTN/IP telephony feature, video telephone is supported in the peripheral hardware expansion; Media function: coupling television set/sound equipment is supported streaming media services such as VOD/IP-TV, and the peripheral hardware expansion supports content to download; Message function: coupling television set/sound equipment support voice, text, media information receive; Communications protocol: POTS, SIP; Media formats: support H.264 MPEG compatible-4, MPEG-2, MP3; The intercommunication form: UMS, 3GPP, webpage HTTP, HTML, cookie, Java, Digital Television, digital high-definition television are supported in domain identifier control; Expansion is supported: DSL/Cabll-Modern switching, WebCall, P2P; Pattern of fusion network media phone set terminal is used schematic diagram as shown in Figure 2.
Description of drawings
Fig. 1 is the utility model---converged communication application flow schematic block diagram
Fig. 2 is the utility model---pattern of fusion network media phone set terminal is used schematic diagram
Fig. 3 is the utility model---pattern of fusion network media phone set terminal basic structure sketch
Fig. 4 is the utility model---pattern of fusion network media phone set terminal hardware system structure block diagram
Fig. 5 is the utility model---pattern of fusion network media phone set terminal software system structure block diagram
Fig. 6 is the utility model---the used H.264 functor of pattern of fusion network media phone set terminal structured flowchart
Fig. 7 is the utility model---the used SIP functor of pattern of fusion network media phone set terminal structured flowchart
Fig. 8 is the utility model---embed the terminal software hierarchical diagram of P2P functional module
Fig. 9 is the utility model---terminal converged communication function realizes schematic diagram
Figure 10 is the utility model---network media phone set terminal functional structure module connection diagram
Figure 11 is the utility model---pattern of fusion network media phone set terminal electrical block diagram
Figure 12 is the utility model---pattern of fusion network media phone set terminal network and port connection layout
Embodiment
For simplifying the design of pattern of fusion network media phone set terminal solution, adopt height optimization and integrated embedded system platform, increase the integrated level of pattern of fusion network media phone set terminal system, and obtain more low-power consumption, more small size and overall lower system cost, and fast integration is in final product design.In the integrated flexible framework of flush bonding processor, embedded ancillary equipment, embedded OS and embedded application software, necessary medium Processing Algorithm is provided and, can when terminal development, be absorbed in the value-added service on the development equipment based on the control of calling out communication.SIP calls out control, user interface and general phone control application and finishes on this application processor, can utilize built-in system software chassis configuration and management to control H.264 video flowing based on the video accelerating module of flush bonding processor hardware simultaneously.Other task realizes with ' C '.Control/system management is handled and called out to medium merge to further simplified design of single application processor, reduce number of devices, cost and volume.In addition, can also cancel every independent development and the independent Development Tool Chain that the VoIP medium are handled and system's control is originally required after the merging.Can use the system-level embedded chip (SoC) that includes general processor and dedicated video coprocessor or DSP.
Pattern of fusion network media phone set terminal basic structure sketch as shown in Figure 3.
1。Hardware Design
Pattern of fusion network media phone set terminal comprises audio video processor and corresponding software is finished the audio frequency and video instant communication function.Consider final products should use simple, easy for installation, be convenient to control, cost performance is reasonable, consider complexity, the marketing of production cost, realization, the factors such as upgrading renewal of product, the concrete hardware plan of implementing the network media phone set terminal system that determines is: use the high-speed digital signal process chip TMS320DM643 of TI company to utilize embedded software to realize audio/video encoding/decoding, realize various interface, embedded OS and transmission control protocol etc. with the ARM9 chip S3C2410 of Samsung.Avoid keeping very high performance again, and can download by simple program and realize software upgrading or increase new converged communication function because of the many high problems of cost of chip.
System hardware mainly is made up of the TMS320DM643 of TI company and the S3C2410 of Samsung.Wherein TMS320DM643 finish the audio compression encoding and decoding G.711/G.729/G.723.1 with video compression coding-decoding H.264; S3C2410 finishes Session Initiation Protocol and embedded OS and various interface such as RS232, video I/O, USB, LCD, RJ11, RJ45, Ethernet, dialing keyboard etc.The TLV320AIC23 of the I/O of audio signal by TI company sends into TMS320DM643 and carries out compressed encoding.
Pattern of fusion network media phone set terminal hardware system structure block diagram as shown in Figure 4.
2. software system design
2-1. system software structure
After the terminal system hardware designs is finished, need write code and realize each functional module, realize that finally whole system is integrated.Embedded OS adopts the ARM-Linux kernel, Hardware drive module mainly is based on the software interface between hardware and linux kernel of ARM9, for thereby specific Hardware Response Delay defines the DLL (dynamic link library) operational hardware, the technology of these 2 big modules is quite ripe at present; G.711/729/723.1 audio coding adopts, and is in order to allow terminal can adapt to the asymmetric operation of audio coding decoding, favorable compatibility to be arranged, the voice that can directly select for use the third party of TI company the to provide bag that develops software.This programme according to the characteristics of pattern of fusion network media phone set terminal realize video coding H.264 with Session Initiation Protocol stack 2 big core technologies.
Pattern of fusion network media phone set terminal software system structure block diagram as shown in Figure 5.
---realization H.264
Though H.264 video encoding standard is considered various application and transmission environment when design, the compression efficiency that it is high and network compatibility are to be cost with big operand, and in the associated video of pattern of fusion network media phone set terminal is used: though the limited bandwidth real-time requires height, must select (naturally selecting main level here for use) meticulously to encoding scheme H.264 so consider the complexity of realization and technology itself, when utilizing the flush bonding processor chip to realize, will be optimized program.Use the C voice programming, utilize the Integrated Development Environment CCS2.2 of TI company to develop and debug,, be fit to the real-time application of terminal, mainly it is optimized from the following aspects in order to reduce the H.264 complexity of encryption algorithm:
1) simplification of motion estimation algorithm
In video coding, motion estimation algorithm plays a part very crucial, accounts for more than 60% of a compression scheme the amount of calculation usually, so adopt a kind of motion estimation algorithm fast to reduce computational complexity here.In coding standard H.264 according to the different characteristics of its corresponding predicated error of different dividing mode of macro block (MB), coding mode is reduced to 4 groups, earlier judge according to predicated error which group current MB belongs to, be somebody's turn to do coding mode best in the group with Lagrangian rate distortion algorithm picks then, according to experimental result, do like this that the scramble time can shorten about 3 times and the PSNR of decoding back image has only slightly and descends (the worst situation can not surpass 0.5dB).For infra-frame prediction, make predictive mode minimum between P piece and the present encoding piece I time-consuming too as choosing from 9 kinds of optional predictive modes of prediction piece P.Probability to each 4 * 4 coding mode in the I frame calculates, and only chooses 4 kinds of patterns that wherein probability of occurrence is the highest and is used for infra-frame prediction.
2) program structure is optimized
At first condition judgment statement, Do statement and function call etc. in the program are optimized to adjust and reduce the instruction that this class expends the more clock cycle.Software pipeline is used in the conversion of video data and inverse transformation, the calculating of SAD, calculating of motion prediction etc. as far as possible.Next utilizes the optimization option that the C compiler provides among the CCS2.2 that program is optimized, and the more code of losing time in the program is optimized these codes with the compilation optimizer.
3) memory is optimized
Optimize storage is because the video data volume is bigger, and is more to the time that the access of data is wasted.Here the access of using dma mode to carry out data is delayed time to reduce memory, promptly with dma mode desired data is sent in the inner buffer before processor is handled data, so not only saves processing time software pipeline also easy to use.
The used H.264 functor of pattern of fusion network media phone set terminal structured flowchart as shown in Figure 6
---the realization of Session Initiation Protocol
Communication protocol based on SIP has a plurality of versions of increasing income, and this programme adopts OS-IP2 (V2.2.2).OSIP2 makes according to RFC3261 (SIP) and RFC2327 (SDP) standard and uses the free protocol stack of the open source code that standard C writes.It is simple in structure small and exquisite, is absorbed in bottom and resolves, and efficient is higher.The Osip2 protocol stack roughly can be divided into 3 parts: the syntactic analysis of Session Initiation Protocol, the process analysis procedure analysis of Session Initiation Protocol and protocol stack framework.
1) syntactic analysis of Session Initiation Protocol
Support the Session Initiation Protocol message of RFC.3261 and RFC3265 definition, comprise INVITE, ACK, OPTIONS, CANCEL, BYE, SUB-SCRIBE, NOTIFY, MESSAGE, REFER and INFO etc.Do not support the PRACK of RFC3262 definition.Follow the offer/answer pattern of RFC3264 about SDP.Have the syntactic analysis of SDP.Support the MD5 enciphering and deciphering algorithm, Authorization, www_authenticate and proxy-authenticate etc.
2) process analysis procedure analysis of Session Initiation Protocol
Based on RFC3261, the Session Initiation Protocol of RFC3264 and RFC3265 is described process, realizes the parsing of SIP around this one deck of transaction.Transaction is meant a transmit leg and recipient's reciprocal process, by asking and replying and form.Request is divided into Invite type and Non-Invite type.Reply and be divided into replying of response type and replying of affirmation type.Directly the answering of response type is meant that this is replied and only represents the other side to receive request.Request all must be returned replying of affirmation type after treatment.Response type replied 1xx, replying of affirmation type comprises 2xx, 3xx, 4xx, 5xx and 6xx.Transaction by a request and one or more response type reply, an affirmation type replys and forms.Transaction can be divided into 4 classes: ict (initiator of session invitation), nict (initiator of non-invitation session), ist (recipient of session invitation) and nist (recipient of non-invitation session) according to the difference and the different of transmission/reception of request.
3) protocol stack framework: mainly contain 3 parts: the reception/transmission of bottom socket, module is asked communication pipe, the api interface is called on the upper strata.OSIP2 does not realize that the reception person of outstanding talent of bottom socket send, and it is realized by eXOSIP, only supports the link of UDP to connect now.
Utilize to download and download among the ARM9 chip S3C2410 after the OSIP2 source code compiles under the LINUX environment.
The used SIP functor of pattern of fusion network media phone set terminal structured flowchart as shown in Figure 7
3. systemic-function exploitation
Application processor based on embedded system structure has strengthened its disposal ability now, by " embedded OS " instruction of optimizing, converged communication specific function task can be given the function middleware of embedded application software and finish.
The function middleware is an intermediate layer that embeds between application program and operating system, hardware platform, is defined as one group of application programming interfaces comparatively complete, standard usually.The exploitation that it is mainly application software provides cross operating system, strides platform and stratification, modularization and the extendible interface of hardware, simultaneously, provides the programming tool of necessity according to the programming feature of Embedded Application.
By middleware, application program can be independent of operating system and hardware platform, makes the opening of product and portability stronger.Middleware has been arranged, application program not only can run on different hardware platforms, also can on different operating system, move, thereby improving development efficiency, reducing the development that to catch up with technology in the development cost, make the exploitation of application become simpler and more direct, also provide a metastable higher layer applications environment for application program.If carefully adopt compilation coding and the manual Linux software of optimizing, relevant fused business scheduling and function provide can efficiently operation on application processor or ancillary equipment.
The integrated exploitation of function of pattern of fusion network media phone set terminal just is based on above-mentioned basic conception and abstract model thereof, and the terminal converged communication of foundation is used and realized that logic designs, and comprising:
1. Embedded System Design: be made up of several major parts such as flush bonding processor, embedded ancillary equipment, embedded OS and embedded application softwares, that software development is adopted is safe and reliable, the built-in Linux operating system of cutting voluntarily
2. the domain identifier of embedded application software system supporting business attribute control, after powering on or after enabling service, have only domain identifier just can insert in the service specified territory by the terminal that authenticates, but system obtains resource on the far call server, sets up the integration of three networks, 3G intercommunication, converged communication service optimizes routes such as UMS, WebCall by calling out (number mapping) by distribution service Attribute domain sign, not only guarantee the safety that terminal inserts, go back the safety that guaranteed service transmits.
3. embedded application software provides VoIP encoding and decoding (G.711, G.729AB, G.723.1), Audio Processing (DTMF (dual-tone multifrequency), the voice quality enhancing (professional detection/scheduling of circuit and acoustic echo elimination, jitter buffer and SIP calling procedure etc.
4. embedded system provides H.264 coding and decoding video, adopts the combine accelerator of form of soft or hard to set up high-quality converged communication Video service in real time glibly;
5. embedded system provides function treatment software and system interface operations " hot key " such as UMS, WebCall by middleware, terminal is set up with Service Source by service-domain control and calling (number mapping) and is linked, and creates converged communication related service environment for use.
6. embedded system embeds the P2P Control Software by middleware: the telecommunication management of terminal being divided into two-layer, is the SIP layer above, handles the SIP signaling of standard; Be the P2P layer below, use specific mechanism by other associated nodes of the network interconnection (containing SIP platform or terminal) the P2P layer and keep contact between them.The P2P layer offers the DLL (dynamic link library) of SIP layer application program.
The embedded P 2 P application software can be carried out the establishment of program according to the middleware standard, mainly finish and being connected and co-ordination of resource layer interface and interpretation layer, the specific initial work of P2P is enabled by the realization system, and the request of business application is converted into calling corresponding P2P driver.Provide api function by application programs, thereby shielding P2P uses the details that realizes.
The terminal software hierarchical diagram that embeds the P2P functional module is seen accompanying drawing 8
Terminal adopts the P2P technology can lower the resource of consumption application server and can obtain the relevant converged communication service of peer-to-peer network technology;
7. terminal embeds complete DSL communication processor (as the AR7 processor solution of TI), as embedded ancillary equipment, related by embedded application software and the generation of IP network interface unit, terminal can be by the unified network access environment that obtains the PSTN+ broadband IP of RJ11
8. terminal embeds complete CableModem communication processor (as the 4040 processor solutions of TI), as embedded ancillary equipment, related by embedded application software and the generation of IP network interface unit, terminal can be by the unified network access environment that obtains the HFC+ broadband IP of 75 Europe Cable
9. terminal embeds complete indoor HomeRF wireless communication module (as the SC1443X processor solution of TI), terminal human-machine interface function module increases wireless access function, as radiotelephone: telephone handle and dialing keyboard are combined as the radio telephone handset, connect by the HomeRF wireless communication protocol between main frame and handset, mobile calls main frame (being equivalent to remote control) and mobile call function in the null terminator Null unit room are provided.
10. Terminal Design is running through the theory that centralized management, resource and computing capability are shared; Terminal " non-maintaining, exempt from upgrading "; Terminal self is not with hard disk, has reduced viral inlet.Can select the embedded system structure of different disposal ability for use according to the converged communication business characteristic, revise embedded OS and embed the seriation function that application software obtains product by middleware by exploitation;
Terminal converged communication function realizes schematic diagram as shown in Figure 9
Above termination function exploitation Integrated Solution not only drops into low in advance, and follow-up functional development expense is little, has minimum TCO (TCO).Present semiconductor and software new technology have made the pattern of fusion network media phone set terminal of high performance-price ratio become possibility, and the chance of utilizing the converged communication application foundation framework that increases fast to enter general marketplace is arrived.The combination of embedded software and hardware technology and video speech coding technology can make the required electronic material cost of pattern of fusion network media phone set terminal exploitation correlation function can reduce over half.The significantly reduction of product cost will impel pattern of fusion network media phone set terminal to popularize rapidly, and simultaneously, time that embedded system structure also can be shorter and minimum risk are developed the novelty end product.
Pattern of fusion network media phone set terminal functional structure module connection diagram as shown in figure 10
4. terminal development is integrated
After the basic key points in design of the software and hardware of clear and definite pattern of fusion network media phone set terminal system and functional development, most important work is exactly that independently function system is integrated with each, and the system basic functions structure comprises video I/O unit, Video Codec, phonetic entry/output unit, audio coder ﹠ decoder (codec), delay unit, data processing unit (optional), system control unit, multi-medium data multiplex/demultiplex unit and network interface unit.Software can be divided into several parts such as application program module, agreement control module, audio coding decoding module, coding and decoding video module.Application program module is finished the user's human-machine interface function and the relevant value-added functionality of terminal, and the agreement control module is responsible for functions such as Signalling exchange.In the integrated design of systemic-function, each functional module data flow must obtain relevance and synchronous at receiver side.
Circuit of the present utility model is realized entrusting IT product manufacturing company to carry out chip and is solved Scheme Selection, mainboard industrial design and corresponding software development, terminal is integrated, and what emphasize is functional module (large scale integrated circuit mainboard) Integrated Solution, adopt embedded system, integrated combination is decided with the design of target developing function, each functional module (large scale integrated circuit mainboard) is according to the different application functional interface configuration of network media phone set terminal, the utility model only need propose structural diagram and Integrated Solution and explain, just can entrust above-mentioned company on the solution development package base that chip supplier provides, it is integrated and obtain satisfactory circuit board of the ratio of performance to price and complete machine to carry out secondary development.
The network media phone set terminal circuit board of the utility model design is based on bus structures, as the embedded system controller, adopts built-in Linux operating system with the S3C2410 chip of the TMS320DM643 of TI company and Samsung.Except main pci bus, system also has H.110 bus, and transmission TDM finishes the exchange of TDM information flow.The predecessor of H.110 bus is multi-vendor integrated agreement (MVIP) and signal computing system architecture (SCSA), and the cable that normally is used for communication between plate connects, rather than core bus.TDM uses different time slot voice-bearer channels.Other functions such as telecommunications I/O and user I/O provide the telecommunications I/O interface function of non-bus-type by pci bus, and are used for the proprietary bus user I/O of Ethernet.
Pattern of fusion network media phone set terminal electrical block diagram as shown in figure 11
Pattern of fusion network media phone set terminal according to above design has been expanded its range of application from function, has embodied the demand of business integration, professional adaptation ability and cost performance height, volume is little, and is low in energy consumption, the peripheral interface circuit simplicity of design, can implement product seriation by available function, comprise:
Network media phone set terminal |
Low side+network media service |
High-end+the converged communication service |
Customized+differentiated service |
The wan interface configuration |
RJ45 |
Built-in DSL-Modem |
Built-in CableModem |
The PSTN interface configuration |
RJ11 |
RJ11 |
RJ11 |
The HFC interface configuration |
CATV is straight-through |
CATV is straight-through |
The Digital Television encoding and decoding |
The LAN interface configuration |
RJ45 |
RJ45 |
RJ45 |
Dialing keyboard+telephone handle |
Carry |
Carry+wireless composite aircraft |
Carry or wireless composite aircraft |
The VOIP audio coding decoding |
G.711 |
G.729/G.723.1 |
G.729/G.723.1 |
The encoding and decoding of audio stream medium |
MP3 |
MP3 |
MP3 |
The video stream media encoding and decoding |
H.264 |
H.264 |
H.264 |
The two-way processing format of video |
NTSC or PAL |
NTSC/PAL is automatic |
The NTSC/PAL/ high-definition digital |
The Message Processing form |
Format identification, conversion present |
Format identification, storage are transmitted |
Intelligent management, editing and processing |
Audio output interface |
Simulate stereo |
Stereophony |
5.1 channel stereo |
USB interface |
Connect the CCD camera |
Connect hard disk or camera |
Connect the Standard PC peripheral hardware |
The converged communication service creation |
The multimedia service calling mapping |
Hot key UMS |
Hot key UMS+WebCall |
The professional control of converged communication |
SIP calling+MAC Address |
SIP calling+domain identifier |
SIP calling+domain identifier |
The converged communication business support |
Voice/message+Streaming Media |
The integration of three networks, the 3G intercommunication |
Directory search, subscription services |
Network peer to peer technology business |
|
The P2P instant messaging |
The P2P digital TV in high resolution |
Pattern of fusion network media phone set terminal network and port connection layout are as shown in figure 12
5. pattern of fusion network media phone set terminal design objective:
5-1. overall objective:
● support PSTN dialing communication, VOIP dialing communication and SIP communication protocol number IP mapping to call out
● support broadband IP to insert;
● support H.264 consensus standard, compatible MPEG-4 and MPEG-II video format and the MP3 audio format supported.
● support NTSC and PAL television system to discern automatically;
● support code stream: 52Kbps---2000Kbps; CBR or VBR;
● video resolution: Full D1 720*576 or 640*480; 1280*720pixelworks resolution and 30frame/rate detect speed; And 1920*1080pixelworks resolution and 60frame/rate detect speed and carry out image-decoding
● support the simulated dual sound channel; Optional 2.1 surround sounds, 5.1 sound channel digital formula clear stereos output
● support HTTP 1.0, HTML 3.2 and HTML 4.0, cookie, JavaScript 1.3, SSL3.0;
● support BMP, GIF87a, GIF89a (animated GIF), JPG picture format;
● support two kinds of big small fonts;
● support simplified form of Chinese Character, English;
● support to act on behalf of media server;
● video format: 4:3,16:9; Screen amplifies and dwindles, and supports two kinds of display modes: 640 * 480 and 800 * 600;
● support code stream: 52Kbps---2000Kbps; CBR or VBR;
● support Windows Media DRM digital copyright management;
● support html web page to browse;
● support SSL, NTLM, Kerberos safety certification;
● support CDN broadband content distributing network;
● network enabled message sink (text MAIL, MS, FAX; PUSH/PULL information etc.)
● the dialing keyboard operation, support Play Control etc.
● the back-up system online upgrading obtains latest edition software on network;
● indoor wireless Home RF composite aircraft function (handset can be used as the straighforward operation terminal) is supported in expansion
● expansion supports the broadband IP of PSTN/DSL mode to insert
● expansion supports the broadband IP of two-way HFC-CableModem mode to insert
● the control of fused business attribute assignment is supported in expansion: converged communication business domains identification service
● expansion support voice/data/video fused business and 3GPP business intercommunication
● expansion supports the generation of UMS converged communication business to handle
● expansion supports " hot key " generating run of WebCall converged communication business (containing multi-party communication, directory search, reservation communication etc.) to handle
● the digital TV in high resolution service based on P2P is supported in expansion
5-2. system framework:
● bus configuration, embedded computer operation system of software
● primary module is handled in the I/O communication
● flush bonding processor functional processing module collection
● PSTN or HFC communication IP interface peripherals switching processing module (optional)
● DC built-in power module, the hands-free loudspeaker of phone, microphone
● this machine configuration: dial-up operation keyboard, wireless composite aircraft band dial-up operation keyboard handle (optional)
● LCD display,
● external stabilized voltage power supply: AC changes DC
5-3. functional module
Basic function module:
● the I/O communication kernel under host CPU hardware and operating system software coordination
● SLIC phone module---support program controlled telephone communication and operating function
● IP phone module---support VOIP communication and IP address/number interpretative function
● medium process module---support that H.264 Streaming Media decodes, A/D changes, video encoding
● Network Interface Module---support to insert with the IP signal
● usb interface module---support peripheral hardware picture pick-up device (video telephone function), portable hard drive to insert (data unload function)
● the driving interface module---support external LAN, in-local system, preset function parameter extended function module are set:
● the extension of network interconnecting module---support the PSTN/DSL broadband IP to insert or the access of HFC-CableModern broadband IP
● the service attribute control module---support converged communication business intercommunication service attribute allocation domain sign and directed control
● the UMS functional module---support the automatic generation of the professional environment for use of converged communication UMS
● the WebCall functional module---support " hot key " generating run of WebCall converged communication business to handle
● the P2P business function module---support peer-to-peer network The Application of Technology and control
● indoor wireless communication module---composite aircraft is supported indoor mobile communication and remotely controlling functional
5-4. interface
● wan interface---RJ45 connector meets IEEE 802.3 10 Base-T
● PSTN interface---RJ11 connector meets the PSTN standard
● the RJ11+DSL adapter meets ADSL2+, VDSL or VDSL2+ standard
● the CableModern adapter meets 64QAM modulation standard
● analogue AV interface---the television set of connecting band AV
● composite video S---the television set of connecting band S-video terminal; Y:0.7Vp-p; C:0.88Vp-p; Impedance: 75 Europe
● the television set of color difference components YUV---connecting band Y, Pb/Cb, Pr/Cr socket, 740-140m Vp-p
● USB interface---USB2.0 connector meets the USB2.0/USB1.1 standard
● LAN interface---RJ45 Ethernet bridge can outreach PC
● other interface---the unprocessed cable TV RF of signal leads directly to interface
● com interface---can the phone parameter be set by the PC browser
● dialing keyboard---except that 0-9, the * of standard, #, other is provided with 12 function keys, is used for operation and the optional service creation of phone " hot key " is set, and is used for the service creation operational processes of converged communication terminal service
● subject for ridicule interface---RJ11 connector
● wireless composite aircraft interface---indoor wireless bridge meets the HomeRF standard
● analogue audio frequency---1-2V
● 5.1 is stereo---connect stero set or home theater 0.5Vp-p
● status indicator lamp---be provided with indicator light and LCD illuminating lamp, be used for the LCD display lighting.
● hand-free function---full duplex, ringer volume, Headphone volume, the digital independent regulation of speaker volume
● AC/DC adapter-input 220~240V (China, Europe etc.)
5-5. environment for use
● serviceability temperature: 0 ℃ of 50 ℃ of to (32 ℉ to, 122 ℉)
● storage temperature :-30 ℃ of 65 ℃ of to (22 ℉ to, 149 ℉)
● humidity: 10 to, 90% no dewfall
● power supply: 220V, 50Hz
●---(PSTN---DSL HFC---is Cable-Modern) for LAN for network: Ethernet
---network delay: less than 400ms
● network jitter: less than 100ms
● network packet loss rate: less than 10%
● the network bandwidth: VOIP is greater than 30kbps, and VOD is greater than 450kbps, and IP-TV is greater than 1.2M
● program controlled telephone: PSTN
● household electrical appliance: television set, sound equipment
● PC peripheral hardware: camera, portable hard drive
5-6. operating process
Operation interface: this machine dial-up operation keyboard (containing hot key), LCD display (text message menu), this machine microphone (IVR info menu), optional indoor wireless composite aircraft remote dial-up operation keyboard
● external tv machine (containing hot key directory search, electronic program information guide), driving interface (the in-local program is set)
Start ready: this machine is by the plug and play design
● in energising and possess under the IP world: according to the domain identifier of service attribute distribute control seek automatically and Login Register to specifying converged communication service platform territory:
● under the prerequisite of finishing the domain identifier registration: seek and obtain to specify the converged communication service automatically according to calling out (number mapping)
● support DHCP: automatic IP address allocation, subnet mask, gateway ip address etc./support PPPoE
● the self-starting silence detection; Comfort noise produces; 16ms echo cancelltion and dynamic buffer management--reduce time-delay, shake influence communication quality
Operation flow: terminal can directly insert the IP world of WAN net, and also optionally connected PSTN of going into or HFC net need the IP world of demodulation
● terminal can directly be passed through permanent plant, also can select to converse under indoor mobile status by Home RF composite aircraft mode, and finish the man-machine interface interactive operation
● keyboard dialing is controlled mutual uplink information, supports IVR, and the TV screen shows operation guide;
● the treated output of Streaming Media signal: directly connect television set or home theater (sound equipment);
● hang up/volume regulates/redials/suspends/caller identification;
● can get, also can squeeze into, under the support of operator, dial pstn telephone;
● other VOIP phones in both can having knitted a net, also can beat any plain old telephone (supporting that VOIP/PSTN interconnects);
● under the service attribute allocation domain, dial converged communication platform, carry out the Streaming Media communication.
● under the service attribute allocation domain, generate based on UMS service mode environment for use: obtain converged communication services such as voice, Streaming Media or message by number call
● under the service attribute allocation domain, finish service code call, obtain converged communication services such as multi-party communication, directory search, reservation communication by WebCall service creation " hot key "
● under the service attribute allocation domain, finish reciprocity intercommunication with the 3G mobile phone by number call
● under the service attribute allocation domain, obtain the digital TV in high resolution Streaming Media in the P2P mode, put by the digital TV in high resolution machine sowing by number call
● under the prerequisite that USB peripheral hardware computer portable hard drive accesses terminal: finish data by number call and download or interaction process
● under USB peripheral hardware digital camera accesses terminal prerequisite: finish the video telephone communication that fixed network or 3G move by number call
The part bilingual:
● POTS:Plain Old Telephone Services traditional telephone service system
● DNS:Domain Name System domain name system
● VoIP:Voice over Internet Protocol data and voice call
● the single industrial chain structure of ICT:Information and Communication Technology
● TIME:TelecomInternetMedia and Entertainment communication industry, IT industry, media sector and show business merge
● Proactive network Provider Participation for P2P is intended to strengthen communicating by letter of service supplier (ISP) and client-side program, reduces backbone network transmission pressure and operation cost, and improves the performance of the P2P file transfer of improvement.
● NGN:Next Generation Network next generation network
● RTP:Real-time TransportProtocol is used for the last a kind of host-host protocol at multimedia data stream of Internet
● RTCP:Real-time Transport Control Protocol RTCP Real-time Transport Control Protocol
● the I/O:(I/O) port
● TS: label
● EPG:Electronic Program Guide electric program menu
● DRM:Digital Rights Management content digital publishing rights encipherment protection technology
● QoS:Quality of Service service quality/quality of service
● Click to Dial: the speed of integrating address list is dialled application
● SoC:System-On-a-Chip is integrated in the system on the chip piece, monolithic system
● BIC: Bus Interface Chip