CN102970286A - Automatic speech and multimedia information communication middleware system - Google Patents
Automatic speech and multimedia information communication middleware system Download PDFInfo
- Publication number
- CN102970286A CN102970286A CN2012104426339A CN201210442633A CN102970286A CN 102970286 A CN102970286 A CN 102970286A CN 2012104426339 A CN2012104426339 A CN 2012104426339A CN 201210442633 A CN201210442633 A CN 201210442633A CN 102970286 A CN102970286 A CN 102970286A
- Authority
- CN
- China
- Prior art keywords
- data
- layer
- communication
- interface
- middleware
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention relates to an automatic speech and multimedia information communication middleware system. A server of the system comprises a hardware architecture and a software architecture. The server and each operation system of a client side conduct data interaction through an interface protocol to form a loose coupling system architecture. Modules in all layers of in the software architecture allow dynamic loading and unloading, and high aggregation calculation is achieved in the layers through a height packaging tight coupling mode. The middleware system uses a telecom computer automation treatment mode to replace an old manual mode, solves oneness of working forms of inland medium-sized and small enterprises in aspects of external notification, customer information search and notification scheduling at present, and improves low-efficiency manual flow at present, and avoids high stoppage under a manual handling environment.
Description
Technical field
The present invention relates to a kind of multimedia messages notice interactive system by computer controlled automatic, particularly relate to a kind of automatic speech and multimedia messages communication middleware system.
Background technology
Rise along with in recent years ecommerce, and the popularizing of the Internet, communication terminal, increasing people selects to carry out on the internet e-commerce initiative, the production load of the relevant supporting traditional industries such as the logistics transportation that huge trading volume makes is increasing, especially be embodied in this one side of customer service
Along with the traffic carrying capacity explosive growth, the activity of the service such as corresponding customer notification, business consultation, inquiry also first mate increases, this head and shoulders above the customer service of existing most logistics company bear pressure.The information communication AC mode that old poor efficiency is single more and more can not satisfy day by day huge service system demand, the mode of linking up also is badly in need of from one to one original, the mode of literal or audio frequency is upgraded to present one-to-many, multi-to-multi, the multimedia messages mixed modes such as literal, image, audio frequency, video.Increasing enterprise need to come the information communication of the flow processs such as process for producing, service, management mutual with convenient, rapid, timely, efficient mode.
Summary of the invention
The technical problem to be solved in the present invention provides a kind of automatic speech and multimedia messages communication middleware system, can share a series of functions such as broadcasting for enterprise provides verbal announcement, Interactive Voice Response, audio/video conference, short message up-downgoing, multimedia messages, the mode of separate server is moved in the Intranet environment, this system can be the issue of external information notice, the customer self-service inquiry of enterprise, and the internal training communication exchange provides and enriches polymorphic mode and approach.It has flexibly extension expansion, can with the operation system slitless connection of corporate client, by the configuration feature of this platform, corporate client can the most reasonably carry out flexible dispatching to various information to be used, and makes it jointly use the maximum supporting role of performance for the information of corporate client.This system can also integrate the existing telecommunications hardware circuit of client resource, and by configuration path, the execution passage of the selection information of intelligence is not wasted the existing line resource of client, does not lose, and avoids overlapping investment, reaches the maximization effect that resource distribution utilizes.
For solving the problems of the technologies described above, the invention provides a kind of automatic speech and multimedia messages communication middleware system, comprise one be placed on move in the Intranet independently, carry out data communication is then carried out in data interaction, the fire compartment wall outside by the Internet or Leased line and the basic line resource of each operator or intermediary service gateway hardware server in the fire compartment wall inboard by Ethernet and each operation system of enterprise.Described server comprises mainly by Data Collection, data encoding Transpression, transfer of data, hardware driving, the hardware structure that communication control processor is realized, service logic disposes, data memory module forms and the software architecture that mainly is comprised of hardware driving, communication protocol control, business logic processing, data transaction transmission, data acquisition feedback, charging processing, application and development interface, system's operation monitoring layer.Each operation system of described server and customer side is carried out data interaction by interface protocol, has consisted of the system architecture of loose coupling.The module of all in the software architecture layer allows dynamic load and unloading, realizes calculating high the gathering by highly encapsulating loose coupling in the layer, and retrains separately category of behavior by set interface; The top layer system makes up the functional interface that calls between each level one by one according to every business configuration model, forms the automatic operation flow process.
The Hardware drive module of described hardware structure is carried out unified classification encapsulation with every hardware driving system, the hardware cell that will have the same behavior attributive character, carry out more higher leveled encapsulation and integrate, generate the unified hardware device drivers that can be flexibly the every hardware device resources in the system be connected driving of a cover and call framework.
The communications protocol gateway of described software architecture comprises the short messaging gateway that has encapsulated note and multimedia message communication protocol, realize the PSTN gateway that calls, has media processing function, communication function of SS1, SS7, ISDN, pri signaling, and the Session Initiation Protocol gateway of the two-way communication of the data communication of responsible realization system and Internet user and 3G network users, realization PSTN and INTERNET.Described Session Initiation Protocol gateway comprises Real-time Transport Protocol, the H.323 realization of agreement and S IP agreement.
The business logic processing layer of described software architecture comprises by user configured rule each level module that system is related and carries out concatenated call, service logic is run through to be blended in each level module forms workflow and support forward, reverse and two-way system side logic realization in conjunction with persistence run user side logic realization and supported data collection, service billing, system's snapshot.
The data transfer layer of described software architecture is responsible for converting initial data to standard that each business model needs, realizes the self-defining encapsulation format of client that the data feedback layer is collected.Described data transfer layer is combined conversion and the processing that realizes the needed various document format datas of various signalings with described base communications protocol gateway module, compress by the transformation of ownership, convert initial data to data format that each agreement is stipulated, carry out communication transfer; And the interim large quantity file data that produces in the user interaction process carried out the segmentation cutting, preserve in the strange land.
The data acquisition feedback layer of described software architecture has designed the data acquisition webpage of different mode according to the behavior property of every business, has the checking of submission, control, management and result of information, the derivation of form, and interface issues function.The Web system of described data acquisition feedback layer also provides configurable rights management, and the Web System Privileges is not for being subjected to the irregularly shaped of level restriction, come fully according to the actual requirements self-defined, all personalizable configuration managements of all functions.Issue function by described interface, can realize the support to the self-defining data packet format of customer side, custom system can realize the data interaction with middleware system, and middleware system can issue various state informations that custom system produces and object information constantly to the customer side system when the data link of data-pushing interface.
System's operation monitoring layer of described software architecture realizes that physical memory monitoring, CPU usage monitoring, the monitoring of disk space utilization rate, task on average send duration monitoring, network condition monitoring and database monitoring.Described system operation monitoring layer is monitored and operating state information acquisition the ruuning situation of each operational module, by analyzing data, forming curves figure.When the moving body of collecting is detectd when exceeding preset range, or when producing fault, system's operation monitoring layer can be controlled middleware system and carry out by different way alarm.
The moving body that system operation monitoring layer is collected is detectd the desired value of the system that refers to of institute when each operational module of run duration moves, the operating index value of modules can constantly change with the variation of the load of the amount of managing business or throughput along with the load of operating system, and the sign of the long-time superelevation of operating index value before to be system break down.System's operation monitoring layer is monitored the desired value of total system operation constantly, and when the desired value value surpassed the alarming value that arranges, system's operation monitoring layer can trigger alarm module, reports to the police.
The hardware server of middleware system is independent and other server; Hardware server is placed in the Intranet and moves, carry out data interaction in the fire compartment wall inboard by Ethernet and each operation system of enterprise, the fire compartment wall outside is then carried out data communication by the Internet or Leased line with the basic line resource of each operator or intermediary service gateway.Owing to adopt the framework of independent operating, so each operation system of middleware system and customer side is to carry out data interaction by interface protocol, guaranteed the independence and stability of both sides systems, consisted of the system architecture of good loose coupling.
The hardware structure of middleware system is mainly stored these 7 unit modules and is formed by Data Collection, data encoding Transpression, transfer of data, hardware driving, communication control processor realization, service logic configuration, data.Connection between Processes combination by these 7 modules, middleware system can become various business configuration independently Work flow model to carry out automatic streamline to carry out.
The software architecture of middleware system adopts the multi-layer framework mode development, comprises hardware driving, communication protocol control, business logic processing, data transaction transmission, data acquisition feedback, charging processing, application and development interface.All layers allow dynamic load and unloading, can realize easily the Dynamic expansion of system and dynamically switching; This will improve middleware system reliability of operation, availability and maintainability greatly.In the software architecture every layer all is responsible for realizing logic affairs separately, realizes calculating high the gathering by highly encapsulating loose coupling in the layer, and retrains separately category of behavior by set interface.Top layer makes up the functional interface that calls between each level one by one according to every business configuration model, forms the automatic operation flow process, thereby reaches set purpose.Layering independently loose coupling structure system has guaranteed that the inefficacy of arbitrary level of system or functional module can not cause the inefficacy of other functional modules.The arbitrary module of random time increase/start/stop all can not cause the unusual of whole system or other modules.The user can not affect the operation of other operation flow to dynamically updating that each workflow is carried out, also need not interrupting service.
Every hardware cell equipment in the middleware system, the driver module of unit such as voice plate card, fax integrated circuit board, conference card, video frequency collection card, VOIP data conversion card produces the numerous and diverse numerous driving system of family and has carried out unified classification encapsulation each.Hardware drive module will have the hardware cell of same behavior attributive character, carrying out more higher leveled encapsulation integrates, thereby generate the unified hardware device drivers of a cover and call framework, utilize this framework to connect driving to the every hardware device resources in the system flexibly, adjust during operation, thereby driving arrangement carries out work better more flexibly.
The communications protocol gateway comprises short messaging gateway, PSTN gateway and S IP protocol gateway, possess many nets, the simultaneously treated ability of multi-service, throughput is large, disposal ability is strong, be the core of middleware system, have the function of all bottoms and operator's communication, respectively as follows:
1. short messaging gateway has encapsulated mobile CMPP communications protocol, the SMGP communications protocol of UNICOM and SMGP communications protocol, the MM7 multimedia message communication protocol of telecommunications, realizes that the weak point/multimedia message to three large operators accesses.
2.PSTN gateway has been realized the calling of SS1, SS7, ISDN, pri signaling of present main flow, relate to each flow processs such as calling, data transmission, exchange/media processing, the signaling protocol of complexity is passed through the encapsulation of height, what make calls the flexibly simple of change, only one group of simple AP I function need be called, just various functions can be finished.By the SOCKET packet interface of standard, the information such as other module of system can swap data any with it, control command, event, the PSTN gateway is responsible for realizing following functions:
1) media processing function: comprise all functions (speech recording and reproducing, echo cancelltion, GTD/GTG, DTMF/FSK transmitting-receiving, large capacity meeting, sound special efficacy, FAX etc.) that Voice media processing can provide on prior art.
2) communication function: comprise the support (SS1/DSS1/SS7/ISDN/PRI) of various signalings, the support (Digital Access E1, analog junction/analog subscriber/high resistant/VoIP access etc.) of various telecommunication interfaces is provided.
3.VOI the P SGW is responsible for the data communication of realization system and Internet user and 3G network users, converts traditional circuit switching to the IP exchange, decoding PSTN voice signal also converts the SIP bag to, thereby realizes the two-way communication of PSTN and INTERNET.The VOIP SGW comprises the realization of following three sub-protocols:
1) realization of Real-time Transport Protocol:
(1) meets RTP/RTCP standard agreement (RFC3551/3552);
(2) voice encoding and decoding format: G.711/A rule, self adaptation G.723.1(5.3/6.3kbps), G.729A/B/AB;
(3) coding and decoding video form: H.263, H.263+, H.264, MPEG-4/V;
(4) movable voice detection/silence compression (G.723/G.729);
(5) comfort noise;
(6) fax pattern: T.38/udptl fax and T.30 transparent transmission (G.711);
(7) voice packet sampling length/frame number configurable (10-60 millisecond);
(8) the dynamic DTMF load of RTP (RFC2833/4733);
(9) jitter buffer: support simultaneously static buffering mode and dynamic self-adapting mode;
(10) network environment analysis, packet loss statistics;
(11) support NAT/ fire compartment wall detects and penetrates.
2) the H.323 realization of agreement
(1) meets H.323v2 standard (H.225v2/H.245v3) of ITU-T;
(2) support to start fast (Fa s t S tar t), calling parameters such as tunnel (H.245Tunne ling) H.245;
(3) call out transfer;
(4) gatekeeper finds (Ga tekeeper Auto Di s covery) and login (supporting simultaneously H.323UI D and E164 number registration mode) automatically;
(5) H.245 user's input characters and dtmf signal message (Us er I nput I ndi ca t i on);
(6) endpoint registration management.
2) realization of S IP agreement
(1) meets IETF SIPv2 standard (RFC3261);
(2) UDP/TCP transmission means;
(3) MD5(digest) authentication;
(4) REFER calls out and shifts (RFC3515);
(5) S IP message subscribing/notifying (RFC3265SUBSCRIBE/NOTIFY);
(6) acting server registration, authenticated client;
(7) SIP INFO (RFC2976);
(8) registrar (Registrar), support service end authentication
(9) support the NAT/ fire compartment wall to penetrate.
The business logic processing layer is divided into user's side logic realization and system side logic realization two parts.User's side logic is responsible for realizing user configured service logic, carry out concatenated call by each level module that user configured rule is related with system, service logic run through be blended in each level module, form workflow, support, forward, oppositely and two-way move in conjunction with persistence.Wherein,
1) forward part:
(1) voice group busy, facsimile cluster sending
(2) short message, multimedia message group sending
(3) the S IP message multicasts
(4) IM information multicasts
2) oppositely partly:
(1) short message uplink receiving
(2) speech data receives
(4) the up inquiry of voice
(5) SIP, IM message sink
3) mutual part:
(1) voice, video conference
(2) the short message up-downgoing is professional
(3) voice automatic-answering back device mutual (IVR)
(4) PSTN+VOIP data communication
System side logic realization following functions:
1) data acquisition: comprise web data acquisition, interface data collection, data validity judges, DB mode data orientation is obtained etc.
2) service billing: the constantly charging of miscellaneous service, press the bar charging such as short message, the charging of multimedia message byte, voice duration based accounting, the charging of IM service traffics.
3) system's snapshot: the trip information of each module of dynamic collection system, by analyzing, formulate optimum executive plan, do dynamic adjustment strategy according to the load condition of collecting each unit of runtime system: than busy, adopt less but the strategy with enough accuracy of amount of calculation to guarantee the response speed of system in system; In system's busy not, adopt the higher implementation strategy of precision, guarantee the execution result efficient of system:
(1) every 1 hour, generates the once running status snapshot of unit modules at different levels, for the O﹠M analysis.
(2) runtime data and historical data are divided the example operation, creation data one operation is finished, and is transferred to history lists from the production table at once, can guarantee like this high efficiency of production table, production system is not caused accumulation when guaranteeing large quantity, affect production system and carry out efficient.Independently query case and running environment have also guaranteed when carrying out extensive historical data report statistics, the overall performance of not loss production system.
The dynamic registration debugging provides command line interface when (3) supporting operation, carries out order control output for the O﹠M personnel, and system supports the run time behaviour output of following several respects:
A. the packet in the agreement communication process is printed
B. the unexpected message in the gateway running is printed
C. the dynamic state of parameters adjustment in the gateway running
D. database session process tracking output (output of Oracle 10046 events)
E. database session statement execution plan output
The data that data transfer layer receive data acquisition module produces convert initial data to standard that each business model needs, call for modules in the workflow.Be responsible for to realize simultaneously the self-defining encapsulation format of client that the data feedback module is collected, carrying out as a result for the data feedback module, web presents, report output and interface propelling movement.
The data transfer layer is combined with the base communications protocol gateway module and is responsible for realizing the needed data format of various signalings, data packet format, audio frequency and video form, fax paper format conversion and processing, compress by the transformation of ownership, initial data is changed the data format of each agreement regulation, carry out communication transfer, with the interim large quantity file data that produces in the user interaction process, for example: leave a message file, session recording file of user carries out the segmentation cutting, and preserve in the strange land.
1) data transaction:
(1) audio coding decoding: sample rate: 6K/8KHZ coded system: A rule/μ rule PCM, AMI-ADPCM, G729, G723.1 etc.
(2) coding and decoding video: support MPEG4, H.263/H.264 wait
(3) media file format: support 3GP, AVI, MPEG4, WAVE, PCM, ADPCM, VOX, MP3 etc.
2) big data quantity transmission: large data files is carried out height ratio integrate compression, adopt external advanced compression algorithm, improved under the traditional mode figure, the low situations of compression ratio such as voice document, new algorithm can in the situation that guarantees the compression quality, be promoted to 30%-40% with compression ratio by 10%-20%.The application of the technology such as segment transmissions, breakpoint transmission has guaranteed the efficiently complete of transmission aspect, compares with traditional wall scroll serial transmission, and new architecture mode can promote the transmission rate more than 5 times, the monofile transmission capacity more than 3 times.
(1) data height ratio compression
(2) segment transmissions
(3) breakpoint transmission
(4) service end is transmitted, is broadcasted
(5) point-to-point direct sending
The input and output of data are carried out at the web interface that the user can provide by the data acquisition feedback layer of middleware system, the data acquisition feedback layer of middleware system is according to the behavior property of every business, designed the data acquisition webpage of different mode, the user can by the platform that logs in middleware system realize information submission, control, management and result check the operations such as the derivation of form.The data acquisition feedback layer also provides configurable rights management: all personalizable configuration managements of all functions, System Privileges upgrades to not limited by level irregularly shaped by traditional inverted pyramid structure, comes fully according to the actual requirements self-defined.
The platform of middleware system provides the application and development interface of all functions, and the DLL (dynamic link library) that SMS, CTI, ACD, voice/Faxmail IVR, IM etc. are powerful, be convenient to develop is provided, and has good opening.VC++, C#, Java, VB, the mainstream speeches such as Powerbuilder, Delphi are supported in the language aspect, and Http, webService, the multiple connection modes such as Socket, Com+ are supported in the access module aspect.
Aspect data feedback, the data acquisition feedback layer not only provides the web interface of traditional aspect to check, the form export function, also provide interface to issue function, custom system is carried out data interaction by the platform of realizing data-pushing interface protocol and middleware system, and the data link of the platform of middleware system by the data-pushing interface issues various state informations that custom system produces and object information constantly to the customer side system.The data-pushing interface is supported the self-defining data packet format of customer side, makes things convenient for the docking of user's side system.
System's operation monitoring layer is responsible for the ruuning situation of each operational module in the platform is monitored and operating state information acquisition, by analyzing data, forming curves figure, the intuitively at that time time of observing system and the ruuning situation of time in the past, and running trend trend.
Running status to each unit module of system gathers system's operation monitoring layer in system's normal operation period, when system's high load capacity operation of continuous long period, monitor supervision platform can come Adjustment System backstage parameter according to the state parameter of collecting, such as the parallel threshold values of submitting to of short message channel, shorten the overtime duration of ring back tone of relaying passage, the unusual number of retries of called end is come the execution efficient of elevator system, reduces load.
When systematic collection to moving body detect when exceeding preset range or producing fault, system's operation monitoring layer can carry out alarm by different way, the O﹠M personnel can search according to graphic interface instruments such as field data figure or trend graph the time period of unusual fluctuations, the time point of quick positioning question is investigated in conjunction with the daily record description.Abnormality alarming information can be by pc client bullet screen, and note issues, PC plays the forms such as buzzer and Email and sends.
The monitoring range of system's operation monitoring layer is as follows:
1) physical memory monitoring: the situation of the physical content of using by system, the ruuning situation of monitor operating system, and be less than a certain amount of the time at internal memory, report to the police.
2) CPU usage monitoring: the operating position of the CPU of supervisory control system, in system, if having some services or process situation to occur, take a large amount of cpu times, when reaching certain value, sent warning, handle it in advance, prevent the generation of fault.
3) disk space utilization rate monitoring: the disk operating position of supervisory control system main frame, when disk space will be not enough, to report to the police, reminding user need to increase disk or some files are backed up and shift, prevent from causing the paralysis of system because disk is not enough.
4) task on average sends the duration monitoring: the average transmission duration to task is monitored, and when average duration strengthened suddenly, system can report to the police, in advance fault is got rid of.
5) network condition monitoring: the situation to network is monitored, and when special circumstances occurred, whether reporting system will carry out route to task, improves promptness and the accuracy of task.
6) database monitoring: the ruuning situation of monitor database, abnormal conditions appear in some values at database, too high such as linking number, in the situations such as Database lock rolls up, report to the police, in advance system and database are processed, prevent the appearance of database collapse situation, strengthen the continual and steady serviceability of system.
The mode that this middleware system is processed with the telecommunications computer automation has replaced old manual type, promoted productivity, the material impact that the trend of having avoided human cost to improve is year by year brought the customer service industry, solved present domestic medium-sized and small enterprises in the unicity of the working forms of the aspects such as external notice, customer information inquiry, notice scheduling, improved the artificial flow process of present poor efficiency, avoid the high fault under the artificial treatment environment, when the first mate that reduces production costs promotes operating efficiency, also liberated corresponding work position labour.The mode that the information of middleware system presents is also from one to one original, and the mode of literal or audio frequency is upgraded to present one-to-many, multi-to-multi, the multimedia messages mixed modes such as literal, image, audio frequency, video have enriched the form that presents of information.Text conversion voice, voice messaging are grouied busy, automatic voice responding is inquired about, audio/video conference, the multimedia messages suites of measure of multiple technologies such as multicast has enriched the approach that exchanges between customer service department and the client in many ways, has promoted the customer service satisfaction.
Description of drawings
Below in conjunction with accompanying drawing the specific embodiment of the present invention is described in further detail.
Fig. 1 is the hardware structure of automatic speech of the present invention and multimedia messages communication middleware system;
Fig. 2 is the software architecture of automatic speech of the present invention and multimedia messages communication middleware system;
Fig. 3 is the loose coupling structure system of automatic speech of the present invention and multimedia messages communication middleware system;
Fig. 4 is the schematic diagram that public network pattern that client is passed through the internet accesses automatic speech of the present invention and multimedia messages communication middleware system;
Fig. 5 is the enterprises user accesses automatic speech of the present invention and multimedia messages communication middleware system by built-in enterprise network schematic diagram.
Fig. 6 is the frame diagram of the base communications protocol gateway module of automatic speech of the present invention and multimedia messages communication middleware system;
Fig. 7 is the Work flow model figure of automatic speech of the present invention and multimedia messages communication middleware system.
Fig. 8 is the compressing file fate map of the data transfer layer of automatic speech of the present invention and multimedia messages communication middleware system;
The functional structure chart at the web-based management interface that Fig. 9 provides for the data acquisition feedback layer of automatic speech of the present invention and multimedia messages communication middleware system.
Figure 10 is running environment, secondary development language, host-host protocol and the database platform tabulation figure that automatic speech of the present invention and multimedia messages communication middleware system are supported.
Display waveform figure when Figure 11 is the CPU usage of system operation monitoring layer monitoring of automatic speech of the present invention and multimedia messages communication middleware system.
Figure 12 is the disk space utilization rate block diagram of system's operation monitoring layer monitoring of automatic speech of the present invention and multimedia messages communication middleware system.
Figure 13 is the network packet loss rate oscillogram of system's operation monitoring layer monitoring of automatic speech of the present invention and multimedia messages communication middleware system.
Figure 14 is the signaling status code criteria classification figure of automatic speech of the present invention and multimedia messages communication middleware system.
Embodiment
Embodiment 1
Middleware system is supported the public network access, with the built-in two kinds of subordinate's patterns of enterprise.The user of public network access style can carry out the data typing by the Internet logon operation network address by corresponding domain name and submit to, perhaps by calling platform opening webService service, realizes corresponding function.
The built-in mode of enterprise is for being installed in the hardware server of a platform independent with middleware system and being positioned in the Intranet.External communication is undertaken by Leased line or public network in the ICP/IP protocol mode.Packet adopts RSA asymmetric encryption strategy, client and service end are owned one group 1024 encryption key and PKI together, PKI is used for sending the encryption of packet, and private key is used for the packet that receives is decrypted, and improves so to the full extent the fail safe of transmission.Internal communication connects by the Ethernet mode.Basic data is carried out in the mode of intermediate database alternately, has guaranteed like this independence and the fail safe of both sides systems.Each operation system of enterprise is committed to intermediate database with task by Web interface or data-interface, after business logic processing and data transaction, be sent to each operator's ground line channel platform and be sent to the mobile reception terminal by each functional protocol gateway, otherwise receive user's information feedback from business system when middleware platform after, information can be formatd encapsulation, and push to information receiving end with the form of web interface form or data-interface.
Middleware system provides the API second development interface of consolidation form, is used for realizing that the related Data Collection of each business function, data are carried out and result feedback issues.Numerous and diverse communication protocol and concrete service application are separated.Called side only needs the form according to definition, by the set interface method of process invocation of definition, can realize corresponding workflow.
Automatic speech is mutual to be to collect the standardized integrated communication platform that voice, note, fax, meeting, IVR, instant messaging etc. are served one with multimedia messages communication middleware system, have that powerful communications, speech processes, fax conversion, recording are synthetic, phone tandem, multimedia interactive, multichannel short message disposal ability, SDK assembly, the WAP assembly of platform by standard is connected CRM, OA, ERP system and connected with the user, realize low input, high efficiency, the concentrated communication service of Full Featured enterprise-level, this middleware system has following function:
1) the intelligent text Voice Conversion Techniques of high accuracy: the analysis of high accuracy intelligent text and preconditioning technique that middleware system has, the effective guarantee phonetic synthesis is accurate, smooth, nature, professional sound bank in magnanimity adds that powerful autonomous learning function basis is by constantly training, optimization, make the TTS switch technology in the difficult point in the face of processing for language analysis, such as polyphone, polysemant, additional character, prosodic phrase, unregistered word (such as place name, name, address) etc., also can ensure the automatic result that obtains pin-point accuracy.
2) graph image conversion compression process technology: aspect graph and image processing, middleware system has carried out expansion and has extended on MFC-GUI graph and image processing class libraries basis, and final encapsulation has formed Vcom fax figure image transitions compression engine.
The present various main flow electronic documents of this engine support, image format conversion become the Tiff facsimile format, and Word and xls document and Pdf electronic document are supported in the electronic document aspect.Present common Jpeg, Jpg, Gif, the Bmp file of support aspect image file.Compatible at present ccitt3 and the ccitt4 algorithm of main flow of while aspect image compression.
3) audio conversion treatment technology: aspect the audio conversion processing, middleware system has carried out secondary research and development expansion on the kit basis that the DirectShow Streaming Media is processed, and final encapsulation has formed unique audio conversion processing engine.This engine provides strong support to audio types conversion, compression, the editor of various forms.Support widely it to support widely turning mutually between the various medium types, comprise Asf, Avi, Mp3, Wave, Wma etc.Support turning mutually such as Pcm, Adpcm, Ccitt, Ccitt-ALaw, Ccitt-U Law, Mpeg, Mpeg-Layer3 etc. between the various compressed formats.
4) pstn signaling net Development Framework: middleware system has been realized the aspect Integrated Developments such as the related circuit switching of PSTN net, speech processes, resource distribution, traffic signaling, support simultaneously multiple signaling exploitation, comprise cno.1, No. one, numeral, I SDN or Signaling System Number 7.PC-PBX (driving is called), ACD(automatic traffic are distributed), the IVR(interactive voice response), numerous business function functions such as CTI service converge integrated, the multi-zone supervision of employing NameSpace formula.Can call combination according to the actual conditions flexible configuration during secondary development that makes, greatly improve the development efficiency of program.
5) unified signaling status code standard: it is unified that middleware system has carried out arrangement with the conditional code of various signaling protocols (voice, short multimedia message, VOIP, IM), the part that has the joint act attribute in the rich conditional code that is of complexity has been carried out the layering classification, unusual ownership has been carried out classification.By environment classification and user group form that the result presents, system's investigation two large codes and standards.Run through data submission, data processing, result feedback three large processes.
Obviously, the above embodiment of the present invention only is for example of the present invention clearly is described, and is not to be restriction to embodiments of the present invention.For those of ordinary skill in the field, can also make other changes in different forms on the basis of the above description.Here can't give all execution modes exhaustive.Everyly belong to the row that apparent variation that technical scheme of the present invention extends out or change still are in protection scope of the present invention.
Claims (10)
1. automatic speech and multimedia messages communication middleware system, comprise that one is placed on and moves in the Intranet independently, carry out data interaction in the fire compartment wall inboard by Ethernet and each operation system of enterprise, the hardware server of data communication is then carried out in the fire compartment wall outside by the Internet or Leased line and the basic line resource of each operator or intermediary service gateway, it is characterized in that: described server comprises mainly by Data Collection, the data encoding Transpression, transfer of data, hardware driving, communication control processor is realized, the service logic configuration, the hardware structure that data memory module forms and mainly by hardware driving, the communications protocol gateway, business logic processing, the data transaction transmission, the data acquisition feedback, charging is processed, the application and development interface layer, the software architecture that system's operation monitoring layer forms; Each operation system of described server and customer side is carried out data interaction by interface protocol, has consisted of the system architecture of loose coupling; The module of all in the software architecture layer allows dynamic load and unloading, realizes calculating high the gathering by highly encapsulating loose coupling in the layer, and retrains separately category of behavior by set interface; The top layer system makes up the functional interface that calls between each level one by one according to every business configuration model, forms the automatic operation flow process.
2. middleware system as claimed in claim 1, it is characterized in that: the Hardware drive module of described hardware structure is carried out unified classification encapsulation with every hardware driving system, the hardware cell that will have the same behavior attributive character, carry out more higher leveled encapsulation and integrate, generate the unified hardware device drivers that can be flexibly the every hardware device resources in the system be connected driving of a cover and call framework.
3. middleware system as claimed in claim 1, it is characterized in that: the communications protocol gateway of described software architecture comprises the short messaging gateway that has encapsulated note and multimedia message communication protocol, realize the PSTN gateway that calls, has media processing function, communication function of SS1, SS7, I SDN, pri signaling, and the S IP protocol gateway of the two-way communication of the data communication of responsible realization system and Internet user and 3G network users, realization PSTN and INTERNET; Described S IP protocol gateway comprises Real-time Transport Protocol, the H.323 realization of agreement and S IP agreement.
4. middleware system as claimed in claim 2, it is characterized in that: the communications protocol gateway of described software architecture comprises the short messaging gateway that has encapsulated note and multimedia message communication protocol, realize the PSTN gateway that calls, has media processing function, communication function of SS1, SS7, I SDN, pri signaling, and the S IP protocol gateway of the two-way communication of the data communication of responsible realization system and Internet user and 3G network users, realization PSTN and INTERNET; Described S IP protocol gateway comprises Real-time Transport Protocol, the H.323 realization of agreement and S IP agreement.
5. as the described middleware system of above-mentioned arbitrary claim, it is characterized in that: the business logic processing layer of described software architecture comprises by user configured rule each level module that system is related and carries out concatenated call, service logic is run through to be blended in forms workflow in each level module and support forward, reverse and two-way system side logic realization in conjunction with persistence run user side logic realization and supported data collection, service billing, system's snapshot.
6. such as arbitrary described middleware system among the claim 1-4, it is characterized in that: the data transfer layer of described software architecture is responsible for initial data is converted to the standard of each business model needs, realizes the self-defining encapsulation format of client that the data feedback layer is collected; Described data transfer layer is combined conversion and the processing that realizes the needed various document format datas of various signalings with described base communications protocol gateway module, compress by the transformation of ownership, convert initial data to data format that each agreement is stipulated, carry out communication transfer; And the interim large quantity file data that produces in the user interaction process carried out the segmentation cutting, preserve in the strange land.
7. want 5 described middleware systems such as right, it is characterized in that: the data transfer layer of described software architecture is responsible for initial data is converted to the standard of each business model needs, realizes the self-defining encapsulation format of client that the data feedback layer is collected; Described data transfer layer is combined conversion and the processing that realizes the needed various document format datas of various signalings with described base communications protocol gateway module, compress by the transformation of ownership, convert initial data to data format that each agreement is stipulated, carry out communication transfer; And the interim large quantity file data that produces in the user interaction process carried out the segmentation cutting, preserve in the strange land.
8. such as arbitrary described middleware system among the claim 1-4, it is characterized in that: the data acquisition feedback layer of described software architecture has designed the data acquisition webpage of different mode according to the behavior property of every business, the checking of submission, control, management and result with information, the derivation of form, and interface issues function; The Web system of described data acquisition feedback layer also provides configurable rights management, and the Web System Privileges is not for being subjected to the irregularly shaped of level restriction, come fully according to the actual requirements self-defined, all personalizable configuration managements of all functions; Issue function by described interface, can realize the support to the self-defining data packet format of customer side, custom system can realize the data interaction with middleware system, and middleware system can issue various state informations that custom system produces and object information constantly to the customer side system when the data link of data-pushing interface.
9. middleware system as claimed in claim 5, it is characterized in that: the data acquisition feedback layer of described software architecture has designed the data acquisition webpage of different mode according to the behavior property of every business, the checking of submission, control, management and result with information, the derivation of form, and interface issues function; The Web system of described data acquisition feedback layer also provides configurable rights management, and the Web System Privileges is not for being subjected to the irregularly shaped of level restriction, come fully according to the actual requirements self-defined, all personalizable configuration managements of all functions; Issue function by described interface, can realize the support to the self-defining data packet format of customer side, custom system can realize the data interaction with middleware system, and middleware system can issue various state informations that custom system produces and object information constantly to the customer side system when the data link of data-pushing interface.
10. middleware system as claimed in claim 6, it is characterized in that: the data acquisition feedback layer of described software architecture has designed the data acquisition webpage of different mode according to the behavior property of every business, the checking of submission, control, management and result with information, the derivation of form, and interface issues function; The Web system of described data acquisition feedback layer also provides configurable rights management, and the Web System Privileges is not for being subjected to the irregularly shaped of level restriction, come fully according to the actual requirements self-defined, all personalizable configuration managements of all functions; Issue function by described interface, can realize the support to the self-defining data packet format of customer side, custom system can realize the data interaction with middleware system, and middleware system can issue various state informations that custom system produces and object information constantly to the customer side system when the data link of data-pushing interface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210442633.9A CN102970286B (en) | 2012-11-08 | 2012-11-08 | Automatic speech and multimedia information communication middleware system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210442633.9A CN102970286B (en) | 2012-11-08 | 2012-11-08 | Automatic speech and multimedia information communication middleware system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102970286A true CN102970286A (en) | 2013-03-13 |
| CN102970286B CN102970286B (en) | 2016-12-07 |
Family
ID=47800172
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210442633.9A Active CN102970286B (en) | 2012-11-08 | 2012-11-08 | Automatic speech and multimedia information communication middleware system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102970286B (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103716190A (en) * | 2013-12-25 | 2014-04-09 | 南威软件股份有限公司 | E-government internal network service application safety supervision method |
| CN105392149A (en) * | 2014-09-05 | 2016-03-09 | 中兴通讯股份有限公司 | Strategy adjusting trigger and strategy adjusting method and device, and strategy adjusting system |
| CN105898505A (en) * | 2016-04-27 | 2016-08-24 | 北京小米移动软件有限公司 | Method, device and system for testing audio and video synchronization in video instant messaging |
| CN105959972A (en) * | 2016-04-18 | 2016-09-21 | 重庆金美通信有限责任公司 | Improved method for full duplex conference |
| CN108521523A (en) * | 2018-04-08 | 2018-09-11 | 成都万维图新信息技术有限公司 | A kind of communication service multimedia middleware cut-in method |
| CN109639722A (en) * | 2019-01-07 | 2019-04-16 | 烽火通信科技股份有限公司 | The method and system of ISDN service access are realized on SIP gateway |
| CN110768870A (en) * | 2019-10-28 | 2020-02-07 | 中国联合网络通信集团有限公司 | Quality monitoring method and device for intelligent special line |
| CN111338927A (en) * | 2018-12-19 | 2020-06-26 | 国家电投集团科学技术研究院有限公司 | Nuclear power software efficient coupling analysis system |
| CN113316101A (en) * | 2021-02-19 | 2021-08-27 | 深圳力维智联技术有限公司 | Short message sending method, short message sending device, short message sending equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1403991A (en) * | 2002-10-25 | 2003-03-19 | 北京炎黄新星网络科技有限公司 | Efficient link-up management system |
| CN101208951A (en) * | 2005-06-28 | 2008-06-25 | 微软公司 | Creating standardized playlists and maintaining coherency |
| CN101706738A (en) * | 2009-10-29 | 2010-05-12 | 中国联合网络通信集团有限公司 | Flow application system |
-
2012
- 2012-11-08 CN CN201210442633.9A patent/CN102970286B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1403991A (en) * | 2002-10-25 | 2003-03-19 | 北京炎黄新星网络科技有限公司 | Efficient link-up management system |
| CN101208951A (en) * | 2005-06-28 | 2008-06-25 | 微软公司 | Creating standardized playlists and maintaining coherency |
| CN101706738A (en) * | 2009-10-29 | 2010-05-12 | 中国联合网络通信集团有限公司 | Flow application system |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103716190B (en) * | 2013-12-25 | 2017-12-22 | 南威软件股份有限公司 | The method of E-government Intranet service application safety supervision |
| CN103716190A (en) * | 2013-12-25 | 2014-04-09 | 南威软件股份有限公司 | E-government internal network service application safety supervision method |
| CN105392149A (en) * | 2014-09-05 | 2016-03-09 | 中兴通讯股份有限公司 | Strategy adjusting trigger and strategy adjusting method and device, and strategy adjusting system |
| WO2016033963A1 (en) * | 2014-09-05 | 2016-03-10 | 中兴通讯股份有限公司 | Policy adjustment trigger, policy adjustment method and device, and policy adjustment system |
| CN105959972A (en) * | 2016-04-18 | 2016-09-21 | 重庆金美通信有限责任公司 | Improved method for full duplex conference |
| CN105898505A (en) * | 2016-04-27 | 2016-08-24 | 北京小米移动软件有限公司 | Method, device and system for testing audio and video synchronization in video instant messaging |
| CN105898505B (en) * | 2016-04-27 | 2019-02-19 | 北京小米移动软件有限公司 | The method, apparatus and system of audio-visual synchronization are tested in video instant communication |
| CN108521523A (en) * | 2018-04-08 | 2018-09-11 | 成都万维图新信息技术有限公司 | A kind of communication service multimedia middleware cut-in method |
| CN111338927A (en) * | 2018-12-19 | 2020-06-26 | 国家电投集团科学技术研究院有限公司 | Nuclear power software efficient coupling analysis system |
| CN111338927B (en) * | 2018-12-19 | 2023-12-12 | 国家电投集团科学技术研究院有限公司 | Nuclear power software efficient coupling analysis system |
| CN109639722A (en) * | 2019-01-07 | 2019-04-16 | 烽火通信科技股份有限公司 | The method and system of ISDN service access are realized on SIP gateway |
| CN109639722B (en) * | 2019-01-07 | 2021-09-07 | 烽火通信科技股份有限公司 | Method and system for realizing ISDN service access on SIP gateway |
| CN110768870B (en) * | 2019-10-28 | 2021-05-28 | 中国联合网络通信集团有限公司 | Quality monitoring method and device for intelligent special line |
| CN110768870A (en) * | 2019-10-28 | 2020-02-07 | 中国联合网络通信集团有限公司 | Quality monitoring method and device for intelligent special line |
| CN113316101A (en) * | 2021-02-19 | 2021-08-27 | 深圳力维智联技术有限公司 | Short message sending method, short message sending device, short message sending equipment and storage medium |
| CN113316101B (en) * | 2021-02-19 | 2022-08-09 | 深圳力维智联技术有限公司 | Short message sending method, short message sending device, short message sending equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102970286B (en) | 2016-12-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102970286A (en) | Automatic speech and multimedia information communication middleware system | |
| CN102316311B (en) | Comprehensive video monitoring and scheduling system and method thereof | |
| US20090136009A1 (en) | Knowledge Management, Capture and Modeling Tool for Multi-Modal Communications | |
| CN100484037C (en) | Device tracking system, device and method | |
| CN101711469B (en) | Voicemail filtering and transcription | |
| CN101730879B (en) | Voicemail filtering and transcription | |
| CN101335869B (en) | Video conference system based on Soft-MCU | |
| CN101711381A (en) | Voicemail filtering and transcription system | |
| KR20100118059A (en) | Intelligent conference call information agents | |
| CN107241519A (en) | A kind of audio call centered video householder method and system | |
| CN202488489U (en) | Unified communication service trusteeship platform | |
| CN102412998A (en) | Operation service system and maintenance method and device thereof | |
| CN101471803B (en) | Conference service system and method | |
| CN110677540A (en) | Intelligent voice recognition management system for consultation telephone of medical institution | |
| CN108416721A (en) | A kind of emergency management system | |
| CN107707652A (en) | A kind of public information platform of sustainable communication | |
| CN107635016A (en) | A kind of call-information management method and system based on big data | |
| CN208188895U (en) | emergency management system | |
| CN110232533A (en) | A kind of power grid job order scheduling system and method | |
| CN100446510C (en) | System and method for implementing business integrating between interprises | |
| CN1169078C (en) | Efficient link-up management system | |
| CN102158615B (en) | LINUX-based media server in (Voice Over Internet Protocol) system and playback method of media server | |
| CN107612744A (en) | A kind of intelligent transportation equipment operational system based on mobile platform | |
| TWI478530B (en) | The method and system for ngn traffic monitoring | |
| CN112925694A (en) | Centralized alarm notification system and method based on rule engine |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20160907 Address after: Copper Road Software Avenue Gulou District of Fuzhou city in Fujian province 350000 No. 89 Fuzhou Software Park B District No. 23 building 301 room Applicant after: Chi Tong (Fujian) Mdt InfoTech Ltd Address before: Copper Road Software Avenue Gulou District of Fuzhou city in Fujian province 350000 No. 89 Fuzhou Software Park B District 23-301 Applicant before: Shanghai Foochow branch company of Ji Shi open network Science and Technology Ltd. |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |