CN116455879A - Method, device, medium and equipment for carrying out NLP real-time test based on fresh and WebRTC technology - Google Patents
Method, device, medium and equipment for carrying out NLP real-time test based on fresh and WebRTC technology Download PDFInfo
- Publication number
- CN116455879A CN116455879A CN202310275295.2A CN202310275295A CN116455879A CN 116455879 A CN116455879 A CN 116455879A CN 202310275295 A CN202310275295 A CN 202310275295A CN 116455879 A CN116455879 A CN 116455879A
- Authority
- CN
- China
- Prior art keywords
- browser
- freeswitch
- text information
- nlp
- webrtc
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 73
- 238000005516 engineering process Methods 0.000 title claims abstract description 43
- 238000000034 method Methods 0.000 title claims abstract description 38
- 230000007175 bidirectional communication Effects 0.000 claims abstract description 54
- 230000006854 communication Effects 0.000 claims abstract description 33
- 238000004891 communication Methods 0.000 claims abstract description 32
- 230000005540 biological transmission Effects 0.000 claims description 26
- 238000004590 computer program Methods 0.000 claims description 18
- 238000004458 analytical method Methods 0.000 claims description 13
- 230000007246 mechanism Effects 0.000 claims description 13
- 238000004806 packaging method and process Methods 0.000 claims description 10
- 230000011664 signaling Effects 0.000 claims description 7
- 230000000977 initiatory effect Effects 0.000 claims description 5
- 238000012216 screening Methods 0.000 claims description 4
- 230000000694 effects Effects 0.000 abstract description 3
- 238000003058 natural language processing Methods 0.000 description 102
- 238000010586 diagram Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 3
- 230000006978 adaptation Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000003776 cleavage reaction Methods 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000007017 scission Effects 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000010998 test method Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/20—Natural language analysis
- G06F40/205—Parsing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/332—Query formulation
- G06F16/3329—Natural language query formulation or dialogue systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1069—Session establishment or de-establishment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1073—Registration or de-registration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1101—Session protocols
- H04L65/1108—Web based protocols, e.g. webRTC
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The application relates to a method, a device, a medium and equipment for NLP real-time test based on a freeswitch and a WebRTC technology, wherein the method comprises the following steps: receiving a preset account transmitted by WebRTC in a browser through a freeswitch, and acquiring an effective user account corresponding to the preset account; receiving a starting instruction sent by a browser, and establishing a bidirectional communication channel between the freeswitch and the browser based on the effective user account; based on the two-way communication channel, text information corresponding to the voice stream transmitted by the WebRTC channel is obtained through the freeswitch, and the text information is analyzed through NLP, so that a context dialogue corresponding to the text information is obtained; the contextual dialog is sent to the browser through the freeswitch to cause the browser to present the contextual dialog in a text dialog. The method and the device have the effect of improving the NLP test efficiency.
Description
Technical Field
The application relates to the technical field of communication, in particular to a method, a device, a medium and equipment for NLP real-time test based on a freeswitch and a WebRTC technology.
Background
The public switched telephone network (Public Switched Telephone Network, PSTN), a commonly used legacy telephone system, i.e. a telephone network used in everyday life, is a global voice communication circuit switched network. But the PSTN also requires additional communication costs, which are greatly affected by the quality of the communication signal and policy.
When a traditional telephone is connected to conduct a conversation, the contextual conversations of the two parties cannot be seen in real time. In order to see the context dialogue of both parties in real time, a normal set of natural speech processing (Natural Language Processing, NLP) context dialogue is usually required to be online, and a great deal of training and NLP testing processes are required to be performed through the PSTN before a normal set of NLP context dialogue is online, so that the NLP testing efficiency is low.
Disclosure of Invention
In order to improve the NLP test efficiency, the application provides a method, a device, a medium and equipment for NLP real-time test based on a freeswitch and a WebRTC technology.
In a first aspect of the present application, a method for performing NLP real-time testing based on a freeswitch and WebRTC technology is provided, which specifically includes:
receiving a preset account transmitted by WebRTC in a browser through a freeswitch, and acquiring an effective user account corresponding to the preset account;
Receiving a starting instruction sent by a browser, and establishing a bidirectional communication channel between the freeswitch and the browser based on the effective user account;
based on the bidirectional communication channel, text information corresponding to the voice stream transmitted by the bidirectional communication channel is obtained through the freeswitch, and the text information is analyzed through NLP, so that a context dialogue corresponding to the text information is obtained;
the contextual dialog is sent to the browser through the freeswitch to cause the browser to present the contextual dialog in a text dialog.
By adopting the technical scheme, the WebRTC integrated in the browser sends the preset account to the freswitch in the server, the freswitch registers and authenticates the preset account, so that the preset account is registered as a valid account, namely a valid user account, then the freswitch receives a starting instruction sent by the browser, bridges the valid user account in the context, so that the freswitch and the valid user account establish communication, further the freswitch and the browser establish two-way communication, and a two-way communication channel between the freswitch and the browser is formed. And acquiring the voice stream transmitted by the browser and the freeswitch based on the bidirectional communication channel, and converting the voice stream into corresponding text information by the freeswitch. And finally, the new switch bridges a channel communicated with the NLP, sends text information to the NLP for analysis to obtain a context dialogue corresponding to the text information, and sends the context dialogue to a browser through a two-way communication channel, and displays a dialogue text box on a browser page, so that the NLP is tested in real time through the transmission of media streams (voice streams and texts) through the two-way communication channel, and NLP test efficiency is improved well without testing the NLP through PSTN (public switched telephone network) mass measurement test.
Optionally, the receiving, by a freeswitch, a preset account number transmitted by WebRTC in a browser, and obtaining an effective user account number corresponding to the preset account number, includes:
based on the SIP protocol, receiving a preset account transmitted by the WebRTC in the browser through a fresh switch;
registering the preset account through the fresh switch to obtain a registered account;
and carrying out 401 authentication on the registered account through the fresh switch, and if 401 authentication is successful, determining the registered account as a valid user account.
By adopting the technical scheme, the freeswitch in the server receives the preset account sent by the WebRTC based on the SIP protocol, then the freeswitch registers the preset account to obtain the registered account, and finally when the user logs in on the browser with the registered account, 401 authentication is performed on the registered account through the freeswitch, and identity verification is performed on the user corresponding to the registered account, if 401 authentication is successful, the authentication is proved to pass, so that the effective user is registered on the freeswitch, namely the effective user account is obtained, and the follow-up freeswitch and the browser are convenient to establish bidirectional communication.
Optionally, the receiving a start instruction sent by the browser, based on the valid user account, establishes a bidirectional communication channel between the freeswitch and the browser, including:
Receiving a starting instruction sent by a browser through websocket, and initiating a media call request to the browser by the fresh switch;
after a media call request is initiated to the browser through the freeswitch, a call instruction sent by the browser is received, the effective user account is bridged, and a bidirectional communication channel between the freeswitch and the browser is established through SIP signaling negotiation.
By adopting the technical scheme, after the effective user account number is determined, the freeswitch receives a starting instruction of NLP test sent by the browser, responds to the starting instruction through the freeswitch, and initiates a media call request to the browser, so that the browser and the freeswitch can perform formal voice call. And then after receiving a call instruction sent by the browser through the freeswitch, starting the voice call formally, bridging the effective user account, and establishing communication with the effective user account by utilizing the B2B function of the freeswitch, thereby rapidly establishing a bidirectional communication channel between the freeswitch and the browser, and further facilitating subsequent media stream transmission through the bidirectional communication channel.
Optionally, the bidirectional communication channel includes a WebRTC channel, and based on the bidirectional communication channel, the text information corresponding to the voice stream transmitted by the bidirectional communication channel is obtained through the freeswitch, and the text information is parsed through NLP, so as to obtain a context dialogue corresponding to the text information, which includes:
Acquiring an RTP voice stream transmitted by the WebRTC channel through the freeswitch;
converting the RTP voice stream into corresponding text information through an ASR technology;
packaging the text information to obtain packaged text information;
and sending the packaged text information to an NLP through the freeswitch for analysis, and obtaining a context dialogue corresponding to the text information.
By adopting the technical scheme, after the bidirectional communication channel between the freeswitch and the browser is established, the browser sends the RTP voice stream to the freeswitch through the WebRTC channel in the bidirectional communication channel, the freeswitch adopts the ASR technology of voice conversion text to convert the RTP voice stream into text information, and then the text information is packaged through the freeswitch, so that the safety in the text information transmission process is ensured. And finally, sending the packaged text information to an NLP, and carrying out context analysis on the packaged text information through the NLP to obtain a context dialogue corresponding to the text information, so that the context dialogue corresponding to the voice stream sent by the browser is obtained in real time.
Optionally, the bidirectional communication channel further includes a websocket channel, and after the RTP voice stream is converted into the corresponding text information by using an ASR technology, the method further includes:
Sending the RTP voice stream to the browser through the WebRTC channel by the fresh switch so as to enable the browser to play the RTP voice stream; or (b)
And sending the text information to the browser through the websocket channel by the fresh switch so as to enable the browser to play the text information.
By adopting the technical scheme, the websocket channel supports transmission of text and binary data as the WebRTC channel supports transmission of voice streams. Therefore, after the switch converts the RTP voice stream into text information, the RTP voice stream is sent to the browser for playing through the WebRTC channel in the bidirectional communication channel, so that a user can hear real-time dialogue voice in the browser, or the text information is sent to the browser through the websocket channel in the bidirectional communication channel, so that the user can read the text corresponding to the dialogue in real time in the browser.
Optionally, the bidirectional communication channel further includes a websocket channel, and the sending the context dialog to the browser through the freswitch, so that the browser displays the context dialog in a text dialog box, including:
Obtaining the context dialogue from the NLP through an NLP interface by the freeswitch;
packaging the context dialogue to obtain Event events;
and sending the Event to the browser through the websocket channel based on an MQ message mechanism, so that the browser displays the context dialogue in a text dialogue box.
By adopting the technical scheme, after the NLP analyzes the text information into the context dialogue, the NLP interface is called by the freeswitch, and the context dialogue is conveniently and safely acquired from the NLP. And then the context dialogue is packaged into Event by the new switch, the Event is converted into MQ information to be sent in a queue mode based on an MQ information mechanism, so that the system performance is effectively improved, and the time required by response is reduced. And finally, the MQ message converted from the Event is sent to the browser through a websocket channel in the bidirectional communication channel, so that the dialogue text (context dialogue) forming the context logic is displayed on a dialogue text box on a browser page, the NLP is tested stably in real time, and the NLP testing efficiency is improved.
Optionally, the sending, by the MQ-based messaging mechanism, the Event to the browser through the websocket channel, so that the browser exposes the contextual dialog in a text dialog box, including:
Based on an MQ message mechanism, acquiring a websocket channel set recorded by a server through the fresh switch, and screening the target websocket channel for starting instruction transmission from the websocket channel set;
and sending the Event to the browser through the target websocket channel so that the browser displays the context dialogue in a text dialogue box.
By adopting the technical scheme, the java application in the acquisition server acquires the websocket channel set, and the java application can automatically record all websocket channels established through the browser. Then judging whether a websocket channel used for starting instruction transmission exists in a websocket channel set, if so, determining the websocket channel used for starting instruction transmission in the websocket channel set as a target websocket channel, and further determining an object sent by the Event. And finally, sending the Event to a corresponding browser through a target websocket channel, so that the context dialogue is displayed in a text dialogue box of the browser, a user can directly see the context dialogue corresponding to dialogue voice in real time, and the NLP test efficiency is improved.
In a second aspect of the present application, a device for performing NLP real-time testing based on a freeswitch and WebRTC technology is provided, which specifically includes:
The account registration module is used for receiving a preset account transmitted by WebRTC in a browser through a freswitch and acquiring a valid user account corresponding to the preset account;
the channel establishing module is used for receiving a starting instruction sent by a browser and establishing a bidirectional communication channel between the fresh switch and the browser based on the effective user account;
the dialogue acquisition module is used for acquiring text information corresponding to the voice stream transmitted by the bidirectional communication channel through the freeswitch based on the bidirectional communication channel, and analyzing the text information through NLP to obtain a context dialogue corresponding to the text information;
and the conversation display module is used for sending the context conversation to the browser through the freeswitch so that the browser displays the context conversation in a text conversation box.
By adopting the technical scheme, the account registration module receives the preset account transmitted by the WebRTC in the browser through the freeswitch, the corresponding effective user account is obtained after registration and authentication, the channel establishment module receives the starting instruction sent by the browser and establishes a bidirectional communication channel between the freeswitch and the browser based on the effective user account, the dialogue acquisition module acquires text information corresponding to the transmitted voice stream through the freeswitch based on the bidirectional communication channel, the text information is analyzed through the NLP, the corresponding context dialogue is obtained, and finally the dialogue display module sends the context dialogue to the browser for display, so that the NLP test efficiency is improved.
In summary, the present application includes at least one of the following beneficial technical effects:
and the WebRTC in the browser sends the preset account to a freeswitch in the server, the freeswitch registers and authenticates the preset account to obtain an effective user account, then the freeswitch receives a starting instruction sent by the browser and bridges the effective user account in the context, so that the freeswitch establishes communication with the effective user account, and a bidirectional communication channel between the freeswitch and the browser is formed. And acquiring the voice stream transmitted by the browser and the freeswitch based on the bidirectional communication channel, and converting the voice stream into corresponding text information through the freeswitch. And finally, the new switch bridges a channel communicated with the NLP, sends text information to the NLP for analysis to obtain a context dialogue corresponding to the text information, and sends the context dialogue to a browser through a two-way communication channel, and displays a dialogue text box on a browser page, so that the NLP is tested in real time through the transmission of media streams (voice streams and texts) through the two-way communication channel, and NLP test efficiency is improved well without testing the NLP through PSTN (public switched telephone network) mass measurement test.
Drawings
FIG. 1 is a schematic diagram of an NLP real-time testing system based on a freeswitch and WebRTC technology according to an embodiment of the present application;
FIG. 2 is a flow chart of a method for performing NLP real-time test based on a freeswitch and WebRTC technology according to an embodiment of the present application;
FIG. 3 is a flowchart of another NLP real-time testing method based on the freeswitch and WebRTC technologies according to the embodiment of the present application;
FIG. 4 is a schematic structural diagram of an NLP real-time testing device based on a freeswitch and WebRTC technology according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of another device for performing NLP real-time testing based on the freeswitch and WebRTC technology according to an embodiment of the present application.
Reference numerals illustrate: 11. an account registration module; 12. a channel establishment module; 13. a dialogue acquisition module; 14. and a dialogue display module.
Detailed Description
In order to make the technical solutions in the present specification better understood by those skilled in the art, the technical solutions in the embodiments of the present specification will be clearly and completely described below with reference to the drawings in the embodiments of the present specification, and it is obvious that the described embodiments are only some embodiments of the present application, but not all embodiments.
In the description of embodiments of the present application, words such as "exemplary," "such as" or "for example" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "illustrative," "such as" or "for example" is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "illustratively," "such as" or "for example," etc., is intended to present related concepts in a concrete fashion.
In the description of the embodiments of the present application, the term "and/or" is merely an association relationship describing an association object, and indicates that three relationships may exist, for example, a and/or B may indicate: a alone, B alone, and both A and B. In addition, unless otherwise indicated, the term "plurality" means two or more. For example, a plurality of systems means two or more systems, and a plurality of screen terminals means two or more screen terminals. Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating an indicated technical feature. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless expressly specified otherwise.
Referring to fig. 1, an embodiment of the application discloses an architecture diagram of an NLP real-time test system based on a freeswitch and WebRTC technology, which specifically includes a terminal and a server, where the terminal may be directly or indirectly connected to the server through a wired or wireless network. The terminal may be an electronic device such as a cell phone, tablet computer, e-book reader, multimedia playback device, wearable device, PC (personal computer), etc. The server 20 may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing cloud computing services.
And establishing a bidirectional communication channel between a browser arranged in the terminal and a fresh switch in the server, namely establishing a WebRTC channel and a websocket channel. Based on the bidirectional communication channel, the new switch in the server obtains dialogue voice (voice stream) for voice test from the WebRTC channel, converts the dialogue voice into text information, sends the text information to the NLP in the server for analysis, and obtains a corresponding context dialogue, then the NLP sends the context dialogue to the new switch, and finally the new switch sends the context dialogue to the terminal through the websocket channel, so that the context dialogue is displayed in a dialogue text box of the browser.
Referring to fig. 2, an embodiment of the present application discloses a flow chart of a method for performing NLP real-time test based on a freeswitch and WebRTC technology, which may be implemented by a computer program or may be run on a device for performing NLP real-time test based on a freeswitch and WebRTC technology based on a von neumann system. The computer program can be integrated in an application or can be run as a stand-alone tool class application, and specifically comprises:
s101: and receiving a preset account transmitted by the WebRTC in the browser through the freeswitch, and acquiring an effective user account corresponding to the preset account.
In one implementation manner, a preset account transmitted by WebRTC in a browser is received through a freeswitch based on a SIP protocol;
registering the preset account through a fresh switch to obtain a registered account;
and carrying out 401 authentication on the registered account through a fresh switch, and if 401 authentication is successful, determining the registered account as a valid user account.
In particular, the switch is a powerful soft switching system in the CIT field, runs in a server, provides functions of voice, video, chat, and the like, and can be used for switch engines, PBX, multimedia gateways, multimedia servers, and the like. (Web Real-Time Communications, webRTC) is a Real-time communication technology that allows Web applications or sites to establish a Peer-to-Peer (Peer-to-Peer) connection between browsers without the aid of intermediaries, enabling the transmission of video and/or audio streams or any other data. In the embodiment of the application, webRTC is integrated in the browser. The user sends the preset account number to a freeswitch in the server through operation in the browser, specifically, the preset account number is transmitted to the freeswitch through WebRTC based on the SIP protocol. After the server receives the preset account transmitted by WebRTC through the freswitch, the preset account is registered by the freswitch, and 401 authentication processing is performed on the preset account after registration, so that only a visitor logged in by using the preset account can be allowed to access the application. Finally, after authentication is successful, an effective user account corresponding to the preset account is obtained, and a communicable effective online user can be obtained, so that communication between the subsequent effective user account and the fresh switch can be conveniently established.
S102: and receiving a starting instruction sent by the browser, and establishing a bidirectional communication channel between the fresh and the browser based on the effective user account.
Specifically, the start instruction refers to a start instruction of a natural language processing (Natural Language Processing, NLP) test. NLP is a discipline of language questions that researchers interact with computers. According to the different technical implementation difficulties, such systems can be divided into three types of simple matching type, fuzzy matching type and paragraph cleavage type, and NLP has become the basis for creating chat robots.
The user sends a start instruction to the server by clicking a start button on the browser page, in order to inform the server that NLP testing is required. After receiving the start instruction sent by the browser through the freeswitch in the server, the method makes a corresponding to the start instruction sent by the browser and sends a relevant instruction for allowing the test (allowing the voice call) to the browser. And finally, receiving a formal call instruction sent by the browser again through the freeswitch, bridging the valid user account after authentication is completed, and verifying the passed valid user account, so that communication is established between the valid user account and the freeswitch in the server, and further, a bidirectional communication channel of the browser corresponding to the freeswitch and the valid user account is established. The bridging refers to a process of forwarding a network data packet according to an address of a link layer of an OSI network model, which simply means that two different physical lans are connected by a bridging manner, so as to establish two-way communication of the two different physical lans.
It should be noted that the bidirectional communication channels are WebRTC channels and websocket channels, that is, webRTC transmission channels and websocket transmission channels. The WebRTC channel is a specific multimedia data transmission channel on which WebRTC and a freeswitch in the server depend in the audio and video communication process. In addition, websocket is a protocol for carrying out full duplex communication on a single TCP connection, so that data exchange between a browser and a server becomes simpler, the server is allowed to actively push data to the browser, the browser and the server can directly establish persistent connection only by completing http handshake once through websocket API, and bidirectional data transmission can be carried out in real time through a corresponding websocket channel. And the browser and the server are connected in a long way through the websocket channel, so that the situation that HTTP requests are required for each data transmission under short connection can be avoided when data transmission is carried out, resources are saved better, and the data transmission is simplified. This is the prior art and will not be described in detail here. Note that websocket is a built-in object of the browser.
S103: based on the two-way communication channel, text information corresponding to the voice stream transmitted by the two-way communication channel is acquired through the freeswitch, and the text information is analyzed through the NLP, so that a context dialogue corresponding to the text information is obtained.
Specifically, after the bidirectional communication channel between the freeswitch and the browser is established, the server acquires a voice stream from the WebRTC channel through the freeswitch, wherein the voice stream is a dialogue voice between the browser and the freeswitch for NLP test, and the user performs transmission through the WebRTC channel through the voice dialogue between the browser and the freeswitch. After the voice stream is acquired, the voice stream is converted into corresponding text information through a freeswitch. The voice stream can be converted into corresponding text information through a preset voice recognition tool. And then establishing communication with the NLP by the fresh switch, packaging the text information, sending the packaged text information to the NLP, analyzing the packaged text information by the NLP, determining the context logic of the text information, and finally obtaining the context dialogue corresponding to the text information.
It should be noted that, text information obtained by converting the speech stream by the freswitch is integrated dialogue text, and no context logic exists. So that the user browses to text matching (logically consistent with the context of) the dialogue speech on the front page of the browser for more efficient NLP testing. The context logic of the text information needs to be analyzed through NLP, and the text information is segmented according to the context logic, so that the context dialogue corresponding to the text information is finally obtained.
S104: the contextual dialog is sent to the browser through the freeswitch so that the browser presents the contextual dialog in a text dialog.
Specifically, after the context dialogue is obtained through the analysis of the NLP to the text information, a request for obtaining the context dialogue is sent to the NLP through the freeswitch, so that the freeswitch obtains the context dialogue from the NLP, then the context dialogue is sent to a browser corresponding to an effective user account through the freeswitch based on a two-way communication channel, the context dialogue is displayed in a text dialogue box of the browser in real time, and a user can observe the test result of the NLP in real time, so that the NLP test efficiency is improved.
Referring to fig. 3, another flow diagram of a method for performing NLP real-time testing based on the freeswitch and WebRTC technology is disclosed in the embodiments of the present application, which may be implemented by a computer program or may be run on a device for performing NLP real-time testing based on the freeswitch and WebRTC technologies based on the von neumann system. The computer program can be integrated in an application or can be run as a stand-alone tool class application, and specifically comprises:
s201: and receiving a preset account transmitted by the WebRTC in the browser through the freeswitch, and acquiring an effective user account corresponding to the preset account.
Specifically, reference may be made to step S101, which is not described herein.
S202: and receiving a starting instruction sent by the browser through the websocket, and initiating a media call request to the browser by the fresh switch.
Specifically, after determining the valid user account number in the context, the user logs in to the NLP real-time test system based on using the valid user account number, so that a voice test "start test" button is displayed on a front page of the browser, and in other embodiments, a text test "start test" button or a voice test and text test "start button" is displayed on the browser at the same time. After the user clicks the "start test" button, the browser sends a start instruction to the fresh switch in the server through websocket. For the freswitch, after receiving the character string corresponding to the start instruction, the package parameter of the character string needs to be analyzed first, then the start instruction for the voice test sent by the browser is determined, and then the freswitch actively initiates a media call request to the browser through the websocket, so as to prepare for formally starting the voice dialogue and performing the NLP test. For example, after receiving a start instruction sent by the browser through the freeswitch, the freeswitch generates and sends a voice message "can start testing" to the browser.
S203: after a media call request is initiated to a browser through a switch, a call instruction sent by the browser is received, an effective user account is bridged, and a bidirectional communication channel between the switch and the browser is established through SIP signaling negotiation.
In particular, the session initiation protocol (Session initialization Protocol, SIP) is a multimedia communication protocol defined by the internet engineering task force (Internet Engineering Task Force, IETF), which is a text-based application-layer control protocol for establishing, modifying and terminating multimedia sessions. SIP itself does not provide services but constitutes a multimedia framework as a component along with other protocols. After a media call request is initiated to the browser through the freswitch, the browser sends a call instruction to the freswitch through the websocket again, and after the call instruction is received through the freswitch, the voice conversation between the browser and the freswitch is formally started. In other embodiments, after a media call request is initiated to the browser through the freeswitch, a voice conversation between the browser and the freeswitch is formally initiated, and the user may send a voice message to the freeswitch in the server through the browser. It should be noted that, the terminal corresponding to the browser is equipped with hardware equipment (such as a sound card), so as to support the man-machine to perform voice interaction, and perform NLP test more conveniently and effectively. The terminal may be an electronic device such as a cell phone, tablet computer, PC (personal computer) or the like.
And then bridging the available user account numbers in the context through the freswitch, and simultaneously carrying out SIP signaling negotiation, so that after the SIP signaling negotiation is completed, the voice message between the browser and the freswitch can be converted into a multimedia message with a unified SIP signaling format, thereby establishing the bidirectional communication between the available user account numbers and the freswitch in the server, namely establishing the bidirectional communication channel between the freswitch and the browser corresponding to the available user account numbers. Thereby facilitating the transmission of subsequent multimedia messages over the bi-directional communication channel. This is the prior art and will not be described in detail here.
S204: and acquiring the RTP voice stream transmitted by the WebRTC channel through the freeswitch.
S205: the RTP voice stream is converted into corresponding text information through ASR technology.
Specifically, after the bidirectional communication channel is established, since the voice stream transmission in the WebRTC channel is based on the RTP/RTCP media stream transmission, the voice stream transmitted between the browser and the fresh through the WebRTC channel is an RTP voice stream. Among them, real-time transport protocol (Real-time Transport Protocol, RTP) is a network transport protocol that specifies the standard packet format for delivering audio over the internet. Real-time transport control protocol (Real-timeTransport Control Protocol, RTCP) is a function of RTP as part of the transport protocol and it involves flow control and congestion control of other transport protocols. In addition, RTP/RTCP is also a basic requirement for creating SIP multimedia sessions.
And acquiring the RTP voice stream transmitted by the WebRTC channel through the freeswitch, namely acquiring the dialogue voice. The acquisition mode is as follows: the conversation voice is intercepted from the WebRTC channel by a preset media bug help fresh. The media bug is mainly used for intercepting call voice data.
After the RTP voice stream is obtained, the RTP voice stream is converted into text information through the speech recognition by the fresh switch, and the text information is mainly converted through an automatic speech recognition technology (Automatic Speech Recognition, ASR). ASR is a technique that converts human speech into text. It should be noted that, the converted text information is in XML format.
In one implementation, after step S205, the method further includes: sending the RTP voice stream to a browser through a WebRTC channel by a freeswitch so that the browser plays the RTP voice stream; or (b)
And sending the text information to the browser through a websocket channel by the freeswitch so as to enable the browser to play the text information. Thereby enabling the user to hear the played content of the dialogue voice in real time on the browser and/or see the dialogue text in real time on the browser.
S206: and packaging the text information to obtain the packaged text information.
S207: and sending the packaged text information to the NLP for analysis through a freeswitch to obtain a context dialogue corresponding to the text information.
Specifically, the freeswitch acquires text information corresponding to the RTP voice stream, packages the text information in the XML format into an object through the freeswitch, and obtains the packaged text information, wherein the specific packaging mode is as follows: the text information is encapsulated by java and by "access control" private, default, protected, public, respectively. Wherein the encapsulation serves two functions: firstly, ensuring the safety of text information; secondly, the calling is convenient for the outside through the interface.
After the packaged text information is obtained, a channel communicated with the NLP is bridged through the freeswitch, so that the communication between the freeswitch and the NLP is established, the packaged text information is sent to the NLP through the freeswitch, the NLP analyzes and performs semantic analysis on the packaged text information, context logic of the text information is further determined, segmentation processing is carried out on the text information, and finally a context dialogue is obtained.
For example, when the user performs a voice test through the browser, the dialogue voice with the freswitch in the server is "hello, i is happy to see you", "hello is happy to see you", "how recently you are very good", and then the corresponding text information is: you are happy to see how you are recently and how me is you are recently very good. At this time, the text information has no context logic, so that the corresponding context dialogue is obtained through NLP analysis, namely:
"hello, I happy to see you"
"hello, I also happy to see you"
"how recently you are"
"I have recently been very good, you woolen".
S208: the context dialog is obtained from the NLP by the freeswitch via the NLP interface.
S209: and packaging the context dialogue to obtain the Event.
S210: based on the MQ message mechanism, the Event is sent to the browser through the websocket channel, so that the browser displays the context dialogue in a text dialogue box.
In one implementation manner, based on an MQ message mechanism, acquiring a websocket channel set recorded by a server through a fresh switch, and screening a target websocket channel for starting instruction transmission from the websocket channel set;
and sending the Event to the browser through the target websocket channel so that the browser displays the context dialogue in a text dialogue box.
Specifically, after obtaining a context dialogue corresponding to the text information through the NLP, calling the NLP interface through the freeswitch, obtaining the context dialogue corresponding to the text information from the NLP, and then packaging the context dialogue into an Event. An Event is a packaged delegate that includes an Event issuer and an Event subscriber. Event publishers and event subscribers implement event triggering by senders and recipients through delegation. In the embodiment of the application, the Event is an Event of identifying text (forming a context dialogue) subscribed by the browser through the websocket channel.
After the Event is obtained, the Event time required to be sent to the browser is put into a Message Queue (MQ) based on a Message Queue (MQ) Message mechanism through a fresh switch. Wherein MQ is a data structure based on a "first-in first-out" of the data structures. Refers to placing the message to be transmitted in a queue, with the mechanism of the queue being used to effect message delivery-the producer generates and places the message in the queue and then is processed by the user. The user may specify that the queue pull be inactive or subscribe to a corresponding queue for which messages are pushed by the MQ server. There are multiple Event events in the message queue, that is, there are multiple users using browsers to perform voice test, and each browser needs to obtain a corresponding Event sent by the new switch.
Further, the java application in the acquisition server acquires the websocket channel set, because the java application automatically records all websocket channels established through the browser. Then judging whether a websocket channel used for starting instruction transmission exists in a websocket channel set, if so, determining the websocket channel in the websocket channel set as a target websocket channel, and further determining an object which is subscribed by a browser and is supposed to be sent by an Event. Because of the numerous browsers involved, it is necessary to determine the correct object for Event delivery.
After the target websocket channel is determined, the new switch sends the Event to the corresponding browser through the target websocket channel, and finally the browser displays the context dialogue in the text dialogue box. The context dialogue corresponding to the Event is matched with the voice test carried out by the browser, so that the error object is avoided.
The implementation principle of the NLP real-time test method based on the freeswitch and WebRTC technology in the embodiment of the application is as follows: the WebRTC integrated in the browser sends the preset account to the freeswitch in the server, the freeswitch registers and authenticates the preset account, so that the preset account is registered to be a valid account, namely a valid user account, then the freeswitch receives a starting instruction sent by the browser, bridges the valid user account in the context, so that the freeswitch establishes communication with the valid user account, further, the freeswitch establishes two-way communication with the browser, and a two-way communication channel between the freeswitch and the browser is formed. And acquiring the voice stream transmitted by the browser and the freeswitch based on the bidirectional communication channel, and converting the voice stream into corresponding text information by the freeswitch. And finally, a channel communicated with the NLP is bridged by the new switch, text information is sent to the NLP for analysis to obtain a context dialogue corresponding to the text information, and the context dialogue is sent to a browser through a two-way communication channel, and a dialogue text box on a browser page is displayed, so that the NLP is tested in real time through the transmission of media streams (voice streams and texts) through the two-way communication channel, and NLP is tested without a large amount of test evidence through PSTN (public switched telephone network), and NLP test efficiency is improved well.
The following are device embodiments of the present application, which may be used to perform method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.
Please refer to fig. 4, which is a schematic structural diagram of an NLP real-time testing device based on the freeswitch and WebRTC technology according to an embodiment of the present application. The application to a device for NLP real-time testing based on the freeswitch and WebRTC techniques may be implemented as all or part of the device by software, hardware, or a combination of both. The device 1 comprises an account registration module 11, a channel establishment module 12, a dialogue acquisition module 13 and a dialogue presentation module 14.
The account registration module 11 is configured to receive a preset account transmitted by WebRTC in the browser through a freswitch, and obtain a valid user account corresponding to the preset account;
the channel establishment module 12 is configured to receive a start instruction sent by the browser, and establish a bidirectional communication channel between the new and the browser based on the valid user account;
the dialogue acquisition module 13 is configured to acquire text information corresponding to a voice stream transmitted by the bidirectional communication channel through a freeswitch based on the bidirectional communication channel, and parse the text information through NLP to obtain a context dialogue corresponding to the text information;
The dialog presentation module 14 is configured to send the context dialog to the browser through the freeswitch, so that the browser presents the context dialog in a text dialog box.
Optionally, the account registration module 11 is specifically configured to:
based on the SIP protocol, receiving a preset account transmitted by the WebRTC in the browser through a fresh switch;
registering the preset account through a fresh switch to obtain a registered account;
and carrying out 401 authentication on the registered account through a fresh switch, and if 401 authentication is successful, determining the registered account as a valid user account.
Optionally, the channel establishment module 12 is specifically configured to:
receiving a starting instruction sent by a browser through a websocket, and initiating a media call request to the browser by a freeswitch;
after a media call request is initiated to a browser through a switch, a call instruction sent by the browser is received, an effective user account is bridged, and a bidirectional communication channel between the switch and the browser is established through SIP signaling negotiation.
Optionally, the session acquisition module 13 is specifically configured to:
acquiring an RTP voice stream transmitted by a WebRTC channel through a freeswitch;
converting the RTP voice stream into corresponding text information through an ASR technology;
encapsulating the text information to obtain encapsulated text information;
And sending the packaged text information to the NLP for analysis through a freeswitch to obtain a context dialogue corresponding to the text information.
Optionally, as shown in fig. 5, the apparatus 1 further includes a text playing module 15, specifically configured to:
sending the RTP voice stream to a browser through a WebRTC channel by a freeswitch so that the browser plays the RTP voice stream; or (b)
And sending the text information to the browser through a websocket channel by the freeswitch so as to enable the browser to play the text information.
Optionally, the dialog presentation module 14 is specifically configured to:
obtaining a context dialogue from the NLP through the NLP interface by the freeswitch;
packaging the context dialogue to obtain Event events;
based on the MQ message mechanism, the Event is sent to the browser through the websocket channel, so that the browser displays the context dialogue in a text dialogue box.
Optionally, the dialog presentation module 14 is specifically further configured to:
based on an MQ message mechanism, acquiring a websocket channel set recorded by a server through a freswitch, and screening a target websocket channel for starting instruction transmission from the websocket channel set;
and sending the Event to the browser through the target websocket channel so that the browser displays the context dialogue in a text dialogue box.
It should be noted that, when the device for performing the NLP real-time test based on the freeswitch and the WebRTC technology provided in the above embodiment performs the method for performing the NLP real-time test based on the freeswitch and the WebRTC technology, only the division of the functional modules is used for illustration, and in practical application, the functional allocation may be performed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the functions described above. In addition, the embodiment of the apparatus for performing NLP real-time test based on the freeswitch and WebRTC technology and the embodiment of the method for performing NLP real-time test based on the freeswitch and WebRTC technology provided in the foregoing embodiments belong to the same concept, and detailed implementation processes of the embodiments are shown in the method embodiment and are not repeated herein.
The embodiment of the application also discloses a computer readable storage medium, and the computer readable storage medium stores a computer program, wherein when the computer program is executed by a processor, the method for performing NLP real-time test based on the freeswitch and WebRTC technology is adopted.
The computer program may be stored in a computer readable medium, where the computer program includes computer program code, where the computer program code may be in a source code form, an object code form, an executable file form, or some middleware form, etc., and the computer readable medium includes any entity or device capable of carrying the computer program code, a recording medium, a usb disk, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM), a Random Access Memory (RAM), an electrical carrier signal, a telecommunication signal, a software distribution medium, etc., where the computer readable medium includes, but is not limited to, the above components.
The method for performing NLP real-time test based on the freeswitch and the WebRTC technology in the embodiment is stored in the computer readable storage medium and loaded and executed on a processor, so as to facilitate the storage and application of the method.
The embodiment of the application also discloses electronic equipment, wherein a computer program is stored in a computer readable storage medium, and when the computer program is loaded and executed by a processor, the method for performing NLP real-time test based on the freeswitch and the WebRTC technology is adopted.
The electronic device may be an electronic device such as a desktop computer, a notebook computer, or a cloud server, and the electronic device includes, but is not limited to, a processor and a memory, for example, the electronic device may further include an input/output device, a network access device, a bus, and the like.
The processor may be a Central Processing Unit (CPU), or of course, according to actual use, other general purpose processors, digital Signal Processors (DSP), application Specific Integrated Circuits (ASIC), ready-made programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., and the general purpose processor may be a microprocessor or any conventional processor, etc., which is not limited in this application.
The memory may be an internal storage unit of the electronic device, for example, a hard disk or a memory of the electronic device, or may be an external storage device of the electronic device, for example, a plug-in hard disk, a Smart Memory Card (SMC), a secure digital card (SD), or a flash memory card (FC) provided on the electronic device, or the like, and may be a combination of the internal storage unit of the electronic device and the external storage device, where the memory is used to store a computer program and other programs and data required by the electronic device, and the memory may be used to temporarily store data that has been output or is to be output, which is not limited in this application.
According to the electronic device, the NLP real-time testing method based on the freeswitch and the WebRTC technology is stored in the memory of the electronic device, and is loaded and executed on the processor of the electronic device, so that the electronic device is convenient to use.
The foregoing is merely exemplary embodiments of the present disclosure and is not intended to limit the scope of the present disclosure. That is, equivalent changes and modifications are contemplated by the teachings of this disclosure, which fall within the scope of the present disclosure. Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure herein. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a scope and spirit of the disclosure being indicated by the claims.
Claims (10)
1. A method for performing NLP real-time testing based on a fresh and WebRTC technology, which is characterized by being applied to a server, the method comprising:
receiving a preset account transmitted by WebRTC in a browser through a freeswitch, and acquiring an effective user account corresponding to the preset account;
receiving a starting instruction sent by a browser, and establishing a bidirectional communication channel between the freeswitch and the browser based on the effective user account;
based on the bidirectional communication channel, text information corresponding to the voice stream transmitted by the bidirectional communication channel is obtained through the freeswitch, and the text information is analyzed through NLP, so that a context dialogue corresponding to the text information is obtained;
the contextual dialog is sent to the browser through the freeswitch to cause the browser to present the contextual dialog in a text dialog.
2. The method for performing NLP real-time test based on the freeswitch and WebRTC technology according to claim 1, wherein the receiving, by the freeswitch, the preset account transmitted by WebRTC in the browser and obtaining the valid user account corresponding to the preset account include:
based on the SIP protocol, receiving a preset account transmitted by the WebRTC in the browser through a fresh switch;
Registering the preset account through the fresh switch to obtain a registered account;
and carrying out 401 authentication on the registered account through the fresh switch, and if 401 authentication is successful, determining the registered account as a valid user account.
3. The method for performing NLP real-time testing based on the freeswitch and WebRTC technology according to claim 1, wherein the receiving the start command sent by the browser and establishing the bidirectional communication channel between the freeswitch and the browser based on the valid user account number include:
receiving a starting instruction sent by a browser through websocket, and initiating a media call request to the browser by the fresh switch;
after a media call request is initiated to the browser through the freeswitch, a call instruction sent by the browser is received, the effective user account is bridged, and a bidirectional communication channel between the freeswitch and the browser is established through SIP signaling negotiation.
4. The method for performing NLP real-time test based on a freeswitch and WebRTC technology according to claim 1, wherein the bidirectional communication channel includes a WebRTC channel, the text information corresponding to the voice stream transmitted by the bidirectional communication channel is obtained through the freeswitch based on the bidirectional communication channel, and the text information is parsed through NLP, so as to obtain a context dialogue corresponding to the text information, which includes:
Acquiring an RTP voice stream transmitted by the WebRTC channel through the freeswitch;
converting the RTP voice stream into corresponding text information through an ASR technology;
packaging the text information to obtain packaged text information;
and sending the packaged text information to an NLP through the freeswitch for analysis, and obtaining a context dialogue corresponding to the text information.
5. The method for performing NLP real-time testing based on the freeswitch and WebRTC technology according to claim 4, wherein the bidirectional communication channel further includes a websocket channel, and the steps of converting the RTP speech stream into corresponding text information by the ASR technology further include:
sending the RTP voice stream to the browser through the WebRTC channel by the fresh switch so as to enable the browser to play the RTP voice stream; or (b)
And sending the text information to the browser through the websocket channel by the fresh switch so as to enable the browser to play the text information.
6. The method of claim 1, wherein the bi-directional communication channel further comprises a websocket channel, wherein the sending the contextual dialog to the browser via the freeswitch to cause the browser to present the contextual dialog in a text dialog comprises:
Obtaining the context dialogue from the NLP through an NLP interface by the freeswitch;
packaging the context dialogue to obtain Event events;
and sending the Event to the browser through the websocket channel based on an MQ message mechanism, so that the browser displays the context dialogue in a text dialogue box.
7. The method for performing NLP real-time testing based on the freeswitch and WebRTC technology according to claim 6, wherein the MQ message mechanism sends the Event to the browser through the websocket channel, so that the browser exposes the contextual dialog in a text dialog box, comprising:
based on an MQ message mechanism, acquiring a websocket channel set recorded by a server through the fresh switch, and screening the target websocket channel for starting instruction transmission from the websocket channel set;
and sending the Event to the browser through the target websocket channel so that the browser displays the context dialogue in a text dialogue box.
8. An apparatus for performing NLP real-time test based on a fresh and WebRTC technology, comprising:
The account registration module (11) is used for receiving a preset account transmitted by the WebRTC in the browser through a fresh switch and acquiring a valid user account corresponding to the preset account;
the channel establishment module (12) is used for receiving a starting instruction sent by a browser and establishing a bidirectional communication channel between the fresh switch and the browser based on the effective user account;
the dialogue acquisition module (13) is used for acquiring text information corresponding to the voice stream transmitted by the browser through the freeswitch based on the two-way communication channel, and sending the text information to the NLP for analysis to obtain a context dialogue corresponding to the text information;
and the conversation display module (14) is used for sending the context conversation to the browser through the freeswitch so that the browser displays the context conversation in a text conversation box.
9. A computer readable storage medium having a computer program stored therein, characterized in that the method according to any of claims 1-7 is employed when the computer program is loaded and executed by a processor.
10. An electronic device comprising a memory, a processor and a computer program stored in the memory and capable of running on the processor, characterized in that the method according to any of claims 1-7 is used when the computer program is loaded and executed by the processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310275295.2A CN116455879A (en) | 2023-03-21 | 2023-03-21 | Method, device, medium and equipment for carrying out NLP real-time test based on fresh and WebRTC technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310275295.2A CN116455879A (en) | 2023-03-21 | 2023-03-21 | Method, device, medium and equipment for carrying out NLP real-time test based on fresh and WebRTC technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116455879A true CN116455879A (en) | 2023-07-18 |
Family
ID=87131205
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310275295.2A Pending CN116455879A (en) | 2023-03-21 | 2023-03-21 | Method, device, medium and equipment for carrying out NLP real-time test based on fresh and WebRTC technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116455879A (en) |
-
2023
- 2023-03-21 CN CN202310275295.2A patent/CN116455879A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI440346B (en) | Open architecture based domain dependent real time multi-lingual communication service | |
| US7751535B2 (en) | Voice browser implemented as a distributable component | |
| US9521174B2 (en) | Video script interpreter platform with cooperating client and server | |
| US7505574B2 (en) | Method and system for providing an improved communications channel for telephone conference initiation and management | |
| KR100985612B1 (en) | Automatic orchestration of dynamic multiple party, multiple media communications | |
| US20080152101A1 (en) | Web-based telephony system and method | |
| WO2014019497A1 (en) | Real time communication method, terminal device, real time communication server and system | |
| TW200414722A (en) | Method and apparatus for implementing call processing in packet telephony networks | |
| US7502993B1 (en) | Calling service using voice enabled web based application server | |
| CN106789581A (en) | Instant communication method, apparatus and system | |
| CN109617990B (en) | Converged communication resource cloud sharing method and system | |
| US11895165B2 (en) | In-line, in-call AI virtual assistant for teleconferencing | |
| CN108156223A (en) | A kind of accurate supplying system of message based on websocket and method | |
| CN110113298B (en) | Data transmission method, device, signaling server and computer readable medium | |
| CN112015383A (en) | Login method and device | |
| WO2021103741A1 (en) | Content processing method and apparatus, computer device, and storage medium | |
| CN116455879A (en) | Method, device, medium and equipment for carrying out NLP real-time test based on fresh and WebRTC technology | |
| US7213056B2 (en) | Providing modular telephony service | |
| US8331541B1 (en) | Systems and methods for providing instant messaging to TDD/TTY users | |
| CN114172858B (en) | Information transmission method and device, storage medium and electronic equipment | |
| CN117271270B (en) | Method for monitoring Android music playing on Web operating system | |
| WO2021180057A1 (en) | Method, machine, and computer program product for dynamic connection to network communication channel | |
| US11445064B2 (en) | Method for establishing a communication with an interactive server | |
| KR100766779B1 (en) | Wireless Instant Messaging System and Service Method with Extensible Presence Capability | |
| CN112527516A (en) | Method and system for developing interactive service across applications |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |