CN116996640A - Communication system and communication method - Google Patents
Communication system and communication method Download PDFInfo
- Publication number
- CN116996640A CN116996640A CN202311246199.1A CN202311246199A CN116996640A CN 116996640 A CN116996640 A CN 116996640A CN 202311246199 A CN202311246199 A CN 202311246199A CN 116996640 A CN116996640 A CN 116996640A
- Authority
- CN
- China
- Prior art keywords
- video
- user equipment
- call
- audio
- communication connection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000004891 communication Methods 0.000 title claims abstract description 172
- 238000000034 method Methods 0.000 title claims abstract description 92
- 238000012795 verification Methods 0.000 claims description 15
- 238000003708 edge detection Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 description 18
- 230000004044 response Effects 0.000 description 9
- 238000012423 maintenance Methods 0.000 description 7
- 230000009471 action Effects 0.000 description 5
- 238000001514 detection method Methods 0.000 description 5
- RWSOTUBLDIXVET-UHFFFAOYSA-N Dihydrogen sulfide Chemical compound S RWSOTUBLDIXVET-UHFFFAOYSA-N 0.000 description 4
- 230000005484 gravity Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000001727 in vivo Methods 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
- H04L63/083—Network architectures or network communication protocols for network security for authentication of entities using passwords
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1073—Registration or de-registration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/40—Network security protocols
Abstract
The embodiment of the invention provides a communication system and a communication method, wherein: the first user equipment is used for acquiring an audio and video call software development kit SDK from the application server based on the target website when the input operation of the target website is detected; running a registration method in the audio/video call SDK to register the first communication identifier to the soft switch server through a pre-stored first communication identifier and a password corresponding to the first communication identifier; when a call operation initiated to the second user equipment is detected, a call method in the audio/video call SDK is operated so as to send a call request to the soft switch server; the soft switch server is used for responding to the call request and establishing a first communication connection with the first user equipment; sending a call request to an operator gateway corresponding to the second communication identifier; the first user equipment is used for carrying out audio and video call with the second user equipment based on the first communication connection, the second communication connection and the third communication connection.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a communications system and a communications method.
Background
In the related art, merchants may engage in customer service to provide pre-or after-market services to customers. Typically, a merchant will have one computer for each agent customer service, with softphone software installed in the computer. During the working time, the agent customer service can open the soft phone software and then use the soft phone software to make a call to the customer or answer the call of the customer. In the related art, if a call between a customer service and a customer is to be made, it is necessary to resort to soft phone software, which in turn makes it necessary to install soft phone software in each computer, increasing maintenance costs and extremely inconvenient to operate.
Disclosure of Invention
The embodiment of the invention provides a communication system and a communication method, which are used for simplifying the conversation process between two devices.
In a first aspect, an embodiment of the present invention provides a communication system, where the communication system includes a first user equipment, a second user equipment, an application server, and a soft switch server, where:
the first user equipment is used for acquiring an audio and video call software development kit SDK from the application server based on the target website when the input operation of the target website is detected; running a registration method in the audio/video call SDK to register the first communication identifier to the soft switch server through a pre-stored first communication identifier and a password corresponding to the first communication identifier; when a call operation initiated to the second user equipment is detected, a call method in the audio/video call SDK is operated so as to send a call request to the soft switch server, wherein the call request carries a first registered communication identifier and a second communication identifier corresponding to the second user equipment;
The soft switch server is used for responding to the call request and establishing a first communication connection with the first user equipment; sending the call request to an operator gateway corresponding to the second communication identifier to request the operator gateway to establish a second communication connection with the soft switch server, and establishing a third communication connection between the operator gateway and the second user equipment through paging operation;
the first user equipment is configured to perform an audio/video call with the second user equipment based on the first communication connection, the second communication connection, and the third communication connection.
In a second aspect, an embodiment of the present invention provides a communication method, where the method is applied to a communication system, and the communication system includes a first user equipment, a second user equipment, an application server, and a soft switch server, and the method includes:
when the first user equipment detects the input operation of a target website, acquiring an audio and video call Software Development Kit (SDK) from the application server based on the target website;
the first user equipment runs a registration method in the audio/video call SDK to register the first communication identifier to the soft switch server through a pre-stored first communication identifier and a password corresponding to the first communication identifier;
When the first user equipment detects a call operation initiated to the second user equipment, a call method in the audio/video call SDK is operated so as to send a call request to the soft switch server, wherein the call request carries a first communication identifier after registration and a second communication identifier corresponding to the second user equipment;
the soft switch server responds to the call request and establishes a first communication connection with the first user equipment;
the soft switch server sends the call request to an operator gateway corresponding to the second communication identifier to request the operator gateway to establish second communication connection with the soft switch server, and establishes third communication connection between the operator gateway and the second user equipment through paging operation;
the first user equipment performs audio and video call with the second user equipment based on the first communication connection, the second communication connection and the third communication connection.
By adopting the invention, the related method in the audio/video call SDK is called, so that the agent customer service can still conveniently realize the process of dialing the audio/video telephone through the browser installed in the user equipment by default under the condition that the software special for dialing the audio/video telephone is not installed in the user equipment. In this way, the operation of making an audio-video call can be simplified and the maintenance cost of the device software can be reduced.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic structural diagram of a communication system according to an embodiment of the present invention;
fig. 2 is a flow chart of a communication method according to an embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The terminology used in the embodiments of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in this application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise, the "plurality" generally includes at least two.
The words "if", as used herein, may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrase "if determined" or "if detected (stated condition or event)" may be interpreted as "when determined" or "in response to determination" or "when detected (stated condition or event)" or "in response to detection (stated condition or event), depending on the context.
In addition, the sequence of steps in the method embodiments described below is only an example and is not strictly limited.
Fig. 1 is a schematic structural diagram of a communication system according to an embodiment of the present invention, as shown in fig. 1, the system may include a first user equipment 110, a second user equipment 120, an application server 130, and a soft switch server 140, where:
the first user equipment 110 is configured to obtain an audio/video call software development kit SDK from the application server 130 based on the target web address when detecting an input operation of the target web address; running a registration method in the audio/video call SDK to register the first communication identifier to the soft switch server 140 through the pre-stored first communication identifier and a password corresponding to the first communication identifier; when a call operation initiated to the second user equipment 120 is detected, a call method in the audio/video call SDK is operated to send a call request to the soft switch server 140, where the call request carries a registered first communication identifier and a second communication identifier corresponding to the second user equipment 120.
A soft switch server 140, configured to establish a first communication connection with the first user equipment 110 in response to the call request; a call request is sent to the carrier gateway corresponding to the second communication identity to request the carrier gateway to establish a second communication connection with the soft switch server 140 and to establish a third communication connection between the carrier gateway and the second user equipment 120 through a paging operation.
The first user equipment 110 is configured to perform an audio/video call with the second user equipment 120 based on the first communication connection, the second communication connection, and the third communication connection.
The first user device 110 may be, for example, a computer used by a customer service, and the second user device 120 may be a mobile phone of a customer.
In practical applications, taking an example of making an audio/video call to a customer by an agent customer service, in some application scenarios, the agent customer service may take a customer list, where the customer list includes a plurality of customers and corresponding second communication identifiers (such as mobile phone numbers). For the agent service, the task of the agent service is to call each customer in the customer list to communicate, and the specific communication content depends on the specific application scenario, for example, the agent service can introduce the products sold by the agent service to the customer, can return the old customer, and the like.
In the embodiment of the present invention, for the agent customer service, the soft phone is not required to make a call to the customer, but the browser installed in the first user equipment 110 is opened. It will be appreciated that for a typical computer, the browser is the default installer for the system, and no additional software need be installed in the computer. The agent customer service may input a target website in the browser, and after the target website is input in the browser, the first user device 110 may access the application server 130 corresponding to the target website, so as to load the audio/video call SDK (Software Development Kit ) into the first user device 110 from the application server 130.
Note that, the audio/video call SDK was developed based on JsSIP (JavaScript SIP protocol) tool and WebRTC (Web Real-Time Communications, web Real-time communication). Specifically, the functions related to the audio/video call in the audio/video call SDK are developed based on JsSIP, which is itself implemented through SIP protocol based on WebRTC. And other functions than the functions of the audio and video call in the audio and video call SDK are developed based on WebRTC.
While the first user equipment 110 loads the audio and video call SDK from the application server 130 to the local, the first user equipment 110 may also load and display the audio and video call web page in the browser. After the first user equipment 110 loads the audio and video call SDK from the application server 130 to the local, the first user equipment 110 may call the registration method in the audio and video call SDK by default. Wherein, alternatively, the called registration method may be a register () method in the UA object of JsSIP. Accordingly, when the first user device 110 needs to be offline, an unregister () method in the UA object may be invoked.
By calling the above-mentioned registration method, the first communication identifier may be registered to the soft switch server 140 through the first communication identifier and the password corresponding to the first communication identifier, which are pre-stored in the first user equipment 110. The first communication identifier may be, for example, an extension number allocated to the current seat service. By registering the first communication identifier with the soft switch server 140, the first user equipment 110 corresponding to the first communication identifier can be marked as being online, so that the first user equipment 110 can dial a call outwards, and can answer an incoming call, etc.
Notably, when the first user device 110 registers the first communication identifier with the soft switch server 140, media parameters, such as a frame rate, a camera resolution, and the like, used during the video call may be configured. In addition, at the time of registration, it is also possible to configure, for example, whether the registration expires for an automatic renewal, whether the incoming call is answered automatically, and the like. It should be noted that, the process of configuring the above parameters may be implemented by a method of calling WebRTC.
In another aspect, the first user device 110 may load an audio-video call web page locally in which an input box of some audio-video call configuration parameters is provided to the seat customer service, such as a second communication identification of the called party (the second user device 120), selecting whether to talk in voice or video, and so on. The agent customer service may input the second communication identifier of the second user device 120 in the corresponding input box in the audio-video call web page. After the seat customer service configures the audio and video call configuration parameters, a confirmation dialing key in the audio and video call webpage can be clicked.
After the seat customer service triggers the key, a calling method in the audio/video call SDK can be correspondingly called. Wherein, alternatively, the calling method called may be a call () method of JsSIP. By invoking the call method, the first user equipment 110 may send a call request to the switching server. The call request carries the registered first communication identifier and the second communication identifier corresponding to the second user equipment 120.
Note that, the softswitch server 140 is loaded with FreeSwitch software (telephone softswitch). After the soft switch server 140 receives the call request, it may be a priori verified whether the first communication identifier carried in the call request is registered, and if the first communication identifier is registered, a first communication connection between the soft switch server 140 and the first user equipment 110 may be established in response to the call request.
The soft switch server 140 may then send the call request to the corresponding carrier gateway of the second communication through the pre-configured carrier channel. After the operator gateway receives the call request, a second communication connection with the soft switch server 140 may be established, and at the same time, a third communication connection between the second user equipment 120 corresponding to the second communication identifier is established through a paging operation, and the second user equipment 120 is enabled to ring, so that after the target user corresponding to the second user equipment 120 senses the ring, the target user can choose to answer the incoming call or reject the incoming call. When the target user selects to answer the incoming call, a communication channel between the first user equipment 110 and the second user equipment 120 can be constructed through the first communication connection, the second communication connection and the third communication connection, so that the first user equipment 110 can perform audio-video call with the second user equipment 120, and the media parameters configured during registration are used in the call process.
In practical applications, the first user equipment 110 and the second user equipment 120 may perform audio and video calls, and may also perform sending and receiving of short messages. The short message outgoing procedure may be implemented by calling the sendMessage () method of JsSIP, and the short message receiving may be implemented by listening to the onNewMessage event.
In some optional embodiments, the agent customer service may transmit, as a media source, a video image collected by a camera in the first user device 110 to the target user for viewing, or the agent customer service may set, in the audio-video call web page, to transmit, as a media source, a local audio-video file to the target user for viewing. The audio and video file can be a product video currently being sold, an explanation video of a using method of the product, and the like, and can be recorded in advance according to actual requirements and transmitted to a target user for watching. Optionally, the first user device 110 may be further configured to: when the playing of the target audio and video file to the second user equipment 120 is detected, acquiring the target audio and video file; mixing file audio data in the target audio-video file with seat voice data acquired by an audio acquisition device to obtain mixed audio data, wherein the seat voice data contains explanation contents of the target audio-video file; the file video data and the audio-mixing audio data in the target audio-video file are transmitted to the second user device 120 through the first communication connection, the second communication connection and the third communication connection.
In practical applications, assuming that the agent service wants to play the content in the target audio/video file to the target user, the agent service may trigger to play the target audio/video file to the second user device 120 through the related operation. In response to the above playing operation, the target audio/video file may be obtained, and then the file audio data may be extracted from the target audio/video file, and since the agent customer service may also explain something to the target user while playing the video, the microphone in the first user device 110 may also continuously collect the agent voice data, and the currently played file audio data and the agent voice data need to be subjected to audio mixing processing, so as to obtain audio mixing audio data. Then, the file video data in the target audio/video file may be used as a media source for replacing the video image collected by the camera, and the audio/video data may be simultaneously transmitted to the second user device 120 as a media source through the first communication connection, the second communication connection, and the third communication connection.
In this way, in the above manner, for the second user device 120, the mixed audio data can be played while the file video data in the target audio/video file is played, so that the target user can not only see the video content in the target audio/video file, but also listen to the video sound in the target audio/video file and simultaneously listen to the explanation content of the seat customer service.
In addition, it should be noted that, by adopting the method provided by the embodiment of the present invention, the first user device 110 not only can transmit the target audio/video file to the second user device 120 for playing, but also the seat customer service can control the playing progress of the target audio/video file in the first user device 110 through related operations, for example, can control to pause playing the file or continue playing the file.
In some alternative embodiments, the agent customer service may choose to share the screen for viewing by the target user in addition to the manner described above. Specifically, the agent customer service may click a button for sharing the screen to the other party in the audio/video call web page, and in response to this operation, a pop-up inquiry may be made in the web page to share the specified window or the system desktop to the other party. When selecting to share the system desktop, it can also select whether to share the system sound to the other party at the same time. In the process of sharing the screen, the screen recording media stream can be obtained by calling the getDisplayMedia method of the browser, and the screen recording media stream is transmitted to the second user equipment 120 as a media source for replacing the video image collected by the camera. In addition, if the agent customer service selects to share the system sound to the other party, the system sound and the agent voice data collected through the microphone may be subjected to a mixing process to obtain mixed audio data, and the mixed audio data is transmitted to the second user device 120 as a media source.
In some application scenarios, for example, the agent customer service is providing maintenance consultation services for the target user, and for some simple product problems encountered by the target user, the agent customer service can help the target user solve the product problems currently encountered by the target user by simply explaining the target user in the telephone, if a maintenance master who sends a professional again cannot be solved by the telephone to perform on-site maintenance. In the process of guiding a target user to solve the product problem by the seat customer service, a few more professional terms are often used, for example, a certain electric appliance in the home of the target user has a problem, specifically, the preliminary judgment through the seat customer service is that a certain valve is not screwed, at the moment, the seat customer service may tell the target user that the XXX valve is not screwed, and ask the target user to find the valve and screw. But for the target user he may be unfamiliar with this vocabulary, as it is not a professional maintenance master, and it is thus difficult to find the position of the XXX valve.
In the above scenario, the target user may take the electrical appliance with the product problem to the seat customer service through the camera in the second user device 120, and the seat customer service may view the video image corresponding to the electrical appliance in the audio/video call webpage. In the embodiment of the invention, the identification information can be added into the call video in the form of marking or graffiti on the call video.
Optionally, the first user equipment 110 is further configured to, when detecting an operation of adding a mark to the first call video, sequentially obtain each video frame in the first call video; each time a video frame is acquired, determining a corresponding mark adding position of a mark adding tool in the currently acquired video frame; adding preset type identification information corresponding to the mark adding position in the currently acquired video frame; the video frame to which the identification information is added is transmitted to the second user equipment 120 through the first communication connection, the second communication connection, and the third communication connection.
In practical application, if identification information needs to be added to a section of call video, the call video can be processed in a marking mode. Specifically, a first call video may be acquired, where the first call video is a video that needs to be marked. Each video frame in the first call video is acquired in sequence, each time a video frame is acquired, the video frame can be sent into a blank canvas, and meanwhile, the mark adding position corresponding to the mark adding tool in the currently acquired video frame is determined. The mark adding tool may be an input tool such as a mouse or a keyboard. Taking a mouse as an example, the agent customer service can control the selection of the mark adding position by moving the mouse, namely, correspondingly determining the mark adding position in the video frame along with the moving position of the mouse. Then, the identification information of the preset type can be added in the currently acquired video frame corresponding to the mark adding position. Wherein the identification information may be a circle, a box, a triangle, an arrow, or the like having an identification effect. After the identification information is added, the video frame to which the identification information is added may be transmitted to the second user equipment 120 through the first communication connection, the second communication connection, and the third communication connection.
Furthermore, if it is a video frame, i.e. a screenshot, to which identification information needs to be added, a graffiti approach may be used. Specifically, a certain video frame in the first call video may be captured to obtain a captured image. The screenshot image is then sent into a blank canvas where it is painted and then transferred to the second user device 120.
It should be noted that, when the playing of the target audio/video file is completed or the playing of the target audio/video file is no longer required, and when the first call video needs to be marked or graffiti, the media source transmitted to the second user equipment 120 may be restored to the video image collected by the camera in the first user equipment 110 and the seat voice data collected by the microphone in the first user equipment 110.
It will be appreciated that a hang-up operation may be performed when the call is over. Specifically, the current call can be terminated by invoking the terminators () method in JsSIP and clearing call related states such as resetting the player, stopping and hiding the canvas, stopping screen sharing, etc.
In addition, it should be noted that if manual answering is configured during registration, when the customer service receives an incoming call, the user can pop up a window to remind that "an incoming call is received < XXXXXX > and please answer or reject the call-! ". The seat customer service can select to answer or reject, and if the answer button is clicked, the opposite party can be preferentially connected in a video call mode. If automatic answering is configured during registration, the user can pop up a window to remind that an incoming call < XXXX > is received when a telephone is incoming, and the user can answer-! ", while the incoming call can be automatically answered.
The procedure of making an incoming call can be implemented by calling the answer () method in JsSIP, while entering a preconfigured media parameter. Refusing can be realized by calling a terminate () method in the JsSIP, and related cleaning work can be carried out after the call is terminated.
In some application scenarios, the agent customer service needs to identify and verify the identity of the target user. In such a case, it may also be realized by video call. Optionally, the first user device 110 may be further configured to obtain a second session video received from the second user device 120 for a preset duration when detecting an operation of identifying a target user corresponding to the second user device 120; in the second conversation video, determining a target video frame meeting a preset condition; transmitting the target video frame to an identity verification server; and receiving an identity verification result corresponding to the target user, which is returned by the identity verification server based on the target video frame.
In practical applications, for example, in a banking scenario, a target user needs to transact a certain service, for example, identity identification needs to be performed to transact the service. The agent customer service may trigger an operation of identifying the target user, and in response to the operation, the first user device 110 may obtain the second session video received from the second user device 120 for a preset duration. The preset duration may be, for example, 20s, and the specific duration may be set according to actual requirements, which is not limited in this embodiment of the present invention.
It can be understood that the second session video with the preset duration includes a plurality of video frames, and specifically, selecting which video frame to use as the identification verification can refer to the rotation angle of the target user in each video frame in the second session video relative to the camera. The rotation angle of the target user relative to the camera in each video frame can be calculated, and the target video frame acquired when the target user faces towards the camera as far as possible is selected from all the rotation angles. Then, the target video frame can be sent to an identity verification server, a large number of face images of different users are stored in the identity verification server, the target video frame can be compared and matched with the stored face images to determine a target face image corresponding to the target user in the target video frame, and then a corresponding identity verification result can be obtained based on the target face image. If the identity verification result indicates that the identity of the target user currently using the second user device 120 matches the holding user of the personal account that he wants to log in to, the target user may be authorized to log in to the personal account and transact the relevant service.
In addition, in order to further improve the security of the authentication, the target user may be authenticated by means of in-vivo authentication. Specifically, motion indication information, such as indicating the target user to perform a low head, head up, head shake, number of words, etc., may be sent to the second user device 120. The call video received from the second user device 120 may be accessed into the canvas such that identification information, such as ellipses, borders, prompt text, etc., may be added to the call video. After the identification information is added, the call video added with the identification information can be transmitted to the second user equipment 120 for the target user to watch, so that the target user can be prompted to complete the specified action according to the action indication information, and the action image shot by the camera is located in the added ellipse and frame as far as possible. In the process of completing the action of the target user, the process of completing the action can be recorded as a fourth voice video, and the fourth voice video is uploaded to the server. The server can perform living body detection on the target user in the fourth conversation video and feed back a living body detection result. If the living body detection result is that the target user before the camera is a living body, and the identity verification result indicates that the identity of the target user currently using the second user device 120 matches with the holding user of the personal account number that the target user wants to log in, the target user can be authorized to log in to the personal account number and transact related services.
In some alternative embodiments, the call process has to be suspended for some reason during the course of the call with the target user by the agent customer service, at which point the call may be suspended by means of a hold. If the call needs to be suspended, the preset music audio data or video data can be transmitted to the second user device 120 as a media source, and the video image collected by the camera is stopped as the media source, so that the target user cannot see the seat customer service. And closing a media source of the seat voice data collected by the microphone.
In some alternative embodiments, the call may be selected to resume when it is not necessary to continue to hold. The call recovery can be realized by recovering video images and seat voice data respectively collected by the camera and the microphone as media sources.
In some alternative embodiments, the currently incoming call may also be forwarded to other extension numbers through a forwarding operation. Specifically, the transfer operation may be implemented by calling the refer () method in JsSIP to transfer the call to another extension number, which is equivalent to initiating another call and hanging up the current call for the current seat service.
In a further alternative embodiment, the targeted user will typically talk to the seat service using a cell phone. For the mobile phone, shooting can be horizontally placed or vertically placed. The gravity sensor is arranged in the mobile phone, sensing information detected by the gravity sensor can be used for determining whether the mobile phone is horizontally placed or vertically placed, and further determining how to display a shot picture, such as horizontal display or vertical display. By adjusting the mode of displaying the picture on the mobile phone, objects in the picture can be forward. However, when the third voice video shot by the mobile phone is transmitted to the first user equipment 110, the sensing information detected by the gravity sensor in the mobile phone is not transmitted to the first user equipment 110 together, so that the first user equipment 110 cannot know the placement orientation of the mobile phone.
For the first user device 110, the third conversation video will be presented at a default angle, which may result in objects in the conversation video presented to the seat service being non-forward in some cases. In order to solve the problem, in the embodiment of the present invention, optionally, an edge detection algorithm may be used to detect the landscape orientation of the person in the third session video; if the transverse and vertical directions of the characters do not meet the set requirements, rotating the third communication video by a preset angle; and displaying the rotated third session video.
If the transverse and vertical directions of the person are detected to be not positive directions, the third session video can be rotated by a preset angle, such as 90 degrees and 180 degrees.
In addition, a manual adjustment key can be provided for the seat customer service in the audio and video call webpage. When the call video adjusted by the edge detection algorithm is still not forward, the seat customer service can also select the direction of manually rotating the third call video. Specifically, the third session video may be accessed into a canvas, each video frame is rotated in turn in the canvas, and then the video frame after the rotation is output and played.
In another alternative embodiment, the current call state information, such as the current bandwidth occupation, may be displayed at a corresponding location in the audio-video call web page. The bandwidth occupation condition is calculated based on the data quantity which is counted and transmitted or received in each unit time, and the seat customer service can know whether the phenomenon of call blocking and the like occurs or not through the bandwidth occupation condition.
The foregoing describes the process of dialing a call to a target user by the agent customer service, and correspondingly, if the target user wants to dial a call to the agent customer service, the process is opposite, that is, the second user device 120 is connected to the operator gateway, and then the operator gateway is connected to the soft switch server 140, because the first user device 110 registers the first communication identifier in the soft switch server 140, the soft switch server 140 can determine that the first user device 110 is in the up state, and thus, the call incoming by the second user device 120 can be accessed to the first user device 110, and the first user device 110 can still implement the process of answering the call in the browser.
In addition, if a call is placed between the customer service agents, the first user device 110 is a computer of the first customer service agent, and the second user device 120 is a computer of the second customer service agent. The first user equipment 110 may initiate a telephone call request through the audio/video call SDK, where the telephone call request is sent to the soft switch server 140, and the soft switch server 140 establishes a connection with the second user equipment 120, so as to implement a call process between the first user equipment 110 and the second user equipment 120.
In addition to the above manner, the agent customer service may also make a call with a soft phone, where the soft phone is software installed in the user equipment and dedicated to making an audio/video call. The first user equipment 110 may initiate a phone call request through the audio/video call SDK, where the phone call request is sent to the soft switch server 140, and the soft switch server 140 establishes a connection with the soft phone in the second user equipment 120, so as to implement a passing process between the agent customer service and the soft phone.
In summary, by adopting the invention, the seat customer service can still conveniently realize the process of dialing the audio and video telephone through the browser installed in the user equipment by default under the condition that the software special for dialing the audio and video telephone is not installed in the user equipment by calling the related method in the audio and video call SDK. In this way, the operation of making an audio-video call can be simplified and the maintenance cost of the device software can be reduced.
In another embodiment of the present invention, a communication method is provided. The method is applied to a communication system, and the communication system comprises first user equipment, second user equipment, an application server and a soft switch server. As shown in fig. 2, the method may include:
201. and when the first user equipment detects the input operation of the target website, acquiring the audio and video call SDK from the application server based on the target website.
202. The first user equipment operates a registration method in the audio/video call SDK to register the first communication identifier to the soft switch server through a pre-stored first communication identifier and a password corresponding to the first communication identifier.
203. When the first user equipment detects a call operation initiated to the second user equipment, a call method in the audio/video call SDK is operated so as to send a call request to the soft switch server, wherein the call request carries a first communication identifier after registration and a second communication identifier corresponding to the second user equipment.
204. And the soft switch server responds to the call request and establishes a first communication connection with the first user equipment.
205. And the soft switch server sends the call request to an operator gateway corresponding to the second communication identifier to request the operator gateway to establish second communication connection with the soft switch server, and establishes third communication connection between the operator gateway and the second user equipment through paging operation.
206. The first user equipment performs audio and video call with the second user equipment based on the first communication connection, the second communication connection and the third communication connection.
Optionally, the registration method in the audio/video call SDK is a register () method in a UA object of the JsSIP tool;
the calling method in the audio/video call SDK is a call () method of a JsSIP tool.
Optionally, the method further comprises:
when the first user equipment detects that a target audio and video file is played to the second user equipment, acquiring the target audio and video file;
the first user equipment mixes the file audio data in the target audio-video file with the seat voice data acquired by the audio acquisition device to obtain mixed audio data, wherein the seat voice data contains explanation contents of the target audio-video file;
And the first user equipment sends the file video data and the audio-mixing audio data in the target audio-video file to the second user equipment through the first communication connection, the second communication connection and the third communication connection.
Optionally, the method further comprises:
when the first user equipment detects the operation of adding a mark to a first call video, sequentially acquiring each video frame in the first call video;
each time a video frame is acquired, the first user equipment determines a corresponding mark adding position of a mark adding tool in the currently acquired video frame;
the first user equipment adds preset type identification information corresponding to the mark adding position in the currently acquired video frame;
the first user equipment sends the video frame added with the identification information to the second user equipment through the first communication connection, the second communication connection and the third communication connection.
Optionally, the method further comprises:
when the first user equipment detects the operation of identifying the identity of a target user corresponding to the second user equipment, acquiring a second conversation video received from the second user equipment for a preset duration;
The first user equipment determines a target video frame meeting a preset condition in the second conversation video;
the first user equipment sends the target video frame to an identity verification server;
and the first user equipment receives an identity verification result corresponding to the target user, which is returned by the identity verification server based on the target video frame.
Optionally, the method further comprises:
the first user equipment detects the transverse and vertical directions of characters in a third conversation video by adopting an edge detection algorithm, wherein the third conversation video is a conversation video received from the second user equipment;
if the transverse and vertical directions of the characters do not meet the set requirements, the first user equipment rotates the third conversation video by a preset angle;
and the first user equipment displays the rotated third conversation video.
The execution process of each device in the communication method provided in the embodiment of the present invention is described in detail in the embodiment corresponding to the communication system, and reference may be made to the execution process of each device in the embodiment corresponding to the communication system, which is not described herein.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (10)
1. A communication system comprising a first user equipment, a second user equipment, an application server and a soft switch server, wherein:
the first user equipment is used for acquiring an audio and video call software development kit SDK from the application server based on the target website when the input operation of the target website is detected; running a registration method in the audio/video call SDK to register the first communication identifier to the soft switch server through a pre-stored first communication identifier and a password corresponding to the first communication identifier; when a call operation initiated to the second user equipment is detected, a call method in the audio/video call SDK is operated so as to send a call request to the soft switch server, wherein the call request carries a first registered communication identifier and a second communication identifier corresponding to the second user equipment;
the soft switch server is used for responding to the call request and establishing a first communication connection with the first user equipment; sending the call request to an operator gateway corresponding to the second communication identifier to request the operator gateway to establish a second communication connection with the soft switch server, and establishing a third communication connection between the operator gateway and the second user equipment through paging operation;
The first user equipment is configured to perform an audio/video call with the second user equipment based on the first communication connection, the second communication connection, and the third communication connection.
2. The communication system according to claim 1, wherein the registration method in the audio-video call SDK is a register () method in a UA object of a JsSIP tool;
the calling method in the audio/video call SDK is a call () method of a JsSIP tool.
3. The communication system of claim 1, wherein the first user device is configured to:
when the target audio and video file played to the second user equipment is detected, acquiring the target audio and video file;
mixing file audio data in the target audio-video file with seat voice data acquired by an audio acquisition device to obtain mixed audio data, wherein the seat voice data comprises explanation contents of the target audio-video file;
and transmitting the file video data and the audio-mixing audio data in the target audio-video file to the second user equipment through the first communication connection, the second communication connection and the third communication connection.
4. The communication system of claim 1, wherein the first user device is configured to:
when detecting the operation of adding a mark to a first call video, sequentially acquiring each video frame in the first call video;
each time a video frame is acquired, determining a corresponding mark adding position of a mark adding tool in the currently acquired video frame;
adding preset type identification information corresponding to the mark adding position in the currently acquired video frame;
and transmitting the video frame added with the identification information to the second user equipment through the first communication connection, the second communication connection and the third communication connection.
5. The communication system of claim 1, wherein the first user device is configured to:
when detecting the operation of identifying the identity of the target user corresponding to the second user equipment, acquiring a second conversation video received from the second user equipment for a preset duration;
determining target video frames meeting preset conditions in the second conversation video;
transmitting the target video frame to an identity verification server;
And receiving an identity verification result corresponding to the target user, which is returned by the identity verification server based on the target video frame.
6. The communication system of claim 1, wherein the first user device is configured to:
detecting the transverse and vertical directions of characters in a third conversation video by adopting an edge detection algorithm, wherein the third conversation video is a conversation video received from the second user equipment;
if the transverse and vertical directions of the characters do not meet the set requirements, rotating the third conversation video by a preset angle;
and displaying the rotated third session video.
7. A communication method, wherein the method is applied to a communication system, the communication system including a first user equipment, a second user equipment, an application server, and a soft switch server, the method comprising:
when the first user equipment detects the input operation of a target website, acquiring an audio and video call Software Development Kit (SDK) from the application server based on the target website;
the first user equipment runs a registration method in the audio/video call SDK to register the first communication identifier to the soft switch server through a pre-stored first communication identifier and a password corresponding to the first communication identifier;
When the first user equipment detects a call operation initiated to the second user equipment, a call method in the audio/video call SDK is operated so as to send a call request to the soft switch server, wherein the call request carries a first communication identifier after registration and a second communication identifier corresponding to the second user equipment;
the soft switch server responds to the call request and establishes a first communication connection with the first user equipment;
the soft switch server sends the call request to an operator gateway corresponding to the second communication identifier to request the operator gateway to establish second communication connection with the soft switch server, and establishes third communication connection between the operator gateway and the second user equipment through paging operation;
the first user equipment performs audio and video call with the second user equipment based on the first communication connection, the second communication connection and the third communication connection.
8. The method of claim 7, wherein the registration method in the audio-video call SDK is a register () method in a UA object of a JsSIP tool;
The calling method in the audio/video call SDK is a call () method of a JsSIP tool.
9. The method of claim 7, wherein the method further comprises:
when the first user equipment detects that a target audio and video file is played to the second user equipment, acquiring the target audio and video file;
the first user equipment mixes the file audio data in the target audio-video file with the seat voice data acquired by the audio acquisition device to obtain mixed audio data, wherein the seat voice data contains explanation contents of the target audio-video file;
and the first user equipment sends the file video data and the audio-mixing audio data in the target audio-video file to the second user equipment through the first communication connection, the second communication connection and the third communication connection.
10. The method of claim 7, wherein the method further comprises:
when the first user equipment detects the operation of adding a mark to a first call video, sequentially acquiring each video frame in the first call video;
Each time a video frame is acquired, the first user equipment determines a corresponding mark adding position of a mark adding tool in the currently acquired video frame;
the first user equipment adds preset type identification information corresponding to the mark adding position in the currently acquired video frame;
the first user equipment sends the video frame added with the identification information to the second user equipment through the first communication connection, the second communication connection and the third communication connection.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311246199.1A CN116996640B (en) | 2023-09-25 | 2023-09-25 | Communication system and communication method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311246199.1A CN116996640B (en) | 2023-09-25 | 2023-09-25 | Communication system and communication method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116996640A true CN116996640A (en) | 2023-11-03 |
| CN116996640B CN116996640B (en) | 2023-12-01 |
Family
ID=88525154
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311246199.1A Active CN116996640B (en) | 2023-09-25 | 2023-09-25 | Communication system and communication method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116996640B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020118800A1 (en) * | 1998-08-27 | 2002-08-29 | Maria Martinez | Telecommunication systems and methods therefor |
| CN110611716A (en) * | 2019-09-27 | 2019-12-24 | 北京巨象具象科技有限公司 | Prefabricated data propagation method and device and electronic equipment |
| CN111050000A (en) * | 2018-10-12 | 2020-04-21 | 北京京东尚科信息技术有限公司 | Method, device and system for realizing soft phone of call center |
| CN112969203A (en) * | 2021-01-30 | 2021-06-15 | 上海浦东发展银行股份有限公司 | Method for integrating multiple call modes based on android system platform |
| KR20220006939A (en) * | 2020-07-09 | 2022-01-18 | 주식회사 케이티알파 | The method of providing a service sharing image on a caller's web screen with realtime by visualizing the web screen automatically at connected time |
-
2023
- 2023-09-25 CN CN202311246199.1A patent/CN116996640B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020118800A1 (en) * | 1998-08-27 | 2002-08-29 | Maria Martinez | Telecommunication systems and methods therefor |
| CN111050000A (en) * | 2018-10-12 | 2020-04-21 | 北京京东尚科信息技术有限公司 | Method, device and system for realizing soft phone of call center |
| CN110611716A (en) * | 2019-09-27 | 2019-12-24 | 北京巨象具象科技有限公司 | Prefabricated data propagation method and device and electronic equipment |
| KR20220006939A (en) * | 2020-07-09 | 2022-01-18 | 주식회사 케이티알파 | The method of providing a service sharing image on a caller's web screen with realtime by visualizing the web screen automatically at connected time |
| CN112969203A (en) * | 2021-01-30 | 2021-06-15 | 上海浦东发展银行股份有限公司 | Method for integrating multiple call modes based on android system platform |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116996640B (en) | 2023-12-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11558437B2 (en) | Communication system and method of using the same | |
| EP3266192B1 (en) | Communication system and method of using the same | |
| KR102327571B1 (en) | Displaying video call data | |
| EP2421000B1 (en) | Communication terminal, communication system, communication method, and communication control program | |
| EP2398187B1 (en) | Transmission of countermeasure data through a management data session between two terminals upon failure of content data session between said terminals | |
| US8885298B2 (en) | Conference roll call | |
| US9661269B2 (en) | System for enabling communications and conferencing between dissimilar computing devices including mobile computing devices | |
| US9020136B2 (en) | System and method for blended PSTN and computer network customer support interactions | |
| US10218749B2 (en) | Systems, methods, and computer programs for establishing a screen share session for a remote voice call | |
| US20070057912A1 (en) | Method and system for controlling an interface of a device through motion gestures | |
| US20170288942A1 (en) | Portal for Provisioning Autonomous Software Agents | |
| US9041763B2 (en) | Method for establishing video conference | |
| US20080008162A1 (en) | Method and system for network path discrimination | |
| US20080181141A1 (en) | Enhanced voicemail processing | |
| CN111475840A (en) | Method and apparatus for suspending screen sharing during confidential data entry | |
| EP2163082A2 (en) | Use of human gestures by a mobile phone for generating responses to a communication party | |
| US8576995B1 (en) | System and method for connecting an endpoint to an active multimedia communications session on a data network by setting metadata associated with a telephone call | |
| WO2017172651A1 (en) | Selecting an autonomous software agent | |
| WO2017172652A1 (en) | Supplying context data to a servicing entity | |
| US9020109B2 (en) | Location aware conferencing system and method | |
| CN105915521A (en) | Multi-party communication management method, device and terminal | |
| CN116996640B (en) | Communication system and communication method | |
| US20080117916A1 (en) | VoIP TERMINAL APPARATUS, VoIP COMMUNICATION SYSTEM AND PRESENCE CHECK METHOD THEREOF | |
| US11671472B1 (en) | Voice agent for sidebars during virtual meetings | |
| US20230246861A1 (en) | Sidebars for virtual meetings |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |