CN113630512B - Rich media call mobile terminal system and application method thereof - Google Patents
Rich media call mobile terminal system and application method thereof Download PDFInfo
- Publication number
- CN113630512B CN113630512B CN202110890072.8A CN202110890072A CN113630512B CN 113630512 B CN113630512 B CN 113630512B CN 202110890072 A CN202110890072 A CN 202110890072A CN 113630512 B CN113630512 B CN 113630512B
- Authority
- CN
- China
- Prior art keywords
- module
- data
- media
- interface
- audio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M7/00—Arrangements for interconnection between switching centres
- H04M7/006—Networks other than PSTN/ISDN providing telephone service, e.g. Voice over Internet Protocol (VoIP), including next generation networks with a packet-switched transport layer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/10—Architectures or entities
- H04L65/1046—Call controllers; Call servers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1101—Session protocols
- H04L65/1104—Session initiation protocol [SIP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M7/00—Arrangements for interconnection between switching centres
- H04M7/006—Networks other than PSTN/ISDN providing telephone service, e.g. Voice over Internet Protocol (VoIP), including next generation networks with a packet-switched transport layer
- H04M7/0072—Speech codec negotiation
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Telephonic Communication Services (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The invention relates to a rich media call mobile terminal system and a use method thereof, which are characterized by comprising an audio and video call module, a media engine module, a secure media channel module, a service processing module, an interface packaging module and an interface module; the audio and video call module, the media engine module, the secure media channel module and the VoLTE core network of the operator are connected; the secure media channel module is used for establishing a secure media channel with the VoLTE core network of the operator and is responsible for sending and receiving secure media data and forwarding the secure media data to the service processing module; the service processing module encodes and decodes the secure media data and forwards the secure media data to the interface packaging module; the interface packaging module converts the secure media data and forwards the secure media data to the interface module; the interface module analyzes the secure media data and displays the secure media data. Compared with the prior art, the invention provides various rich media interactive contents for the mobile terminal, and simultaneously ensures the transmission safety of rich media data.
Description
Technical Field
The invention relates to a rich media call mobile terminal system and a using method thereof.
Background
The services of the conventional mobile phone are mainly classified into three types, the first type is a basic audio and video call service, the second type is a supplementary service such as a call transfer service, and the third type is a multimedia service such as a ring service before a call, a DTMF (dual-tone multifrequency, chinese is dual tone multi frequency) service in a call, an IVR (Interactive Voice Response, chinese is interactive voice response) and an IVVR (Interactive Voice and Video Response, chinese is interactive voice and video response) service. DTMF is a dial-up key service, IVR is an interactive response voice service, and IVVR is an interactive response video service.
Based on IVR and IVVR services, a user can operate some simple responsive video services such as network on demand, video monitoring, video games, enterprise video applications and the like through keys in a call, but cannot do more complex business functions of B2C (Business to Consumer, chinese is enterprise to consumer) in the call, such as questionnaire survey, intelligent customer service and the like, and the more complex business needs to be completed by the user through a Web page or a control mode. At present, a mature scheme is to issue Web page links in a short message mode, so that a user opens the Web page links of the short message simultaneously in the conversation process, and the external link mode has the problems that firstly, certain potential safety hazards exist in data transmission, data are transmitted under an unsafe Internet network and possibly intercepted or stolen by a third party, and secondly, the user experience is very unfriendly, and the user is required to actively find the corresponding short message links and then open.
Based on the above problems, if the rich media call can be realized on the call mobile terminal, the security of data transmission can be ensured, so that the service experience of a user can be well ensured, and the quick innovation and online of a new service can be supported, thereby improving the competitive power of OTT application of the mobile internet. Rich Media, i.e., english translation of Rich Media, is not itself a specific form of internet Media, but rather refers to a method of information dissemination with animation, sound, video, or interactivity. The rich media contains one or a combination of several forms of programming languages such as streaming media, sound, flash, java, javascript, DHTML, etc.
Disclosure of Invention
The invention aims to provide a mobile terminal system capable of realizing various rich media interactive contents and ensuring the safety of data transmission.
The invention further aims to solve the technical problem of providing a using method of the mobile terminal system which can realize various rich media interactive contents and ensure the safety of data transmission at the same time.
The invention solves the above primary technical problems by adopting the technical proposal that: the rich media call mobile terminal system is characterized by comprising an audio and video call module, a media engine module, a secure media channel module, a service processing module, an interface packaging module and an interface module; the audio and video call module, the media engine module, the secure media channel module and the VoLTE core network of the operator are connected;
the audio and video call module is used for establishing audio and video call with the VoLTE core network of the operator, can call the media engine module to establish an audio and video channel at the same time, and can call the secure media channel module to establish a secure media channel at the same time;
the media engine module is used for establishing an audio and video channel with the VoLTE core network of the operator and is responsible for encoding and decoding audio and video media data and receiving and transmitting the audio and video media data;
the secure media channel module is used for establishing a secure media channel with the VoLTE core network of the operator and is responsible for sending and receiving secure media data, and forwarding the received secure media data to the service processing module;
the service processing module is used for interfacing with the secure media channel module, encoding and decoding the secure media data of the secure media channel module to obtain first intermediate secure media data, and forwarding the first intermediate secure media data to the interface encapsulation module;
the interface packaging module is used for interfacing with the service processing module, converting the first intermediate security media data sent by the service processing module to obtain second intermediate security media data which can be analyzed by the interface module, and forwarding the second intermediate security media data to the interface module;
the interface module can be in butt joint with the interface packaging module, can analyze the second intermediate safety media data sent by the interface packaging module, and can display the safety media data after the analysis of the second intermediate safety media data.
The audio-video call module and the VoLTE core network of the operator establish audio-video call through the SIP protocol and the SDP protocol, and can interactively interface with first SIP signaling data for maintaining and controlling the state of the whole audio-video call, interactively interface with second SIP signaling data for negotiating audio-video media parameters, and interactively interface with third SIP signaling data for negotiating security media channel parameters.
The second SIP signaling data comprises a media port, a coding and decoding type and a packing duration; the third SIP signaling data includes a media port, a flow ID, a service protocol, and a service type.
The media engine module and the VoLTE core network of the operator can interactively butt joint audio and video media data in an RTP format, are used for being responsible for encoding and decoding functions of the audio and video media data, ensure the quality of the audio and video media and manage the input and output functions of audio equipment and video equipment.
The secure media channel module and the VoLTE core network of the operator can interact SCTP media data; the method comprises the steps that a secure media channel module firstly establishes a secure media channel between the secure media channel module and an operator VoLTE core network, wherein the secure media channel comprises a DTLS handshake flow and an SCTP handshake flow; and then encrypting or decrypting the SCTP media data, encoding or decoding the SCTP media data, decoding the received SCTP media data by the secure media channel module to obtain HTTP message data with an HTML stream, and forwarding the HTTP message data with the HTML stream to the service module processing module as the secure media data.
The service processing module is in butt joint with the secure media channel, HTTP message data with the HTML stream is obtained, the HTTP message data with the HTML stream is decoded or decoded, the HTML stream is obtained, and the HTML stream is used as first intermediate secure media data to be sent to the interface packaging module.
The interface packaging module is in butt joint with the service processing module to acquire an HTML stream, then the HTML stream data is converted into Javascript interface data from C interface data, and the Javascript interface data is used as second intermediate safety media data to be transmitted to the interface module; the interface module is in butt joint with the interface packaging module, HTML stream data is obtained through Javascript interface data, the HTML stream data is input into a WebView component, and an interactive interface is provided for a user to do business operation.
The technical scheme adopted for solving the further technical problems is as follows: the using method of the rich media call mobile terminal system with the structure is characterized by comprising the following steps:
step 1, a rich media call mobile terminal user initiates an audio and video call to a called party by clicking a call button through an interface module;
step 2, the audio and video call module of the rich media call mobile terminal establishes a call with the VoLTE core network of the operator by utilizing the SIP protocol, successfully negotiates the media parameters with the VoLTE core network of the operator and establishes an audio and video call by utilizing the SDP protocol to carry the audio and video media parameters and the media parameters of the safety channel;
step 3, the media engine module of the rich media call mobile terminal and the VoLTE core network of the operator establish an audio and video channel, collect audio and video streams of a microphone and a camera of the local terminal, encode and package the audio and video streams, send the audio and video streams, and receive, decode and play the audio and video data streams sent by the called party;
step 4, the secure media channel module of the rich media call mobile terminal establishes an SCTP secure media channel by utilizing an SCTP protocol, a DTLS protocol and an operator VoLTE core network, decrypts the received HTTP message data with the HTML stream, and then transmits the HTTP message data as secure media data to the service processing module;
step 5, the service processing module of the rich media call mobile terminal replies the received HTTP message data with the HTML stream, then decodes or decodes the HTTP message data with the HTML stream, extracts the HTTP message data to obtain the HTML stream, and sends the HTML stream as first intermediate safety media data to the interface packaging module;
step 6, the interface packaging module of the rich media call mobile terminal packages the received HTML stream into Jav by the C interface through the JNI technologyaThe interface is sealed by JSbridge technologyThe method comprises the steps of loading the Javascript interface data, and transmitting the Javascript interface data to a WebView component of an interface module as second intermediate safety media data;
step 7, the user of the rich media call mobile terminal operates the service on the WebView component of the interface module, and the operation data of the user is transmitted to the service processing module through the interface packaging module;
step 8, the service processing module of the rich media call mobile terminal sends the operation data of the user to the secure media channel module, the secure media channel module sends the operation data of the user to the VoLTE core network of the operator through the SCTP secure media channel, receives the HTTP response result of the VoLTE core network of the operator, then transmits the HTTP response result to the service processing module, and transmits the HTTP response result to the interface encapsulation module through the service processing module;
step 9, the interface packaging module of the rich media call mobile terminal converts the received HTTP response result from C interface data to JNI technologyJavaAnd packaging the interface data into Javascript interface data through a JSbridge technology, and transmitting the Javascript interface data to a WebView component of the interface module for display.
Compared with the prior art, the invention has the advantages that: the secure media channel and the interface module are communicated and integrated in the mobile terminal, so that various rich media interactive contents are provided for the mobile terminal, and meanwhile, the transmission security of rich media data is ensured.
Drawings
Fig. 1 is a functional block diagram of a rich media call mobile terminal system according to an embodiment of the present invention.
Fig. 2 is a flowchart of a method for using a rich media call mobile terminal system according to an embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the embodiments of the drawings.
The rich media call mobile terminal system shown in fig. 1 is characterized by comprising an audio/video call module 1, a media engine module 2, a secure media channel module 3, a service processing module 4, an interface packaging module 5 and an interface module 6; the audio and video call module 1, the media engine module 2, the secure media channel module 3 and the VoLTE core network of the operator are connected;
the audio-video call module 1 and the VoLTE core network of the operator establish audio-video call through an SIP protocol and an SDP protocol, and can interactively interface first SIP signaling data for maintaining and controlling the state of the whole audio-video call, interactively interface second SIP signaling data for negotiating audio-video media parameters and interactively interface third SIP signaling data for negotiating security media channel parameters; the second SIP signaling data comprises a media port, a coding and decoding type and a packing time length; the third SIP signaling data includes a media port, a flow ID, a service protocol, and a service type; the audio and video call module 1 can also call the media engine module to establish an audio and video channel at the same time, and can also call the secure media channel module to establish a secure media channel at the same time;
the media engine module 2 is used for establishing an audio and video channel with the VoLTE core network of an operator and is responsible for encoding and decoding audio and video media data and receiving and transmitting the audio and video media data; the audio and video media data which are interactively butted by the media engine module 2 and the VoLTE core network of the operator are in RTP format, and the media engine module 2 is not only responsible for the encoding and decoding functions of the audio and video media data in RTP format, so that the quality of the audio and video media is ensured, but also the input and output functions of the audio equipment and the video equipment are managed;
the secure media channel module 3 and the VoLTE core network of the operator can interact SCTP media data; the secure media channel module 3 firstly establishes a secure media channel between the secure media channel module and the VoLTE core network of an operator, wherein the secure media channel comprises a DTLS handshake flow and an SCTP handshake flow; then encrypting or decrypting the SCTP media data, encoding or decoding the SCTP media data, decoding the received SCTP media data by the secure media channel module to obtain HTTP message data with an HTML stream, and forwarding the HTTP message data with the HTML stream to the service module processing module 4 as the secure media data;
the service processing module 4 is configured to dock with the secure media channel module 3, and encode and decode the secure media data of the secure media channel module, that is, the service processing module 4 obtains HTTP message data with HTML stream, decodes or decodes the HTTP message data with HTML stream to obtain HTML stream, and sends the HTML stream as first intermediate secure media data to the interface encapsulation module 5;
the interface packaging module 5 is used for interfacing with the service processing module 4 to obtain an HTML stream, then converting the HTML stream data from C interface data to Javascript interface data, and transmitting the Javascript interface data as second intermediate security media data to the interface module 6;
the interface module 6 can be in butt joint with the interface packaging module 5, can analyze the Javascript interface data sent by the interface packaging module 5, analyze the Javascript interface data to obtain HTML stream data, input the HTML stream data into a WebView component, and provide an interactive interface for a user to perform business operation.
The method for using the rich media call mobile terminal system includes the following steps, referring to fig. 2:
step 1, a rich media call mobile terminal user clicks a call button to initiate an audio and video call to a called party through an interface module 6;
step 2, the audio and video call module 1 of the rich media call mobile terminal establishes a call with the VoLTE core network of the operator by utilizing the SIP protocol, successfully negotiates the media parameters with the VoLTE core network of the operator and establishes an audio and video call by utilizing the SDP protocol to carry the audio and video media parameters and the media parameters of the safety channel;
step 3, the media engine module 2 of the rich media call mobile terminal and the VoLTE core network of the operator establish an audio and video channel, collect audio and video streams of a microphone and a camera of the local terminal, encode and package the audio and video streams, send the audio and video streams in the form of RTP data packets, and receive, decode and play the audio and video data streams sent by a called party, namely RTP data streams;
step 4, the secure media channel module 3 of the rich media call mobile terminal establishes an SCTP secure media channel by utilizing an SCTP protocol, a DTLS protocol and an operator VoLTE core network, decrypts the received HTTP message data with the HTML stream, and then transmits the HTTP message data as secure media data to the service processing module 4;
step 5, the service processing module 4 of the rich media call mobile terminal replies the received HTTP message data with the HTML stream, then decodes or decodes the HTTP message data with the HTML stream, extracts the HTTP message data to obtain the HTML stream, and sends the HTML stream as first intermediate security media data to the interface packaging module 5;
step 6, the interface packaging module 5 of the rich media call mobile terminal packages the received HTML stream into Java interface data by the C interface data through a JNI technology, packages the Java interface data into Java interface data through a JSbridge technology, and transmits the Java interface data as second intermediate safety media data to the WebView component of the interface module 6;
step 7, the user of the rich media call mobile terminal operates the service on the WebView component of the interface module 6, and transmits the operation data of the user to the service processing module 4 through the interface packaging module 5;
step 8, the service processing module 4 of the rich media call mobile terminal sends the operation data of the user to the secure media channel module 3, the secure media channel module 3 sends the operation data of the user to the VoLTE core network of the operator through the SCTP secure media channel, receives the HTTP response result of the VoLTE core network of the operator, then transmits the HTTP response result to the service processing module 4, and transmits the HTTP response result to the interface encapsulation module 5 through the service processing module 4;
and 9, converting the received HTTP response result into Java interface data by the interface packaging module 5 of the rich media call mobile terminal through the C interface data, packaging the Java interface data into Java interface data through a JSbridge technology, and transmitting the Java interface data to a WebView component of the interface module 6 for display.
According to the rich media new call mobile terminal system, the session is established through the audio-video module, the secure media channel is established through the secure media channel module, different rich media data (such as RTP data, MSRP data, HTTP data and the like) are transmitted in the secure media channel, rich media content is presented and interacted with a user through the WebView component of the interface module 6, and the rich interaction content and the safer media transmission channel are provided for traditional call scenes.
The following uses dialing 10086 as a specific application scenario to illustrate the usage method of the above-mentioned rich media call mobile terminal system:
step 1, a user opens a dialing application in a rich media call mobile terminal, and clicks and dials after 0757-10086 numbers are input on a display interface of the dialing application;
step 2, the audio-video call module of the rich media call mobile terminal establishes a call with 10086 by using the SIP protocol, the media engine module of the rich media call mobile terminal establishes an audio-video channel with 10086, the user successfully establishes a call with 10086, and the rich media call mobile terminal collects audio-video streams of a microphone and a camera of the home terminal, encodes and packages the audio-video streams, sends the encoded and packaged audio-video streams, and receives, decodes and plays the audio-video data streams sent by 10086;
step 3, the secure media channel module of the rich media call mobile terminal establishes an SCTP secure media channel by utilizing an SCTP protocol, a DTLS protocol and 10086, and triggers personal broadband service after the user inputs 10;
step 4, popup WebView on the display interface of the dialing application of the rich media call mobile terminal, and after decrypting the received HTTP message data with the HTML stream, the secure media channel module of the rich media call mobile terminal is used as the secure media data to be transmitted to the service processing module, the service processing module replies the received HTTP message data with the HTML stream, then decodes the HTTP message data with the HTML stream, extracts the HTML stream and transmits the HTML stream to the interface encapsulation module, the interface encapsulation module encapsulates the received HTML stream into Java interface data from C interface data through JNI technology, encapsulates the Java interface data into Javascript interface data through JSbridge technology, and transmits the Java interface data to the WebView component of the interface module for display; at the moment, after the user's own number is automatically logged in, the user is jumped to a broadband handling page, the user is prompted to input an address of the expected broadband, the user can input texts, can also position and select local addresses, and can also open a navigation map for self-defining selection;
and 5, after the user inputs the address, clicking and submitting, prompting success of broadband installation willingness submitting, and enabling the user to select to hang up.
The process does not need the user to receive and open the external link through the short message, has no potential safety hazard, and is more convenient and quick to use.
Claims (9)
1. The rich media call mobile terminal system is characterized by comprising an audio and video call module, a media engine module, a secure media channel module, a service processing module, an interface packaging module and an interface module; the audio and video call module, the media engine module, the secure media channel module and the VoLTE core network of the operator are connected;
the audio and video call module is used for establishing audio and video call with the VoLTE core network of the operator, can call the media engine module to establish an audio and video channel at the same time, and can call the secure media channel module to establish a secure media channel at the same time;
the media engine module is used for establishing an audio and video channel with the VoLTE core network of the operator and is responsible for encoding and decoding audio and video media data and receiving and transmitting the audio and video media data;
the secure media channel module is used for establishing a secure media channel with the VoLTE core network of the operator and is responsible for sending and receiving secure media data, and forwarding the received secure media data to the service processing module;
the service processing module is used for interfacing with the secure media channel module, encoding and decoding the secure media data of the secure media channel module to obtain first intermediate secure media data, and forwarding the first intermediate secure media data to the interface encapsulation module;
the interface packaging module is used for interfacing with the service processing module, converting the first intermediate security media data sent by the service processing module to obtain second intermediate security media data which can be analyzed by the interface module, and forwarding the second intermediate security media data to the interface module;
the interface module can be in butt joint with the interface packaging module, can analyze the second intermediate safety media data sent by the interface packaging module, and can display the safety media data after the analysis of the second intermediate safety media data.
2. The rich media talking mobile terminal system of claim 1, wherein: the audio-video call module and the VoLTE core network of the operator establish audio-video call through the SIP protocol and the SDP protocol, and can interactively interface with first SIP signaling data for maintaining and controlling the state of the whole audio-video call, interactively interface with second SIP signaling data for negotiating audio-video media parameters, and interactively interface with third SIP signaling data for negotiating security media channel parameters.
3. The rich media talking mobile terminal system of claim 2, wherein: the second SIP signaling data comprises a media port, a coding and decoding type and a packing duration; the third SIP signaling data includes a media port, a flow ID, a service protocol, and a service type.
4. The rich media talking mobile terminal system of claim 1, wherein: the media engine module and the VoLTE core network of the operator can interactively butt-joint audio and video media data in an RTP format, not only are responsible for encoding and decoding functions of the audio and video media data and ensure the quality of the audio and video media, but also manage the input and output functions of the audio equipment and the video equipment.
5. The rich media talking mobile terminal system of claim 1, wherein: the secure media channel module and the VoLTE core network of the operator can interact SCTP media data; the method comprises the steps that a secure media channel module firstly establishes a secure media channel between the secure media channel module and an operator VoLTE core network, wherein the secure media channel comprises a DTLS handshake flow and an SCTP handshake flow; and then encrypting or decrypting the SCTP media data, encoding or decoding the SCTP media data, decoding the received SCTP media data by the secure media channel module to obtain HTTP message data with an HTML stream, and forwarding the HTTP message data with the HTML stream to the service module processing module as the secure media data.
6. The rich media talking mobile terminal system of claim 5, wherein: the service processing module is in butt joint with the secure media channel, HTTP message data with the HTML stream is obtained, the HTTP message data with the HTML stream is decoded or decoded, the HTML stream is obtained, and the HTML stream is used as first intermediate secure media data to be sent to the interface packaging module.
7. The rich media talking mobile terminal system of claim 6, wherein: the interface packaging module is in butt joint with the service processing module to acquire an HTML stream, then the HTML stream data is converted into Javascript interface data from C interface data, and the Javascript interface data is used as second intermediate safety media data to be transmitted to the interface module; the interface module is in butt joint with the interface packaging module, HTML stream data is obtained through Javascript interface data, the HTML stream data is input into a WebView component, and an interactive interface is provided for a user to do business operation.
8. The rich media talking mobile terminal system of claim 1, wherein: the secure media data includes one or any combination of the following: RTP data, MSRP data, HTTP data.
9. A method of using a rich media call mobile terminal system as claimed in claim 1, comprising the steps of:
step 1, a rich media call mobile terminal user initiates an audio and video call to a called party by clicking a call button through an interface module;
step 2, the audio and video call module of the rich media call mobile terminal establishes a call with the VoLTE core network of the operator by utilizing the SIP protocol, successfully negotiates the media parameters with the VoLTE core network of the operator and establishes an audio and video call by utilizing the SDP protocol to carry the audio and video media parameters and the media parameters of the safety channel;
step 3, the media engine module of the rich media call mobile terminal and the VoLTE core network of the operator establish an audio and video channel, collect audio and video streams of a microphone and a camera of the local terminal, encode and package the audio and video streams, send the audio and video streams, and receive, decode and play the audio and video data streams sent by the called party;
step 4, the secure media channel module of the rich media call mobile terminal establishes an SCTP secure media channel by utilizing an SCTP protocol, a DTLS protocol and an operator VoLTE core network, decrypts the received HTTP message data with the HTML stream, and then transmits the HTTP message data as secure media data to the service processing module;
step 5, the service processing module of the rich media call mobile terminal replies the received HTTP message data with the HTML stream, then decodes or decodes the HTTP message data with the HTML stream, extracts the HTTP message data to obtain the HTML stream, and sends the HTML stream as first intermediate safety media data to the interface packaging module;
step 6, the interface packaging module of the rich media call mobile terminal packages the received HTML stream into Java interface data by the C interface data through a JNI technology, packages the Java interface data into Javascript interface data through a JSbridge technology, and transmits the Javascript interface data as second intermediate safety media data to a WebView component of the interface module;
step 7, the user of the rich media call mobile terminal operates the service on the WebView component of the interface module, and the operation data of the user is transmitted to the service processing module through the interface packaging module;
step 8, the service processing module of the rich media call mobile terminal sends the operation data of the user to the secure media channel module, the secure media channel module sends the operation data of the user to the VoLTE core network of the operator through the SCTP secure media channel, receives the HTTP response result of the VoLTE core network of the operator, then transmits the HTTP response result to the service processing module, and transmits the HTTP response result to the interface encapsulation module through the service processing module;
and 9, converting the received HTTP response result into Java interface data by the interface packaging module of the rich media call mobile terminal through the C interface, packaging the Java interface data into Java interface data through the JSbridge technology, and transmitting the Java interface data to a WebView component of the interface module for display.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110890072.8A CN113630512B (en) | 2021-08-04 | 2021-08-04 | Rich media call mobile terminal system and application method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110890072.8A CN113630512B (en) | 2021-08-04 | 2021-08-04 | Rich media call mobile terminal system and application method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113630512A CN113630512A (en) | 2021-11-09 |
| CN113630512B true CN113630512B (en) | 2023-10-13 |
Family
ID=78382527
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110890072.8A Active CN113630512B (en) | 2021-08-04 | 2021-08-04 | Rich media call mobile terminal system and application method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113630512B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114285816B (en) * | 2021-12-30 | 2024-02-06 | 中国电信股份有限公司 | Method and system for calling instant message interaction in voice call process |
| CN116847128B (en) * | 2023-09-04 | 2023-11-28 | 中科融信科技有限公司 | Video superposition processing method based on 5G VoLTE video teleconference |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101453477A (en) * | 2007-12-07 | 2009-06-10 | 华为技术有限公司 | Method and apparatus for media content uploading in real-time |
| US9408067B1 (en) * | 2013-12-02 | 2016-08-02 | Taqua, Llc | Selectively disallowing use of media over data calling in a segment based on segment characteristics |
| WO2017045407A1 (en) * | 2015-09-17 | 2017-03-23 | 中兴通讯股份有限公司 | Method of implementing end-to-end conversation encryption, terminal and network element of network side |
| CN110336842A (en) * | 2014-01-20 | 2019-10-15 | 三星电子株式会社 | Use the communication device of multimedia service, method and system |
| CN110351445A (en) * | 2019-06-19 | 2019-10-18 | 成都康胜思科技有限公司 | A kind of high concurrent VOIP recording service system based on intelligent sound identification |
| CN113114860A (en) * | 2021-04-02 | 2021-07-13 | 宁波菊风系统软件有限公司 | Web-based audio and video response system and use method thereof |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070266170A1 (en) * | 2006-05-11 | 2007-11-15 | Mockett Gregory P | Interactive, rich-media delivery over an ip network using synchronized unicast and multicast |
| US20090234876A1 (en) * | 2008-03-14 | 2009-09-17 | Timothy Schigel | Systems and methods for content sharing |
| CN102035839B (en) * | 2010-12-14 | 2014-11-05 | 中兴通讯股份有限公司 | Method, system and equipment for providing stream media service |
| US9565149B2 (en) * | 2012-11-05 | 2017-02-07 | Phoji, Llc | Media messaging methods, systems, and devices |
-
2021
- 2021-08-04 CN CN202110890072.8A patent/CN113630512B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101453477A (en) * | 2007-12-07 | 2009-06-10 | 华为技术有限公司 | Method and apparatus for media content uploading in real-time |
| US9408067B1 (en) * | 2013-12-02 | 2016-08-02 | Taqua, Llc | Selectively disallowing use of media over data calling in a segment based on segment characteristics |
| CN110336842A (en) * | 2014-01-20 | 2019-10-15 | 三星电子株式会社 | Use the communication device of multimedia service, method and system |
| WO2017045407A1 (en) * | 2015-09-17 | 2017-03-23 | 中兴通讯股份有限公司 | Method of implementing end-to-end conversation encryption, terminal and network element of network side |
| CN110351445A (en) * | 2019-06-19 | 2019-10-18 | 成都康胜思科技有限公司 | A kind of high concurrent VOIP recording service system based on intelligent sound identification |
| CN113114860A (en) * | 2021-04-02 | 2021-07-13 | 宁波菊风系统软件有限公司 | Web-based audio and video response system and use method thereof |
Non-Patent Citations (2)
| Title |
|---|
| 富媒体通信的部署实践;曹懿军;洪亮;;电信技术(04);59-61 * |
| 移动智能终端Web应用平台开发技术研究;陈桦;杜启宏;程刚;;移动通信(05);25-28 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113630512A (en) | 2021-11-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10341610B2 (en) | Method and apparatus using an integrated femtocell and residential gateway device | |
| CN106850399B (en) | Communication method based on WebRTC technology instant message | |
| US8666046B2 (en) | System and method for providing enhanced telephone call functions associated with caller and/or callee information during telephony ringing signal | |
| CN113630512B (en) | Rich media call mobile terminal system and application method thereof | |
| US8582726B2 (en) | Method and an apparatus for handling multimedia calls | |
| US20230353603A1 (en) | Call processing system and call processing method | |
| EP1890457A1 (en) | Accessing interactive services over internet | |
| CN116636199A (en) | Call processing method, call processing device and related equipment | |
| US8130691B2 (en) | Relay apparatus, communication terminal, and communication method | |
| US20080123626A1 (en) | Accessing television and video services on a video phone over voice over internet protocol network | |
| CN101888377A (en) | Communication method, media server and communication system | |
| KR101302880B1 (en) | Method and mobile terminal for sharing mobile phone television program | |
| WO2013189430A2 (en) | Method, system, and media server for implementing automatic speech recognition service | |
| US9100412B2 (en) | Method and apparatus for transmitting media resources | |
| CN112714131A (en) | Cross-platform microphone connecting method and device, storage medium and electronic equipment | |
| JP2023552769A (en) | Order payment methods, equipment, storage media, devices and systems | |
| CN100446602C (en) | Method for transmitting cell-phone button information | |
| US9143726B2 (en) | Video media server for realizing video intercommunication gateway function and video intercommunication method | |
| US20070280215A1 (en) | Method and apparatus for providing a click-to-talk service for advertisements | |
| KR100938346B1 (en) | Iptv client system of providing internet phone and method thereof | |
| Van Wijk et al. | Framework for real-time text over IP using the session initiation protocol (SIP) | |
| CN109151559B (en) | Multi-party conversation method and household internet protocol shutdown set top box all-in-one machine | |
| US8799976B1 (en) | Method and apparatus for providing a web session with a commercial advertiser | |
| CN107786832A (en) | The method and terminal of video playback control and method and server that video is provided | |
| EP1395055B1 (en) | Method for providing access to video data and voice data of a video telephony call |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |