CN113630512A - Rich media call mobile terminal system and use method thereof - Google Patents

Rich media call mobile terminal system and use method thereof Download PDF

Info

Publication number
CN113630512A
CN113630512A CN202110890072.8A CN202110890072A CN113630512A CN 113630512 A CN113630512 A CN 113630512A CN 202110890072 A CN202110890072 A CN 202110890072A CN 113630512 A CN113630512 A CN 113630512A
Authority
CN
China
Prior art keywords
module
data
media
interface
audio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110890072.8A
Other languages
Chinese (zh)
Other versions
CN113630512B (en
Inventor
周方斌
周波
杨小燕
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Juphoon Corp
Original Assignee
Juphoon Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Juphoon Corp filed Critical Juphoon Corp
Priority to CN202110890072.8A priority Critical patent/CN113630512B/en
Publication of CN113630512A publication Critical patent/CN113630512A/en
Application granted granted Critical
Publication of CN113630512B publication Critical patent/CN113630512B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M7/00Arrangements for interconnection between switching centres
    • H04M7/006Networks other than PSTN/ISDN providing telephone service, e.g. Voice over Internet Protocol (VoIP), including next generation networks with a packet-switched transport layer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/10Architectures or entities
    • H04L65/1046Call controllers; Call servers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1101Session protocols
    • H04L65/1104Session initiation protocol [SIP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M7/00Arrangements for interconnection between switching centres
    • H04M7/006Networks other than PSTN/ISDN providing telephone service, e.g. Voice over Internet Protocol (VoIP), including next generation networks with a packet-switched transport layer
    • H04M7/0072Speech codec negotiation

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Human Computer Interaction (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The invention relates to a rich media call mobile terminal system and a using method thereof, which is characterized by comprising an audio and video call module, a media engine module, a safe media channel module, a service processing module, an interface packaging module and an interface module; the audio and video call module, the media engine module and the secure media channel module are connected with a VoLTE core network of an operator; the safe media channel module is used for establishing a safe media channel with a VoLTE core network of an operator, and is responsible for sending and receiving safe media data and forwarding the safe media data to the service processing module; the service processing module encodes and decodes the secure media data and forwards the secure media data to the interface packaging module; the interface packaging module converts the secure media data and forwards the secure media data to the interface module; and the interface module analyzes the safe media data and displays the safe media data. Compared with the prior art, the invention provides various rich media interactive contents for the mobile terminal and simultaneously ensures the transmission safety of rich media data.

Description

Rich media call mobile terminal system and use method thereof
Technical Field
The invention relates to a rich media communication mobile terminal system and a using method thereof.
Background
The services of the conventional mobile phone are mainly classified into three types, the first type is a basic audio/Video call service, the second type is a supplementary service, such as a call transfer service, and the third type is a multimedia service, such as a ringing service before a call, a DTMF (dual-tone multi-frequency, chinese) service during a call, an IVR (Interactive Voice Response, chinese) and an IVVR (Interactive Voice and Video Response, chinese) service. DTMF is a dial-up key service, IVR is an interactive response voice service, and IVVR is an interactive response video service.
Based on IVR and IVVR services, a user can operate some simple answering video services such as Web-on-demand, video monitoring, video games, enterprise video applications, etc. during a call, but cannot perform some more complicated service functions of B2C (Business to customer, chinese is enterprise to Consumer) such as questionnaire survey, intelligent customer service, etc. during the call, these more complicated services need to be completed by the user through Web pages or controls. At present, a mature scheme is that a Web page link is issued in a short message mode, so that a user can open the Web page link of a short message simultaneously in a call process, and the external link mode has the problems that firstly, certain potential safety hazards exist in data transmission, data transmission under an unsafe Internet network can be intercepted or stolen by a third party, and secondly, user experience is very unfriendly, and the user needs to actively find the corresponding short message link and then open the short message link.
Based on the above problems, if rich media call can be realized on the call mobile terminal, and meanwhile, the security of data transmission can be ensured, so that the service experience of the user can be well ensured, and meanwhile, the fast innovation and online of new services can be supported, and the competitiveness of OTT application with the mobile internet is improved. Rich Media, i.e., the english translation of Rich Media, is not a specific form of internet Media by itself, but refers to a method of information dissemination with animation, sound, video or interactivity. The rich media comprises streaming media, voice, Flash, and one or more of the forms of Java, Javascript, DHTML and other programming languages.
Disclosure of Invention
The invention aims to solve the primary technical problem of providing a mobile terminal system which can realize various rich media interactive contents and can ensure the safety of data transmission simultaneously aiming at the prior art.
A further technical problem to be solved by the present invention is to provide a method for using a mobile terminal system, which can implement various rich media interactive contents and ensure the security of data transmission.
The technical scheme adopted by the invention for solving the above-mentioned primary technical problems is as follows: a rich media call mobile terminal system is characterized by comprising an audio and video call module, a media engine module, a secure media channel module, a service processing module, an interface packaging module and an interface module; the audio and video call module, the media engine module and the secure media channel module are connected with a VoLTE core network of an operator;
the audio and video call module is used for establishing audio and video calls with a VoLTE core network of an operator, and can simultaneously call the media engine module to establish an audio and video channel and also call the secure media channel module to establish a secure media channel;
the media engine module is used for establishing an audio and video channel with a VoLTE core network of an operator and is responsible for encoding and decoding audio and video media data and receiving and transmitting the audio and video media data;
the safe media channel module is used for establishing a safe media channel with a VoLTE core network of an operator, is responsible for sending and receiving safe media data and forwarding the received safe media data to the service processing module;
the service processing module is used for being butted with the secure media channel module, coding and decoding the secure media data received by the secure media channel module to obtain first intermediate secure media data, and forwarding the first intermediate secure media data to the interface packaging module;
the interface packaging module is used for being in butt joint with the service processing module, converting the first intermediate secure media data sent by the service processing module to obtain second intermediate secure media data which can be analyzed by the interface module, and forwarding the second intermediate secure media data to the interface module;
the interface module can be in butt joint with the interface packaging module, can analyze the second intermediate secure media data sent by the interface packaging module, and displays the secure media data after the second intermediate secure media data is analyzed.
The audio and video call module and the VoLTE core network of the operator establish audio and video calls through an SIP protocol and an SDP protocol, and meanwhile, first SIP signaling data used for maintaining and controlling the state of the whole audio and video calls, second SIP signaling data used for negotiating audio and video media parameters and third SIP signaling data used for negotiating security media channel parameters can be interactively butted.
The second SIP signaling data comprises a media port, an encoding and decoding type and a packing time length; the third SIP signaling data includes a media port, a stream ID, a service protocol, and a service type.
The media engine module and the VoLTE core network of the operator can interactively butt joint audio and video media data in an RTP format, and are used for taking charge of the coding and decoding functions of the audio and video media data, ensuring the quality of the audio and video media and managing the input and output functions of audio equipment and video equipment.
The secure media channel module and the VoLTE core network of the operator can interact SCTP media data; the secure media channel module firstly establishes a secure media channel between the secure media channel module and a VoLTE core network of an operator, wherein the secure media channel comprises a DTLS handshake process and a SCTP handshake process; and then encrypting or decrypting the SCTP media data, simultaneously encoding or decoding the SCTP media data, decoding the received SCTP media data by the secure media channel module to obtain HTTP message data with HTML stream, and forwarding the HTTP message data with HTML stream to the service module processing module as secure media data.
The service processing module is in butt joint with the secure media channel to acquire HTTP message data with HTML streams, decode or decode the HTTP message data with the HTML streams to acquire the HTML streams, and the HTML streams are used as first intermediate secure media data to be sent to the interface packaging module.
The interface packaging module is in butt joint with the service processing module to obtain HTML stream, then the HTML stream data is converted into Javascript interface data from C interface data, and the Javascript interface data is transmitted to the interface module as second intermediate secure media data; the interface module is connected with the interface packaging module in a butt joint mode, HTML stream data are obtained through Javascript interface data and input into the WebView component, and an interactive interface is provided for a user to do business operation.
The technical scheme adopted by the invention for solving the further technical problems is as follows: a use method of the rich media call mobile terminal system with the structure is characterized by comprising the following steps:
step 1, a rich media call mobile terminal user clicks a call button through an interface module to initiate an audio and video call to a called party;
step 2, an audio and video call module of the rich media call mobile terminal establishes a call with a VoLTE core network of an operator by utilizing an SIP protocol, carries audio and video media parameters and security channel media parameters by utilizing an SDP protocol, successfully negotiates the media parameters with the VoLTE core network of the operator and establishes an audio and video call;
step 3, a media engine module of the rich media call mobile terminal and an operator VoLTE core network establish an audio and video channel, acquire audio and video streams of a microphone and a camera of a home terminal, encode and pack the audio and video streams and then send the audio and video streams out, and receive, decode and play an audio and video data stream sent by a called party;
step 4, a secure media channel module of the rich media call mobile terminal establishes an SCTP secure media channel by utilizing an SCTP protocol, a DTLS protocol and an operator VoLTE core network, decrypts the received HTTP message data with the HTML stream and transmits the HTTP message data as secure media data to a service processing module;
step 5, a service processing module of the rich media call mobile terminal replies response to the received HTTP message data with the HTML stream, then decodes or decodes the HTTP message data with the HTML stream, extracts the HTML stream, and sends the HTML stream to an interface packaging module as first intermediate secure media data;
step 6, the interface packaging module of the rich media communication mobile terminal packages the received HTML stream into Jav through JNI technology by the C interfaceaThe interface is packaged into Javascript interface data through JSbridge technology, and the Javascript interface data is used as second intermediate secure media data and transmitted to the WebView component of the interface module;
step 7, a user of the rich media call mobile terminal operates the service on the WebView component of the interface module, and transmits the operation data of the user to the service processing module through the interface packaging module;
step 8, a service processing module of the rich media call mobile terminal sends operation data of a user to a secure media channel module, the secure media channel module sends the operation data of the user to a VoLTE core network of an operator through an SCTP secure media channel, receives an HTTP response result of the VoLTE core network of the operator, transmits the HTTP response result to the service processing module, and transmits the HTTP response result to an interface packaging module through the service processing module;
step 9, the interface packaging module of the rich media communication mobile terminal converts the received HTTP response result from the C interface data through JNI technologyJavaAnd the interface data is packaged into Javascript interface data through JSbridge technology and transmitted to the WebView component of the interface module for display.
Compared with the prior art, the invention has the advantages that: the secure media channel and the interface module are communicated and integrated in the mobile terminal, so that various rich media interactive contents are provided for the mobile terminal, and meanwhile, the transmission security of rich media data is also ensured.
Drawings
Fig. 1 is a functional block diagram of a rich media call mobile terminal system according to an embodiment of the present invention.
Fig. 2 is a flowchart of a method for using the rich media call mobile terminal system according to an embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the accompanying examples.
The rich media call mobile terminal system shown in fig. 1 is characterized by comprising an audio and video call module 1, a media engine module 2, a secure media channel module 3, a service processing module 4, an interface encapsulation module 5 and an interface module 6; the audio and video call module 1, the media engine module 2 and the secure media channel module 3 are connected with a VoLTE core network of an operator;
the audio and video call module 1 and the VoLTE core network of the operator establish audio and video calls through an SIP protocol and an SDP protocol, and meanwhile, first SIP signaling data used for maintaining and controlling the state of the whole audio and video calls, second SIP signaling data used for negotiating audio and video media parameters and third SIP signaling data used for negotiating safe media channel parameters can be interactively butted; the second SIP signaling data comprises a media port, an encoding and decoding type and a packing time length; the third SIP signaling data comprises a media port, a stream ID, a service protocol and a service type; the audio and video call module 1 can also call a media engine module to establish an audio and video channel at the same time, and can also call a secure media channel module to establish a secure media channel at the same time;
the media engine module 2 is used for establishing an audio/video channel with a VoLTE core network of an operator and is responsible for encoding and decoding audio/video media data and transceiving the audio/video media data; the audio and video media data interactively butted by the media engine module 2 and the VoLTE core network of the operator are in an RTP format, and the media engine module 2 is not only responsible for the coding and decoding functions of the audio and video media data in the RTP format to ensure the quality of the audio and video media, but also needs to manage the input and output functions of audio equipment and video equipment;
the safe media channel module 3 can interact SCTP media data with the VoLTE core network of the operator; the secure media channel module 3 firstly establishes a secure media channel with the VoLTE core network of an operator, wherein the secure media channel comprises a DTLS handshake process and a SCTP handshake process; then encrypting or decrypting the SCTP media data, simultaneously encoding or decoding the SCTP media data, decoding the received SCTP media data by the secure media channel module to obtain HTTP message data with HTML stream, and forwarding the HTTP message data with HTML stream to the service module processing module 4 as secure media data;
the service processing module 4 is used for interfacing with the secure media channel module 3, and encoding and decoding the secure media data received by the secure media channel module, that is, the service processing module 4 acquires HTTP message data with HTML stream, decodes or decodes the HTTP message data with HTML stream to obtain HTML stream, and sends the HTML stream as first intermediate secure media data to the interface encapsulation module 5;
the interface packaging module 5 is used for being connected with the service processing module 4 in a butt joint mode to obtain HTML streams, converting the HTML stream data from C interface data into Javascript interface data, and transmitting the Javascript interface data serving as second intermediate secure media data to the interface module 6;
the interface module 6 can be in butt joint with the interface packaging module 5, and can analyze Javascript interface data sent by the interface packaging module 5, analyze the Javascript interface data to obtain HTML stream data, input the HTML stream data into the WebView component and provide an interactive interface for a user to do business operation.
The method for using the rich media call mobile terminal system comprises the following steps, which are shown in reference to fig. 2:
step 1, a rich media call mobile terminal user clicks a call button through an interface module 6 to initiate an audio and video call to a called party;
step 2, an audio and video call module 1 of the rich media call mobile terminal establishes a call with a VoLTE core network of an operator by utilizing an SIP protocol, carries audio and video media parameters and security channel media parameters by utilizing an SDP protocol, successfully negotiates the media parameters with the VoLTE core network of the operator and establishes an audio and video call;
step 3, a media engine module 2 of the rich media call mobile terminal and an operator VoLTE core network establish an audio and video channel, acquire audio and video streams of a microphone and a camera of a home terminal, encode and pack the audio and video streams, transmit the audio and video streams in an RTP data packet mode, and receive, decode and play audio and video data streams, namely RTP data streams, transmitted by a called party;
step 4, the secure media channel module 3 of the rich media call mobile terminal establishes an SCTP secure media channel by utilizing an SCTP protocol, a DTLS protocol and an operator VoLTE core network, decrypts the received HTTP message data with the HTML stream and transmits the HTTP message data as secure media data to the service processing module 4;
step 5, the service processing module 4 of the rich media call mobile terminal replies response to the received HTTP message data with the HTML stream, then decodes or decodes the HTTP message data with the HTML stream, extracts the HTML stream, and sends the HTML stream to the interface packaging module 5 as first intermediate secure media data;
step 6, an interface packaging module 5 of the rich media communication mobile terminal packages the received HTML stream into Javat interface data through JNI technology from C interface data, packages the Javascript interface data through JSbridge technology, and transmits the Javascript interface data to a WebView component of the interface module 6 as second intermediate secure media data;
7, operating the service on the WebView component of the interface module 6 by a user of the rich media call mobile terminal, and transmitting the operation data of the user to the service processing module 4 through the interface packaging module 5;
step 8, the service processing module 4 of the rich media call mobile terminal sends the operation data of the user to the secure media channel module 3, the secure media channel module 3 sends the operation data of the user to the VoLTE core network of the operator through the SCTP secure media channel, receives the HTTP response result of the VoLTE core network of the operator, then transmits the HTTP response result to the service processing module 4, and transmits the HTTP response result to the interface packaging module 5 through the service processing module 4;
and 9, converting the received HTTP response result into Java interface data by the interface packaging module 5 of the rich media call mobile terminal, packaging the Java interface data into Javascript interface data by the JSbridge technology, and transmitting the Javascript interface data to the WebView component of the interface module 6 for display.
The rich media new call mobile terminal system establishes a session through the audio and video module, establishes a secure media channel through the secure media channel module, transmits different rich media data (such as RTP data, MSRP data, HTTP data and the like) in the secure media channel, presents rich media content through the WebView component of the interface module 6 and interacts with a user.
The following description will be given by taking dialing 10086 as a specific application scenario, and illustrates a method for using the rich media call mobile terminal system:
step 1, a user opens a dialing application in the rich media communication mobile terminal, and clicks and dials after inputting 0757-10086 numbers on a display interface of the dialing application;
step 2, an audio and video call module of the rich media call mobile terminal establishes a call with 10086 by using an SIP protocol, a media engine module of the rich media call mobile terminal establishes an audio and video channel with 10086, a user successfully establishes a call with 10086, the rich media call mobile terminal collects audio and video streams of a microphone and a camera of the terminal, encodes and packages the audio and video streams, sends the audio and video streams out, and receives, decodes and plays an audio and video data stream sent by 10086;
step 3, a secure media channel module of the rich media call mobile terminal establishes an SCTP secure media channel by utilizing an SCTP protocol, a DTLS protocol and 10086, and triggers a personal broadband service after a user inputs 10;
step 4, popping up WebView on a display interface of the dialing application of the rich media call mobile terminal, decrypting received HTTP message data with HTML streams by a secure media channel module of the rich media call mobile terminal, transmitting the decrypted HTTP message data with HTML streams to a service processing module as secure media data, responding the received HTTP message data with HTML streams by the service processing module, decoding the HTTP message data with HTML streams, extracting the HTML streams to obtain HTML streams, transmitting the HTML streams to an interface packaging module, packaging the received HTML streams into Java interface data from C interface data through JNI technology by the interface packaging module, packaging the Java interface data into Javascript interface data through JSbridge technology, and transmitting the Javascript interface data to a WebView component of the interface module for display; at the moment, the user jumps to a broadband handling page after the local number of the user automatically logs in, prompts the user to input an address where the broadband is expected to be installed, can input text, can position and select a local address, and can open a navigation map for custom selection;
and 5, after the user inputs the address, clicking to submit, prompting that the broadband installation will be submitted successfully, and enabling the user to select to hang up the phone.
According to the process, a user does not need to receive and open an external link through a short message, potential safety hazards do not exist, and the use is more convenient and faster.

Claims (9)

1. A rich media call mobile terminal system is characterized by comprising an audio and video call module, a media engine module, a secure media channel module, a service processing module, an interface packaging module and an interface module; the audio and video call module, the media engine module and the secure media channel module are connected with a VoLTE core network of an operator;
the audio and video call module is used for establishing audio and video calls with a VoLTE core network of an operator, and can simultaneously call the media engine module to establish an audio and video channel and also call the secure media channel module to establish a secure media channel;
the media engine module is used for establishing an audio and video channel with a VoLTE core network of an operator and is responsible for encoding and decoding audio and video media data and receiving and transmitting the audio and video media data;
the safe media channel module is used for establishing a safe media channel with a VoLTE core network of an operator, is responsible for sending and receiving safe media data and forwarding the received safe media data to the service processing module;
the service processing module is used for being butted with the secure media channel module, coding and decoding the secure media data received by the secure media channel module to obtain first intermediate secure media data, and forwarding the first intermediate secure media data to the interface packaging module;
the interface packaging module is used for being in butt joint with the service processing module, converting the first intermediate secure media data sent by the service processing module to obtain second intermediate secure media data which can be analyzed by the interface module, and forwarding the second intermediate secure media data to the interface module;
the interface module can be in butt joint with the interface packaging module, can analyze the second intermediate secure media data sent by the interface packaging module, and displays the secure media data after the second intermediate secure media data is analyzed.
2. The rich media call mobile terminal system according to claim 1, wherein: the audio and video call module and the VoLTE core network of the operator establish audio and video calls through an SIP protocol and an SDP protocol, and meanwhile, first SIP signaling data used for maintaining and controlling the state of the whole audio and video calls, second SIP signaling data used for negotiating audio and video media parameters and third SIP signaling data used for negotiating security media channel parameters can be interactively butted.
3. The rich media call mobile terminal system according to claim 2, wherein: the second SIP signaling data comprises a media port, an encoding and decoding type and a packing time length; the third SIP signaling data includes a media port, a stream ID, a service protocol, and a service type.
4. The rich media call mobile terminal system according to claim 1, wherein: the media engine module and the VoLTE core network of the operator can interactively butt joint audio and video media data in an RTP format, are responsible for the coding and decoding functions of the audio and video media data, ensure the quality of the audio and video media, and manage the input and output functions of audio equipment and video equipment.
5. The rich media call mobile terminal system according to claim 1, wherein: the secure media channel module and the VoLTE core network of the operator can interact SCTP media data; the secure media channel module firstly establishes a secure media channel between the secure media channel module and a VoLTE core network of an operator, wherein the secure media channel comprises a DTLS handshake process and a SCTP handshake process; and then encrypting or decrypting the SCTP media data, simultaneously encoding or decoding the SCTP media data, decoding the received SCTP media data by the secure media channel module to obtain HTTP message data with HTML stream, and forwarding the HTTP message data with HTML stream to the service module processing module as secure media data.
6. The rich media call mobile terminal system according to claim 5, wherein: the service processing module is in butt joint with the secure media channel to acquire HTTP message data with HTML streams, decode or decode the HTTP message data with the HTML streams to acquire the HTML streams, and the HTML streams are used as first intermediate secure media data to be sent to the interface packaging module.
7. The rich media call mobile terminal system according to claim 6, wherein: the interface packaging module is in butt joint with the service processing module to obtain HTML stream, then the HTML stream data is converted into Javascript interface data from C interface data, and the Javascript interface data is transmitted to the interface module as second intermediate secure media data; the interface module is connected with the interface packaging module in a butt joint mode, HTML stream data are obtained through Javascript interface data and input into the WebView component, and an interactive interface is provided for a user to do business operation.
8. The rich media call mobile terminal system according to claim 1, wherein: the secure media data comprises one or any combination of the following: RTP data, MSRP data, HTTP data.
9. A method for using the rich media call mobile terminal system according to claim 1, comprising the steps of:
step 1, a rich media call mobile terminal user clicks a call button through an interface module to initiate an audio and video call to a called party;
step 2, an audio and video call module of the rich media call mobile terminal establishes a call with a VoLTE core network of an operator by utilizing an SIP protocol, carries audio and video media parameters and security channel media parameters by utilizing an SDP protocol, successfully negotiates the media parameters with the VoLTE core network of the operator and establishes an audio and video call;
step 3, a media engine module of the rich media call mobile terminal and an operator VoLTE core network establish an audio and video channel, acquire audio and video streams of a microphone and a camera of a home terminal, encode and pack the audio and video streams and then send the audio and video streams out, and receive, decode and play an audio and video data stream sent by a called party;
step 4, a secure media channel module of the rich media call mobile terminal establishes an SCTP secure media channel by utilizing an SCTP protocol, a DTLS protocol and an operator VoLTE core network, decrypts the received HTTP message data with the HTML stream and transmits the HTTP message data as secure media data to a service processing module;
step 5, a service processing module of the rich media call mobile terminal replies response to the received HTTP message data with the HTML stream, then decodes or decodes the HTTP message data with the HTML stream, extracts the HTML stream, and sends the HTML stream to an interface packaging module as first intermediate secure media data;
step 6, an interface packaging module of the rich media communication mobile terminal packages the received HTML stream into Java interface data through JNI technology from C interface data, packages the Java interface data into Javascript interface data through JSbridge technology, and transmits the Javascript interface data to a WebView component of the interface module as second intermediate secure media data;
step 7, a user of the rich media call mobile terminal operates the service on the WebView component of the interface module, and transmits the operation data of the user to the service processing module through the interface packaging module;
step 8, a service processing module of the rich media call mobile terminal sends operation data of a user to a secure media channel module, the secure media channel module sends the operation data of the user to a VoLTE core network of an operator through an SCTP secure media channel, receives an HTTP response result of the VoLTE core network of the operator, transmits the HTTP response result to the service processing module, and transmits the HTTP response result to an interface packaging module through the service processing module;
and 9, converting the received HTTP response result into Java interface data by an interface packaging module of the rich media call mobile terminal from a C interface, packaging the Java interface data into Javascript interface data by a JSbridge technology, and transmitting the Javascript interface data to a WebView component of the interface module for display.
CN202110890072.8A 2021-08-04 2021-08-04 Rich media call mobile terminal system and application method thereof Active CN113630512B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110890072.8A CN113630512B (en) 2021-08-04 2021-08-04 Rich media call mobile terminal system and application method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110890072.8A CN113630512B (en) 2021-08-04 2021-08-04 Rich media call mobile terminal system and application method thereof

Publications (2)

Publication Number Publication Date
CN113630512A true CN113630512A (en) 2021-11-09
CN113630512B CN113630512B (en) 2023-10-13

Family

ID=78382527

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110890072.8A Active CN113630512B (en) 2021-08-04 2021-08-04 Rich media call mobile terminal system and application method thereof

Country Status (1)

Country Link
CN (1) CN113630512B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114285816A (en) * 2021-12-30 2022-04-05 中国电信股份有限公司 Method and system for calling instant message interaction in voice call process
CN116847128A (en) * 2023-09-04 2023-10-03 中科融信科技有限公司 Video superposition processing method based on 5G VoLTE video teleconference

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070266170A1 (en) * 2006-05-11 2007-11-15 Mockett Gregory P Interactive, rich-media delivery over an ip network using synchronized unicast and multicast
CN101453477A (en) * 2007-12-07 2009-06-10 华为技术有限公司 Method and apparatus for media content uploading in real-time
US20090234876A1 (en) * 2008-03-14 2009-09-17 Timothy Schigel Systems and methods for content sharing
US20130254353A1 (en) * 2010-12-14 2013-09-26 Zte Corporation Method, System and Apparatus for Providing Streaming Media Service
US20140129650A1 (en) * 2012-11-05 2014-05-08 Brilliant Mobile, L.L.C. Media messaging methods, systems, and devices
US9408067B1 (en) * 2013-12-02 2016-08-02 Taqua, Llc Selectively disallowing use of media over data calling in a segment based on segment characteristics
WO2017045407A1 (en) * 2015-09-17 2017-03-23 中兴通讯股份有限公司 Method of implementing end-to-end conversation encryption, terminal and network element of network side
CN110336842A (en) * 2014-01-20 2019-10-15 三星电子株式会社 Use the communication device of multimedia service, method and system
CN110351445A (en) * 2019-06-19 2019-10-18 成都康胜思科技有限公司 A kind of high concurrent VOIP recording service system based on intelligent sound identification
CN113114860A (en) * 2021-04-02 2021-07-13 宁波菊风系统软件有限公司 Web-based audio and video response system and use method thereof

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070266170A1 (en) * 2006-05-11 2007-11-15 Mockett Gregory P Interactive, rich-media delivery over an ip network using synchronized unicast and multicast
CN101453477A (en) * 2007-12-07 2009-06-10 华为技术有限公司 Method and apparatus for media content uploading in real-time
US20090234876A1 (en) * 2008-03-14 2009-09-17 Timothy Schigel Systems and methods for content sharing
US20130254353A1 (en) * 2010-12-14 2013-09-26 Zte Corporation Method, System and Apparatus for Providing Streaming Media Service
US20140129650A1 (en) * 2012-11-05 2014-05-08 Brilliant Mobile, L.L.C. Media messaging methods, systems, and devices
US9408067B1 (en) * 2013-12-02 2016-08-02 Taqua, Llc Selectively disallowing use of media over data calling in a segment based on segment characteristics
CN110336842A (en) * 2014-01-20 2019-10-15 三星电子株式会社 Use the communication device of multimedia service, method and system
WO2017045407A1 (en) * 2015-09-17 2017-03-23 中兴通讯股份有限公司 Method of implementing end-to-end conversation encryption, terminal and network element of network side
CN110351445A (en) * 2019-06-19 2019-10-18 成都康胜思科技有限公司 A kind of high concurrent VOIP recording service system based on intelligent sound identification
CN113114860A (en) * 2021-04-02 2021-07-13 宁波菊风系统软件有限公司 Web-based audio and video response system and use method thereof

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
曹懿军;洪亮;: "富媒体通信的部署实践", 电信技术, no. 04, pages 59 - 61 *
陈桦;杜启宏;程刚;: "移动智能终端Web应用平台开发技术研究", 移动通信, no. 05, pages 25 - 28 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114285816A (en) * 2021-12-30 2022-04-05 中国电信股份有限公司 Method and system for calling instant message interaction in voice call process
CN114285816B (en) * 2021-12-30 2024-02-06 中国电信股份有限公司 Method and system for calling instant message interaction in voice call process
CN116847128A (en) * 2023-09-04 2023-10-03 中科融信科技有限公司 Video superposition processing method based on 5G VoLTE video teleconference
CN116847128B (en) * 2023-09-04 2023-11-28 中科融信科技有限公司 Video superposition processing method based on 5G VoLTE video teleconference

Also Published As

Publication number Publication date
CN113630512B (en) 2023-10-13

Similar Documents

Publication Publication Date Title
US8666046B2 (en) System and method for providing enhanced telephone call functions associated with caller and/or callee information during telephony ringing signal
CN106850399B (en) Communication method based on WebRTC technology instant message
US20050277406A1 (en) System and method for electronic message notification
CN113630512B (en) Rich media call mobile terminal system and application method thereof
EP4262320A1 (en) Call processing system and call processing method
EP1890457A1 (en) Accessing interactive services over internet
WO2009082301A1 (en) A method and an apparatus for handling multimedia calls
US20120017249A1 (en) Delivery system, delivery method, conversion apparatus, and program
US8130691B2 (en) Relay apparatus, communication terminal, and communication method
KR101302880B1 (en) Method and mobile terminal for sharing mobile phone television program
US9100412B2 (en) Method and apparatus for transmitting media resources
CN102045535B (en) Device, system and method for user to select customer service representative by video
JP2023552769A (en) Order payment methods, equipment, storage media, devices and systems
CN100446602C (en) Method for transmitting cell-phone button information
CN112714131A (en) Cross-platform microphone connecting method and device, storage medium and electronic equipment
US9143726B2 (en) Video media server for realizing video intercommunication gateway function and video intercommunication method
KR100938346B1 (en) Iptv client system of providing internet phone and method thereof
Van Wijk et al. Framework for real-time text over IP using the session initiation protocol (SIP)
KR100887152B1 (en) System for pushing image message and method the same
KR101094631B1 (en) Video banking service system and its method
EP1395055B1 (en) Method for providing access to video data and voice data of a video telephony call
KR100330140B1 (en) Internet phone system
CN104333437A (en) Communication equipment and communication method for maritime affair or outdoor area
KR101108590B1 (en) Gateway, Gatekeeper and Server Located in VoIP Network and Recording Medium
KR101162195B1 (en) System and Method for Providing Information by Using Gateway, Gatekeeper and Server Located in VoIP Network and Recording Medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant