WO2019165960A1 - Procédé de commande de transmission en temps réel de données multimédias, système et support d'informations - Google Patents

Procédé de commande de transmission en temps réel de données multimédias, système et support d'informations Download PDF

Info

Publication number
WO2019165960A1
WO2019165960A1 PCT/CN2019/076206 CN2019076206W WO2019165960A1 WO 2019165960 A1 WO2019165960 A1 WO 2019165960A1 CN 2019076206 W CN2019076206 W CN 2019076206W WO 2019165960 A1 WO2019165960 A1 WO 2019165960A1
Authority
WO
WIPO (PCT)
Prior art keywords
call
receiving end
media data
rtp packet
video
Prior art date
Application number
PCT/CN2019/076206
Other languages
English (en)
Chinese (zh)
Inventor
冯德政
Original Assignee
惠州Tcl移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 惠州Tcl移动通信有限公司 filed Critical 惠州Tcl移动通信有限公司
Publication of WO2019165960A1 publication Critical patent/WO2019165960A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16—Vocoder architecture
    • G10L19/167—Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/10—Architectures or entities
    • H04L65/1016—IP multimedia subsystem [IMS]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1069—Session establishment or de-establishment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/70—Media network packetisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone

Definitions

  • the present invention relates to the field of data transmission technologies, and in particular, to a media data real-time transmission control method, system, and storage medium.
  • VoLTE voice over HD
  • ViLTE IMS-based video services
  • Music is an art that reflects the emotions of human real life. It is an art form that expresses people's thoughts and feelings and social real life. It is also one of the most artistic forms that can impress people instantly. Music in life is everywhere, school students use music classes to ease the pressure of students' learning; use music to create a relaxed working environment at work; use music to cultivate their own sentiments in leisure; use in the busy life rhythm Music to relax and improve your spirit. Pictures and videos are very important in human abnormal life. Pictures and videos can record the characteristics of a certain period of time. Pictures and videos can record beautiful scenery somewhere. Pictures and videos can record the wonderful moments in life. As a kind of multimedia data in human life, pictures and videos can intuitively show a picture, which is widely used in human daily life. As the Internet becomes more developed, the transmission of pictures and videos over the Internet is also increasing.
  • Embodiments of the present invention provide a media data real-time transmission control method, system, and storage medium, which can be based on VoLTE (High Definition Voice Call) and ViLTE (High Definition Video Call) protocols and RTP real-time transmission protocols, through VoLTE or When ViLTE is established, in one or more parties, one party can play music to achieve the purpose of sharing music; or transfer pictures and videos to achieve the purpose of sharing pictures or videos online and conveniently, enhance call function and improve call performance.
  • VoLTE High Definition Voice Call
  • ViLTE High Definition Video Call
  • an embodiment of the present invention provides a media data real-time transmission control method, where the media data real-time transmission control method includes:
  • the call originating end and the call receiving end establish a call by using a preset call protocol, and start a real-time transmission channel of the media data based on the RTP protocol;
  • the call originating end When the call originating end selects to send the media data to the call receiving end, the call originating end packs the media data into an RTP packet and sends the data to the call receiving end;
  • the call receiving end After receiving the RTP packet sent by the call originating end, the call receiving end parses and processes the RTP packet, and outputs and displays the media data sent by the call originating end.
  • the media data real-time transmission control method wherein the preset call protocol comprises: a VoLTE protocol and a ViLTE protocol.
  • the media data real-time transmission control method wherein the call originating end and the call receiving end establish a call by using a preset call protocol, and the step of enabling the media data real-time transmission channel based on the RTP protocol, specifically includes:
  • the call originating end and the call receiving end establish a high-definition voice call through the VoLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol.
  • Data real-time transmission channel ;
  • the call originating end and the call receiving end establish a high-definition video call through the VoLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol.
  • Data real-time transmission channel When the preset call protocol is selected as the ViLTE protocol, the call originating end and the call receiving end establish a high-definition video call through the VoLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol.
  • Data real-time transmission channel When the preset call protocol is selected as the ViLTE protocol, the call originating end and the call receiving end establish a high-definition video call through the VoLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol. Data real-time transmission channel.
  • the media data real-time transmission control method wherein, when the call originating end selects to send the media data to the call receiving end, the step of the call originating end packaging the media data into the RTP packet and sending the data to the call receiving end includes:
  • the call originating end and the call receiving end After the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call, when the call originating end selects to share music to the call receiving end, the call originating end selects a song and then performs play music;
  • the call originating end packs the audio media data into a voice RTP packet, and sends the voice RTP packet to the call receiving end in real time.
  • the media data real-time transmission control method wherein, when the call originating end selects to send the media data to the call receiving end, the step of the call originating end packaging the media data into the RTP packet and sending the data to the call receiving end includes:
  • the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call
  • the call originating end selects to share the picture or video to the call receiving end
  • the call originating end adds a picture or Compress and encode after the video
  • the call originating end packs the picture or video media data into a speech video RTP packet, and sends the video RTP packet to the call receiving end in real time.
  • the media data real-time transmission control method wherein, after the call receiving end receives the RTP packet sent by the call originating end, the call receiving end parses and processes the RTP packet, and outputs and displays the media data sent by the call originating end.
  • the steps specifically include:
  • the call receiving end receives the voice RTP packet sent by the call originating end, in a state in which the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call.
  • the call receiving end parses the received voice RTP packet, and after the parsing is completed, outputs the music in the voice RTP packet at the call receiving end, and is used to play the song shared by the call originating end online.
  • the media data real-time transmission control method wherein, after the call receiving end receives the RTP packet sent by the call originating end, the call receiving end parses and processes the RTP packet, and outputs and displays the media data sent by the call originating end.
  • the steps specifically include:
  • the call receiving end receives the video RTP packet sent by the call originating end, in a state in which the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call.
  • the call receiving end parses the received video RTP packet, decompresses and decodes the picture or video after the parsing is completed, displays a picture or plays a video at the call receiving end, and is used to display the call online.
  • the image shared by the originating end or the video shared by the call originating end is played online.
  • the media data real-time transmission control method wherein the RTP package comprises: a voice RTP packet, a video RTP packet, and a text RTP packet.
  • the embodiment of the present invention provides a media data real-time transmission control system, where the media data real-time transmission control system includes: a call originating end and a call receiving end;
  • the call originating end and the call receiving end establish a call by using a preset call protocol, and start a media data real-time transmission channel based on the RTP protocol; when the call originating end selects to send media data to the call receiving end, the The call originating end packs the media data into an RTP packet and sends the RTP packet to the call receiving end. After the call receiving end receives the RTP packet sent by the call originating end, the call receiving end parses and processes the RTP packet, and Outputting and displaying media data sent by the call originating end.
  • an embodiment of the present invention provides a storage medium, wherein the storage medium stores a media data real-time transmission control program, and the media data real-time transmission control program is executed by the processor as follows:
  • the call originating end and the call receiving end establish a call by using a preset call protocol, and start a real-time transmission channel of the media data based on the RTP protocol;
  • the call originating end When the call originating end selects to send the media data to the call receiving end, the call originating end packs the media data into an RTP packet and sends the data to the call receiving end, so that when the call receiving end receives the RTP packet sent by the call originating end, the call receiving end The end parses and processes the RTP packet, and outputs and displays the media data sent by the call originating end.
  • the preset call protocol includes: a VoLTE protocol and a ViLTE protocol.
  • the step of the call originating end and the call receiving end establishing a call by using a preset call protocol, and starting the real-time transmission channel of the media data based on the RTP protocol specifically includes:
  • the call originating end and the call receiving end establish a high-definition voice call through the VoLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol.
  • Data real-time transmission channel ;
  • the call originating end and the call receiving end establish a high-definition video call through the ViLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol.
  • Data real-time transmission channel When the preset call protocol is selected as the ViLTE protocol, the call originating end and the call receiving end establish a high-definition video call through the ViLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol.
  • Data real-time transmission channel When the preset call protocol is selected as the ViLTE protocol, the call originating end and the call receiving end establish a high-definition video call through the ViLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol. Data real-time transmission channel.
  • the call originating end and the call receiving end After the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call, when the call originating end selects to share music to the call receiving end, the call originating end selects a song and then performs play music;
  • the call originating end packs the audio media data into a voice RTP packet, and sends the voice RTP packet to the call receiving end in real time, so that the call receiving end receives the received location
  • the voice RTP packet is parsed, and after the parsing is completed, the music in the voice RTP packet is outputted at the call receiving end, and the song shared by the call originating end is played online.
  • the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call
  • the call originating end selects to share the picture or video to the call receiving end
  • the call originating end adds a picture or Compress and encode after the video
  • the call originating end packs the picture or video media data into a video RTP packet, and sends the video RTP packet to the call receiving end in real time, so that the call receiving end Parsing the received video RTP packet, decompressing and decoding the image or video after the parsing is completed, displaying a picture or playing a video on the call receiving end, and displaying the picture shared by the call originating end or The video shared by the call originating party is played online.
  • the RTP package includes: a voice RTP packet, a video RTP packet, and a text RTP packet.
  • the invention discloses a media data real-time transmission control method, system and storage medium, the method comprises: a call originating end and a call receiving end establish a call by using a preset call protocol, and open a real-time transmission channel of the media data based on the RTP protocol; When the call originating end selects to send the media data to the call receiving end, the call originating end packs the media data into an RTP packet and sends it to the call receiving end; when the call receiving end receives the RTP packet sent by the call originating end, the call receiving end parses and Processing the RTP packet, and outputting and displaying the media data sent by the call originating end.
  • the invention is based on VoLTE (High Definition Voice Call) and ViLTE (High Definition Video Call) protocol and RTP real-time transport protocol, through VoLTE or
  • VoLTE High Definition Voice Call
  • ViLTE High Definition Video Call
  • RTP Real-time transport protocol
  • FIG. 1 is a flow chart of a preferred embodiment of a method for controlling real-time transmission of media data provided by the present invention
  • FIG. 2 is a flow chart of sharing music in a preferred embodiment of a media data real-time transmission control method provided by the present invention
  • FIG. 3 is a flow chart of sharing a picture or video in a preferred embodiment of a media data real-time transmission control method provided by the present invention
  • FIG. 4 is a functional block diagram of a preferred embodiment of a media data real-time transmission control system provided by the present invention.
  • FIG. 5 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention.
  • the media data real-time transmission control method provided by the preferred embodiment of the present invention, as shown in FIG. 1 is a media data real-time transmission control method, wherein the media data real-time transmission control method includes the following steps:
  • Step S10 The call originating end and the call receiving end establish a call by using a preset call protocol, and start a real-time transmission channel of the media data based on the RTP protocol.
  • the preset call protocol includes: a VoLTE protocol (High Definition Voice Call Protocol) and a ViLTE protocol (High Definition Video Call Protocol). Both parties of the call pass VoLTE or When ViLTE establishes a call, it is based on the RTP protocol (Real-Time Transport Protocol, which is a network transmission protocol, RTP protocol is commonly used in streaming media systems, with RTSP protocol, video conferencing and push-to-talk system (with H.323 or SIP) makes it the technical foundation of the IP telephony industry. RTP is widely used in streaming media-related communication and entertainment, including telephony, video conferencing, television and network-based push-to-talk services. The originating end and the call receiving end perform media data transmission, and the media data includes voice (music), pictures, video, text, and the like.
  • the step S10 includes:
  • the call originating end and the call receiving end establish a high-definition voice call by using the VoLTE protocol, and start between the call originating end and the call receiving end according to the RTP protocol.
  • Real-time transmission channel of media data
  • the call originating end and the call receiving end establish a high-definition video call through the ViLTE protocol, and start the call between the call originating end and the call receiving end according to the RTP protocol.
  • Real-time transmission channel of media data When the preset call protocol is selected as the ViLTE protocol, the call originating end and the call receiving end establish a high-definition video call through the ViLTE protocol, and start the call between the call originating end and the call receiving end according to the RTP protocol. Real-time transmission channel of media data.
  • Step S20 When the call originating end selects to send media data to the call receiving end, the call originating end packs the media data into an RTP packet and sends the data to the call receiving end.
  • the music sharing mode based on the RTP protocol has its unique characteristics.
  • VoLTE or ViLTE calls only one party needs to play and share. Both parties can enjoy the artistic feeling brought by music in real time, online and at the same time, without affecting the call itself.
  • a music creator creates a song that wants to sing to people in the distance, but the music needs melody. If it is a recorded audio file, there is no effect of “live” singing to you, so the creator can In VoLTE or ViLTE calls, by playing the music melody as background music, and then singing, to achieve instant, online, and at the same time enjoy the emotions I sing for you "live.”
  • the call originating party chooses to share the picture with the call receiving end, for example, two people are talking, and one party wants to shoot the wonderful moment in front of the scene, or something, and then transmits it to the other party, and needs to describe the scene in the photo online. Or things, etc.; or two people are talking, one party wants to share the beautiful scenery of a certain tour, and share it with the other party online. At this time, one piece can be transmitted to the other party, and the content of the picture can be explained at the same time. Restore the scenes of the tourism at the time and share the fun of the other party.
  • the step S20 includes:
  • the call originating end packs the audio media data into a voice RTP packet, and sends the voice RTP packet to the call receiving end in real time.
  • step S20 further includes:
  • the call originating end packs the picture or video media data into a video RTP packet, and sends the video RTP packet to the call receiving end in real time.
  • Step S30 After receiving the RTP packet sent by the call originating end, the call receiving end parses and processes the RTP packet, and outputs and displays the media data sent by the call originating end.
  • the call originating end when the call originating end performs music, picture or video sharing on the call receiving end, when the call receiving end receives the RTP packet (voice RTP packet, video RTP packet or text RTP packet) sent by the call originating end, After that, the call receiving end needs to parse and process the RTP packet accordingly, and after processing, output and display the media data sent by the call originating end, for example, the music that is finally played and shared when the music is shared, and is the final image when the image is shared. Display is the playback of the video when the video is shared.
  • the RTP packet voice RTP packet, video RTP packet or text RTP packet
  • the call receiving end needs to parse and process the RTP packet accordingly, and after processing, output and display the media data sent by the call originating end, for example, the music that is finally played and shared when the music is shared, and is the final image when the image is shared. Display is the playback of the video when the video is shared.
  • the step S30 includes:
  • the call receiving end receives the voice RTP packet sent by the call originating end, in a state in which the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call.
  • the call receiving end parses the received voice RTP packet, and after the parsing is completed, outputting the music in the voice RTP packet at the call receiving end, and playing the online shared song of the call originating end. .
  • step S30 further includes:
  • the call receiving end receives the video RTP packet sent by the call originating end, in a state in which the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call.
  • the call receiving end parses the received video RTP packet, decompresses and decodes the picture or video after the parsing is completed, displays a picture or plays a video at the call receiving end, and displays the online The picture shared by the call originating party or the video shared by the call originating end.
  • the process of sharing music to the call receiving end of the call originating end (the call originating end and the call receiving end have previously established a call connection through the VoLTE protocol or the ViLTE protocol):
  • the call originating end packs the audio media data into a voice RTP packet, and sends the voice RTP packet to the call receiving end in real time;
  • the call receiving end receives the voice RTP packet sent by the call originating end.
  • the call receiving end parses the received voice RTP packet.
  • the process of performing picture or video sharing to the call receiving end of the call originating end (the call originating end and the call receiving end have previously established a call connection through the VoLTE protocol or the ViLTE protocol):
  • the call originating end packs the picture or video media data into a video RTP packet, and sends the data to the call receiving end in real time;
  • the call receiving end receives the video RTP packet sent by the call originating end.
  • the call receiving end parses the received video RTP packet.
  • S207 Display a picture or play a video on the call receiving end, that is, display the picture shared by the call originating end or play the video shared by the call originating end online.
  • the two parties When the two parties establish a call through VoLTE or ViLTE, start RTP to transmit media data in real time.
  • the RTP package When playing music, the RTP package is packaged and transmitted to the other party's mobile phone through the RTP packet.
  • the picture When the picture is sent, the picture is compressed into a video stream.
  • the RTP packet is transmitted to the other party's mobile phone and other devices; VoLTE or ViLTE
  • a dedicated bearer and port are created for the RTP, and the multimedia stream (RTP stream) is transmitted in real time, and the multimedia data is encapsulated into an RTP packet for transmission, such as a voice RTP packet, a video RTP packet, a text RTP packet, and the like.
  • the played music is encoded and sent as a voice RTP packet, and the transmission of the picture needs to be compressed (JPEG/JPEG 2000) into video encoded data, a picture as a frame, video encoding, and then the encoded video is packaged into an RTP packet for transmission, after the other party receives the RTP packet, parsing each frame is a picture. If a picture is transmitted, there is only one frame, the encoded video has only one frame, and the parsing is one picture; the video transmission is a combination of multi-frame pictures.
  • SIP/SDP Session
  • Initiation Protocol/Session Description Protocol which establishes bearers and ports for RTP packets and negotiates MIME types.
  • the cyclically packaged multimedia RTP packets are periodically transmitted through the network to form RTP media. flow. Examples are as follows:
  • the present invention further provides a media data real-time transmission control system, wherein the media data real-time transmission control system includes: a call originating end 10 and a call receiving end 20;
  • the call originating end 10 and the call receiving end 20 establish a call by using a preset call protocol (VoLTE protocol or ViLTE protocol), and enable a media data real-time transmission channel based on the RTP protocol; when the call originating end 10 selects the call When the call receiving end 20 sends the media data, the call originating end 10 packs the media data into an RTP packet and sends the data to the call receiving end 20; when the call receiving end 20 receives the RTP sent by the call originating end 10 After the packet, the call receiving end 20 parses and processes the RTP packet, and outputs and displays the media data sent by the call originating terminal 10.
  • VoIP protocol Voice over IP
  • ViLTE protocol Voice over IP
  • the present invention further provides a storage medium, wherein the storage medium stores a media data real-time transmission control program, and the step of realizing the media data real-time transmission control method when the media data real-time transmission control program is executed by the processor; As mentioned above.
  • FIG. 5 is a block diagram showing a specific structure of a mobile terminal according to an embodiment of the present invention.
  • the mobile terminal may be used to implement a media data real-time transmission control method provided in the foregoing embodiment.
  • the mobile terminal 1200 can be a smartphone or a tablet.
  • the mobile terminal 1200 may include an RF (Radio Frequency) circuit 110, a memory 120 including one or more (only one shown) computer-readable storage medium, an input unit 130, and a display unit. 140, sensor 150, audio circuit 160, transmission module 170, including processor 180 having one or more processing cores (only one shown) and power supply 190 and the like.
  • RF Radio Frequency
  • the structure of the mobile terminal 1200 shown in FIG. 5 does not constitute a limitation of the mobile terminal 1200, and may include more or less components than those illustrated, or combine some components, or different components. Arrangement. among them:
  • the RF circuit 110 is configured to receive and transmit electromagnetic waves, and realize mutual conversion between electromagnetic waves and electrical signals, thereby communicating with a communication network or other devices.
  • the RF circuit 110 may include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption/decryption chip, a Subscriber Identity Module (SIM) card, a memory, and the like.
  • SIM Subscriber Identity Module
  • the RF circuit 110 can communicate with various networks such as the Internet, an intranet, a wireless network, or communicate with other devices over a wireless network.
  • the wireless network described above may include a cellular telephone network, a wireless local area network, or a metropolitan area network.
  • the above wireless networks may use various communication standards, protocols and technologies, including but not limited to global mobile communication systems (Global System for Mobile Communication, GSM), Enhanced Mobile Communication Technology (Enhanced Data GSM Environment, EDGE), Wideband Code Division Multiple Access (Wideband Code) Division Multiple Access (WCDMA), Code Division Access (Code Division Access, CDMA), Time Division Multiple Access (TDMA), Wireless Fidelity (Wireless Fidelity, Wi-Fi) (such as the Institute of Electrical and Electronics Engineers Standard IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and / or IEEE 802.11n), VoIP (Voice) Over Internet Protocol, VoIP), Worldwide Interoperability for Microwave Access (Worldwide Interoperability for Microwave Access, Wi-Max, other protocols for mail, instant messaging, and short messages, as well as any other suitable communication protocol, may even include protocols that are not currently being developed.
  • GSM Global System for Mobile Communication
  • EDGE Enhanced Mobile Communication Technology
  • WCDMA Wideband Code Division Multiple Access
  • CDMA Code Division Access
  • the memory 120 can be used to store software programs and modules, such as program instructions/modules corresponding to the media data real-time transmission control method in the above embodiment, and the processor 180 executes various functional applications by running software programs and modules stored in the memory 120. And data processing, that is, the function of real-time transmission control of media data.
  • Memory 120 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory.
  • memory 120 can further include memory remotely located relative to processor 180, which can be connected to mobile terminal 1200 via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • the input unit 130 can be configured to receive input numeric or character information and to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls.
  • input unit 130 can include touch-sensitive surface 131 as well as other input devices 132.
  • Touch-sensitive surface 131 also referred to as a touch display or trackpad, can collect touch operations on or near the user (such as a user using a finger, stylus, etc., on any suitable object or accessory on touch-sensitive surface 131 or The operation near the touch-sensitive surface 131) and driving the corresponding connecting device according to a preset program.
  • the touch-sensitive surface 131 can include two portions of a touch detection device and a touch controller.
  • the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information.
  • the processor 180 is provided and can receive commands from the processor 180 and execute them.
  • the touch-sensitive surface 131 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves.
  • the input unit 130 can also include other input devices 132.
  • other input devices 132 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.
  • the display unit 140 can be used to display information input by the user or information provided to the user and various graphical user interfaces of the mobile terminal 1200, which can be composed of graphics, text, icons, video, and any combination thereof.
  • the display unit 140 may include a display panel 141, and optionally, an LCD (Liquid may be used)
  • the display panel 141 is configured in the form of a Crystal Display (LCD) or an OLED (Organic Light-Emitting Diode).
  • touch-sensitive surface 131 may cover the display panel 141, and when the touch-sensitive surface 131 detects a touch operation thereon or nearby, it is transmitted to the processor 180 to determine the type of the touch event, and then the processor 180 according to the touch event The type provides a corresponding visual output on display panel 141.
  • touch-sensitive surface 131 and display panel 141 are implemented as two separate components to implement input and output functions, in some embodiments, touch-sensitive surface 131 can be integrated with display panel 141 for input. And output function.
  • Mobile terminal 1200 may also include at least one type of sensor 150, such as a light sensor, motion sensor, and other sensors.
  • the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 141 according to the brightness of the ambient light, and the proximity sensor may close the display panel 141 when the mobile terminal 1200 moves to the ear. And / or backlight.
  • the gravity acceleration sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity.
  • the mobile terminal 1200 can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, here No longer.
  • the audio circuit 160, the speaker 161, and the microphone 162 can provide an audio interface between the user and the mobile terminal 1200.
  • the audio circuit 160 can transmit the converted electrical data of the received audio data to the speaker 161 for conversion to the sound signal output by the speaker 161; on the other hand, the microphone 162 converts the collected sound signal into an electrical signal by the audio circuit 160. After receiving, it is converted into audio data, and then processed by the audio data output processor 180, transmitted to the mobile terminal 110 via the RF circuit 110, or outputted to the memory 120 for further processing.
  • the audio circuit 160 may also include an earbud jack to provide communication of the peripheral earphones with the mobile terminal 1200.
  • the mobile terminal 1200 can help the user to send and receive emails, browse web pages, access streaming media, etc. through the transmission module 170 (eg, Wi-Fi module), which provides wireless broadband Internet access to the user.
  • the transmission module 170 eg, Wi-Fi module
  • FIG. 5 shows the transmission module 170, it can be understood that it does not belong to the essential configuration of the mobile terminal 1200, and may be omitted as needed within the scope of not changing the essence of the invention.
  • the processor 180 is a control center of the mobile terminal 1200 that connects various portions of the entire handset with various interfaces and lines, by running or executing software programs and/or modules stored in the memory 120, and recalling data stored in the memory 120.
  • the various functions and processing data of the mobile terminal 1200 are executed to perform overall monitoring of the mobile phone.
  • the processor 180 may include one or more processing cores; in some embodiments, the processor 180 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and For applications, etc., the modem processor primarily handles wireless communications. It can be understood that the above modem processor may not be integrated into the processor 180.
  • the mobile terminal 1200 also includes a power source 190 (such as a battery) that powers the various components.
  • the power source can be logically coupled to the processor 180 through a power management system to manage charging, discharging, and power consumption through the power management system. Management and other functions.
  • Power supply 190 may also include any one or more of a DC or AC power source, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.
  • the mobile terminal 1200 may further include a camera (such as a front camera, a rear camera), a Bluetooth module, and the like, and details are not described herein.
  • the display unit of the mobile terminal is a touch screen display
  • the mobile terminal further includes a memory, and one or more programs, wherein one or more programs are stored in the memory and configured to be one or one
  • the above processor executes one or more programs that include instructions for performing the following operations:
  • the call originating end and the call receiving end establish a call by using a preset call protocol, and start a real-time transmission channel of the media data based on the RTP protocol;
  • the call originating end When the call originating end selects to send the media data to the call receiving end, the call originating end packs the media data into an RTP packet and sends the data to the call receiving end, so that when the call receiving end receives the RTP packet sent by the call originating end, the call receiving end The end parses and processes the RTP packet, and outputs and displays the media data sent by the call originating end.
  • the preset call protocol includes: a VoLTE protocol and a ViLTE protocol.
  • the step of the call originating end and the call receiving end establishing a call by using a preset call protocol, and starting the real-time transmission channel of the media data based on the RTP protocol specifically includes:
  • the call originating end and the call receiving end establish a high-definition voice call through the VoLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol.
  • Data real-time transmission channel ;
  • the call originating end and the call receiving end establish a high-definition video call through the ViLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol.
  • Data real-time transmission channel When the preset call protocol is selected as the ViLTE protocol, the call originating end and the call receiving end establish a high-definition video call through the ViLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol.
  • Data real-time transmission channel When the preset call protocol is selected as the ViLTE protocol, the call originating end and the call receiving end establish a high-definition video call through the ViLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol. Data real-time transmission channel.
  • the call originating end and the call receiving end After the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call, when the call originating end selects to share music to the call receiving end, the call originating end selects a song and then performs play music;
  • the call originating end packs the audio media data into a voice RTP packet, and sends the voice RTP packet to the call receiving end in real time, so that the call receiving end receives the received location
  • the voice RTP packet is parsed, and after the parsing is completed, the music in the voice RTP packet is outputted at the call receiving end, and the song shared by the call originating end is played online.
  • the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call
  • the call originating end selects to share the picture or video to the call receiving end
  • the call originating end adds a picture or Compress and encode after the video
  • the call originating end packs the picture or video media data into a video RTP packet, and sends the video RTP packet to the call receiving end in real time, so that the call receiving end Parsing the received video RTP packet, decompressing and decoding the image or video after the parsing is completed, displaying a picture or playing a video on the call receiving end, and displaying the picture shared by the call originating end or The video shared by the call originating party is played online.
  • the RTP package includes: a voice RTP packet, a video RTP packet, and a text RTP packet.
  • the present invention provides a media data real-time transmission control method, system, and storage medium.
  • the method includes: a call originating end and a call receiving end establish a call by using a preset call protocol, and start media data in real time based on the RTP protocol.
  • the call originating end selects to send the media data to the call receiving end
  • the call originating end packs the media data into an RTP packet and sends it to the call receiving end; when the call receiving end receives the RTP packet sent by the call originating end, the call is made.
  • the receiving end parses and processes the RTP packet, and outputs and displays the media data sent by the call originating end.
  • the invention is based on VoLTE (High Definition Voice Call) and ViLTE (High Definition Video Call) protocol and RTP real-time transport protocol, through VoLTE or
  • VoLTE High Definition Voice Call
  • ViLTE High Definition Video Call
  • RTP Real-time transport protocol
  • a computer program to instruct related hardware (such as a processor, a controller, etc.), and the program can be stored in one.
  • the program when executed, may include the processes of the various method embodiments as described above.
  • the storage medium described therein may be a memory, a magnetic disk, an optical disk, or the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computational Linguistics (AREA)
  • General Business, Economics & Management (AREA)
  • Business, Economics & Management (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Telephonic Communication Services (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

L'invention concerne un procédé de commande de transmission en temps réel de données multimédias, un système et un support d'informations, le procédé comprenant : l'établissement, par un terminal de lancement d'appel, d'un appel auprès d'un terminal de réception d'appel au moyen d'un protocole d'appel prédéfini et l'ouverture d'un canal de transmission en temps réel de données multimédias, sur la base d'un protocole RTP ; lorsque le terminal de lancement d'appel choisit de transmettre des données multimédias au terminal de réception d'appel, le conditionnement, par le terminal de lancement d'appel, des données multimédias en un paquet de RTP et la transmission de ce dernier au terminal de réception d'appel ; l'analyse et le traitement, par le terminal de réception d'appel, du paquet de RTP et la production et l'affichage des données multimédias envoyées par le terminal de lancement d'appel.
PCT/CN2019/076206 2018-02-27 2019-02-26 Procédé de commande de transmission en temps réel de données multimédias, système et support d'informations WO2019165960A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810163715.7 2018-02-27
CN201810163715.7A CN108259510A (zh) 2018-02-27 2018-02-27 一种媒体数据实时传输控制方法、系统及存储介质

Publications (1)

Publication Number Publication Date
WO2019165960A1 true WO2019165960A1 (fr) 2019-09-06

Family

ID=62744427

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/076206 WO2019165960A1 (fr) 2018-02-27 2019-02-26 Procédé de commande de transmission en temps réel de données multimédias, système et support d'informations

Country Status (2)

Country Link
CN (1) CN108259510A (fr)
WO (1) WO2019165960A1 (fr)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111885015A (zh) * 2020-07-06 2020-11-03 惠州市源医科技有限公司 一种基于rtp远程控制设备的方法
CN114697753A (zh) * 2020-12-28 2022-07-01 深圳Tcl数字技术有限公司 通话实现方法、装置、电视机和计算机可读存储介质
CN113438200B (zh) * 2021-05-13 2023-01-10 荣耀终端有限公司 在通话过程中传输富媒体信息的系统、方法及设备
CN113596271B (zh) * 2021-07-22 2023-12-12 深圳市软讯信息技术有限公司 一种通话中共享图片的方法和系统
CN116939139A (zh) * 2022-03-31 2023-10-24 华为技术有限公司 一种通信方法、装置及系统

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106534203A (zh) * 2016-12-27 2017-03-22 努比亚技术有限公司 一种移动终端及通讯方法
US20170374635A1 (en) * 2016-06-27 2017-12-28 Blackberry Limited RELIABILITY OF VoLTE/ViLTE CALLS
CN107682360A (zh) * 2017-10-31 2018-02-09 维沃移动通信有限公司 一种语音通话的处理方法及移动终端

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170374635A1 (en) * 2016-06-27 2017-12-28 Blackberry Limited RELIABILITY OF VoLTE/ViLTE CALLS
CN106534203A (zh) * 2016-12-27 2017-03-22 努比亚技术有限公司 一种移动终端及通讯方法
CN107682360A (zh) * 2017-10-31 2018-02-09 维沃移动通信有限公司 一种语音通话的处理方法及移动终端

Also Published As

Publication number Publication date
CN108259510A (zh) 2018-07-06

Similar Documents

Publication Publication Date Title
WO2019165960A1 (fr) Procédé de commande de transmission en temps réel de données multimédias, système et support d'informations
WO2018018892A1 (fr) Procédé de lecture de tonalité de retour d'appel vidéo et équipement utilisateur appelant
CN101282464B (zh) 转移视频的终端及方法
WO2017008627A1 (fr) Procédé, appareil et système de diffusion en direct de contenu multimédia
JP2013511194A (ja) モバイル端末機、ディスプレイ装置及びその制御方法
CN106982286B (zh) 一种录音方法、设备和计算机可读存储介质
CN105430208A (zh) 语音会话方法、装置及终端设备
KR102324694B1 (ko) 전자 장치에서 전력 소모를 줄이기 위한 장치 및 방법
CN112423076B (zh) 一种音频投屏同步控制方法、设备及计算机可读存储介质
WO2022062625A1 (fr) Appareil et procédé d'appel vidéo
CN108810293A (zh) 一种通信方法、装置和移动终端
WO2022222691A1 (fr) Procédé de traitement d'appel et dispositif associé
WO2021197309A1 (fr) Procédé et dispositif de traitement de transmission
WO2021057776A1 (fr) Procédé d'appel de sous-système multimédia à protocole internet, terminal et fonction de réseau
JP2023514783A (ja) オーディオ伝送方法、電子機器及びコンピュータ可読記憶媒体
WO2023045848A1 (fr) Procédé de traitement d'appel et appareil de traitement d'appel
CN112203116A (zh) 一种视频生成方法、播放方法及相关设备
CN106878655B (zh) 视频通话方法和装置
KR20110092713A (ko) 실시간 멀티미디어 서비스 제공 방법 및 시스템
WO2018035873A1 (fr) Procédé de traitement de données audio, dispositif terminal, et support de stockage
WO2021164761A1 (fr) Procédé de communication et dispositif associé
WO2021227143A1 (fr) Procédé d'appel direct, dispositif de réseau central, terminal mobile et support de stockage
TWI523461B (zh) 通訊系統和方法
JP6031825B2 (ja) 楽曲データ出力システム
WO2021120381A1 (fr) Procédé et dispositif de basculement de réseau d'appels et support de stockage

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19760058

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19760058

Country of ref document: EP

Kind code of ref document: A1