WO2019165960A1 - Media data real time transmission control method, system and storage medium - Google Patents

Abstract

Disclosed are a media data real time transmission control method, system and storage medium, the method comprising: a call initiating terminal establishing a call with a call receiving terminal by means of a preset call protocol, and opening a media data real time transmission channel on the basis of an RTP protocol; when the call initiating terminal chooses to transmit media data to the call receiving terminal, the call initiating terminal packaging the media data into an RTP package and transmitting the same to the call receiving terminal; the call receiving terminal parsing and processing the RTP package, and outputting and displaying the media data sent by the call initiating terminal.

Description

Media data real-time transmission control method, system and storage medium

This application claims the priority of the Chinese patent application filed on February 27, 2018, the Chinese Patent Office, Application No. 201101163715.7, entitled "A Media Data Real-Time Transmission Control Method, System and Storage Medium", the entire contents of which are The citations are incorporated herein by reference.

Technical field

The present invention relates to the field of data transmission technologies, and in particular, to a media data real-time transmission control method, system, and storage medium.

Background technique

As wireless networks become more popular around the world, voice over HD (VoLTE, IMS-based voice services) and high-definition video (ViLTE, IMS-based video services) calls can lead to a better user experience, so VoLTE and ViLTE will become the future. The mainstream of the call.

Music is an art that reflects the emotions of human real life. It is an art form that expresses people's thoughts and feelings and social real life. It is also one of the most artistic forms that can impress people instantly. Music in life is everywhere, school students use music classes to ease the pressure of students' learning; use music to create a relaxed working environment at work; use music to cultivate their own sentiments in leisure; use in the busy life rhythm Music to relax and improve your spirit. Pictures and videos are very important in human abnormal life. Pictures and videos can record the characteristics of a certain period of time. Pictures and videos can record beautiful scenery somewhere. Pictures and videos can record the wonderful moments in life. As a kind of multimedia data in human life, pictures and videos can intuitively show a picture, which is widely used in human daily life. As the Internet becomes more developed, the transmission of pictures and videos over the Internet is also increasing.

In the daily life of human beings, there is a lack of a convenient, online, and common way of listening and sharing music. The current way of sharing music is to send music related elements or music files themselves to each other and tell them to go. Looking for a download, and then the other party listening to music, this method is very cumbersome, consumes more resources, and the sharing effect is not ideal. For example, a music creator creates a song and sings it to people in the distance, but the music needs melody. If it is a recorded audio file, there is no effect of "live" singing to you. Sometimes, during a call, it is convenient, online, and real-time to share a picture or video. It is inflexible, inconvenient, or even delayed to transmit pictures or videos in the form of a traditional Internet.

Therefore, the prior art has yet to be improved and developed.

technical problem

Embodiments of the present invention provide a media data real-time transmission control method, system, and storage medium, which can be based on VoLTE (High Definition Voice Call) and ViLTE (High Definition Video Call) protocols and RTP real-time transmission protocols, through VoLTE or When ViLTE is established, in one or more parties, one party can play music to achieve the purpose of sharing music; or transfer pictures and videos to achieve the purpose of sharing pictures or videos online and conveniently, enhance call function and improve call performance.

Technical solution

The technical solution adopted by the present invention to solve the technical problem is as follows:

In a first aspect, an embodiment of the present invention provides a media data real-time transmission control method, where the media data real-time transmission control method includes:

The call originating end and the call receiving end establish a call by using a preset call protocol, and start a real-time transmission channel of the media data based on the RTP protocol;

When the call originating end selects to send the media data to the call receiving end, the call originating end packs the media data into an RTP packet and sends the data to the call receiving end;

After receiving the RTP packet sent by the call originating end, the call receiving end parses and processes the RTP packet, and outputs and displays the media data sent by the call originating end.

The media data real-time transmission control method, wherein the preset call protocol comprises: a VoLTE protocol and a ViLTE protocol.

The media data real-time transmission control method, wherein the call originating end and the call receiving end establish a call by using a preset call protocol, and the step of enabling the media data real-time transmission channel based on the RTP protocol, specifically includes:

When the preset call protocol is selected as the VoLTE protocol, the call originating end and the call receiving end establish a high-definition voice call through the VoLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol. Data real-time transmission channel;

When the preset call protocol is selected as the ViLTE protocol, the call originating end and the call receiving end establish a high-definition video call through the VoLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol. Data real-time transmission channel.

The media data real-time transmission control method, wherein, when the call originating end selects to send the media data to the call receiving end, the step of the call originating end packaging the media data into the RTP packet and sending the data to the call receiving end includes:

After the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call, when the call originating end selects to share music to the call receiving end, the call originating end selects a song and then performs play music;

When the music is in the playing process, the call originating end packs the audio media data into a voice RTP packet, and sends the voice RTP packet to the call receiving end in real time.

The media data real-time transmission control method, wherein, when the call originating end selects to send the media data to the call receiving end, the step of the call originating end packaging the media data into the RTP packet and sending the data to the call receiving end includes:

After the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call, when the call originating end selects to share the picture or video to the call receiving end, the call originating end adds a picture or Compress and encode after the video;

After the picture or video is compressed and encoded, the call originating end packs the picture or video media data into a speech video RTP packet, and sends the video RTP packet to the call receiving end in real time.

The media data real-time transmission control method, wherein, after the call receiving end receives the RTP packet sent by the call originating end, the call receiving end parses and processes the RTP packet, and outputs and displays the media data sent by the call originating end. The steps specifically include:

The call receiving end receives the voice RTP packet sent by the call originating end, in a state in which the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call.

The call receiving end parses the received voice RTP packet, and after the parsing is completed, outputs the music in the voice RTP packet at the call receiving end, and is used to play the song shared by the call originating end online.

The media data real-time transmission control method, wherein, after the call receiving end receives the RTP packet sent by the call originating end, the call receiving end parses and processes the RTP packet, and outputs and displays the media data sent by the call originating end. The steps specifically include:

The call receiving end receives the video RTP packet sent by the call originating end, in a state in which the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call.

The call receiving end parses the received video RTP packet, decompresses and decodes the picture or video after the parsing is completed, displays a picture or plays a video at the call receiving end, and is used to display the call online. The image shared by the originating end or the video shared by the call originating end is played online.

The media data real-time transmission control method, wherein the RTP package comprises: a voice RTP packet, a video RTP packet, and a text RTP packet.

In a second aspect, the embodiment of the present invention provides a media data real-time transmission control system, where the media data real-time transmission control system includes: a call originating end and a call receiving end;

The call originating end and the call receiving end establish a call by using a preset call protocol, and start a media data real-time transmission channel based on the RTP protocol; when the call originating end selects to send media data to the call receiving end, the The call originating end packs the media data into an RTP packet and sends the RTP packet to the call receiving end. After the call receiving end receives the RTP packet sent by the call originating end, the call receiving end parses and processes the RTP packet, and Outputting and displaying media data sent by the call originating end.

In a third aspect, an embodiment of the present invention provides a storage medium, wherein the storage medium stores a media data real-time transmission control program, and the media data real-time transmission control program is executed by the processor as follows:

The call originating end and the call receiving end establish a call by using a preset call protocol, and start a real-time transmission channel of the media data based on the RTP protocol;

When the call originating end selects to send the media data to the call receiving end, the call originating end packs the media data into an RTP packet and sends the data to the call receiving end, so that when the call receiving end receives the RTP packet sent by the call originating end, the call receiving end The end parses and processes the RTP packet, and outputs and displays the media data sent by the call originating end.

The preset call protocol includes: a VoLTE protocol and a ViLTE protocol.

The step of the call originating end and the call receiving end establishing a call by using a preset call protocol, and starting the real-time transmission channel of the media data based on the RTP protocol, specifically includes:

When the preset call protocol is selected as the VoLTE protocol, the call originating end and the call receiving end establish a high-definition voice call through the VoLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol. Data real-time transmission channel;

When the preset call protocol is selected as the ViLTE protocol, the call originating end and the call receiving end establish a high-definition video call through the ViLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol. Data real-time transmission channel.

The step of: when the call originating end selects to send the media data to the call receiving end, the call originating end packs the media data into an RTP packet and sends the data to the call receiving end, which specifically includes:

After the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call, when the call originating end selects to share music to the call receiving end, the call originating end selects a song and then performs play music;

When the music is in the playing process, the call originating end packs the audio media data into a voice RTP packet, and sends the voice RTP packet to the call receiving end in real time, so that the call receiving end receives the received location The voice RTP packet is parsed, and after the parsing is completed, the music in the voice RTP packet is outputted at the call receiving end, and the song shared by the call originating end is played online.

The step of: when the call originating end selects to send the media data to the call receiving end, the call originating end packs the media data into an RTP packet and sends the data to the call receiving end, which specifically includes:

After the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call, when the call originating end selects to share the picture or video to the call receiving end, the call originating end adds a picture or Compress and encode after the video;

After the picture or video is compressed and encoded, the call originating end packs the picture or video media data into a video RTP packet, and sends the video RTP packet to the call receiving end in real time, so that the call receiving end Parsing the received video RTP packet, decompressing and decoding the image or video after the parsing is completed, displaying a picture or playing a video on the call receiving end, and displaying the picture shared by the call originating end or The video shared by the call originating party is played online.

The RTP package includes: a voice RTP packet, a video RTP packet, and a text RTP packet.

Beneficial effect

The invention discloses a media data real-time transmission control method, system and storage medium, the method comprises: a call originating end and a call receiving end establish a call by using a preset call protocol, and open a real-time transmission channel of the media data based on the RTP protocol; When the call originating end selects to send the media data to the call receiving end, the call originating end packs the media data into an RTP packet and sends it to the call receiving end; when the call receiving end receives the RTP packet sent by the call originating end, the call receiving end parses and Processing the RTP packet, and outputting and displaying the media data sent by the call originating end. The invention is based on VoLTE (High Definition Voice Call) and ViLTE (High Definition Video Call) protocol and RTP real-time transport protocol, through VoLTE or When ViLTE is established, in one or more parties, one party can play music to achieve the purpose of sharing music; or transfer pictures and videos to achieve the purpose of sharing pictures or videos online and conveniently, enhance call function and improve call performance.

DRAWINGS

1 is a flow chart of a preferred embodiment of a method for controlling real-time transmission of media data provided by the present invention;

2 is a flow chart of sharing music in a preferred embodiment of a media data real-time transmission control method provided by the present invention;

3 is a flow chart of sharing a picture or video in a preferred embodiment of a media data real-time transmission control method provided by the present invention;

4 is a functional block diagram of a preferred embodiment of a media data real-time transmission control system provided by the present invention.

FIG. 5 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention.

Embodiments of the invention

The present invention will be further described in detail below with reference to the accompanying drawings. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

The present invention will be further described in detail below with reference to the accompanying drawings. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

The media data real-time transmission control method provided by the preferred embodiment of the present invention, as shown in FIG. 1 , is a media data real-time transmission control method, wherein the media data real-time transmission control method includes the following steps:

Step S10: The call originating end and the call receiving end establish a call by using a preset call protocol, and start a real-time transmission channel of the media data based on the RTP protocol.

Specifically, the preset call protocol includes: a VoLTE protocol (High Definition Voice Call Protocol) and a ViLTE protocol (High Definition Video Call Protocol). Both parties of the call pass VoLTE or When ViLTE establishes a call, it is based on the RTP protocol (Real-Time Transport Protocol, which is a network transmission protocol, RTP protocol is commonly used in streaming media systems, with RTSP protocol, video conferencing and push-to-talk system (with H.323 or SIP) makes it the technical foundation of the IP telephony industry. RTP is widely used in streaming media-related communication and entertainment, including telephony, video conferencing, television and network-based push-to-talk services. The originating end and the call receiving end perform media data transmission, and the media data includes voice (music), pictures, video, text, and the like.

The step S10 includes:

S11. When the preset call protocol is selected as the VoLTE protocol, the call originating end and the call receiving end establish a high-definition voice call by using the VoLTE protocol, and start between the call originating end and the call receiving end according to the RTP protocol. Real-time transmission channel of media data;

S12. When the preset call protocol is selected as the ViLTE protocol, the call originating end and the call receiving end establish a high-definition video call through the ViLTE protocol, and start the call between the call originating end and the call receiving end according to the RTP protocol. Real-time transmission channel of media data.

Step S20: When the call originating end selects to send media data to the call receiving end, the call originating end packs the media data into an RTP packet and sends the data to the call receiving end.

Specifically, when the call originating party selects to share music with the call receiving end, the music sharing mode based on the RTP protocol has its unique characteristics. When VoLTE or ViLTE calls, only one party needs to play and share. Both parties can enjoy the artistic feeling brought by music in real time, online and at the same time, without affecting the call itself.

For example, a music creator creates a song that wants to sing to people in the distance, but the music needs melody. If it is a recorded audio file, there is no effect of “live” singing to you, so the creator can In VoLTE or ViLTE calls, by playing the music melody as background music, and then singing, to achieve instant, online, and at the same time enjoy the emotions I sing for you "live."

In addition, when the call originating party chooses to share the picture with the call receiving end, for example, two people are talking, and one party wants to shoot the wonderful moment in front of the scene, or something, and then transmits it to the other party, and needs to describe the scene in the photo online. Or things, etc.; or two people are talking, one party wants to share the beautiful scenery of a certain tour, and share it with the other party online. At this time, one piece can be transmitted to the other party, and the content of the picture can be explained at the same time. Restore the scenes of the tourism at the time and share the fun of the other party.

Whether in life or at work, sometimes it is difficult to express clearly by words, and it is necessary to use pictures to explain or use music to express emotions. At this time, the present invention can often achieve very good communication.

The step S20 includes:

S21: After the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call, when the call originating end selects to share music to the call receiving end, the call originating end selects a song. After playing music;

S22. When the music is in the playing process, the call originating end packs the audio media data into a voice RTP packet, and sends the voice RTP packet to the call receiving end in real time.

Or the step S20 further includes:

S23, after the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call, when the call originating end selects to share a picture or video to the call receiving end, the call originating end adds Compress and encode after the picture or video;

S24. After the picture or video is compressed and encoded, the call originating end packs the picture or video media data into a video RTP packet, and sends the video RTP packet to the call receiving end in real time.

Step S30: After receiving the RTP packet sent by the call originating end, the call receiving end parses and processes the RTP packet, and outputs and displays the media data sent by the call originating end.

Specifically, in the present invention, when the call originating end performs music, picture or video sharing on the call receiving end, when the call receiving end receives the RTP packet (voice RTP packet, video RTP packet or text RTP packet) sent by the call originating end, After that, the call receiving end needs to parse and process the RTP packet accordingly, and after processing, output and display the media data sent by the call originating end, for example, the music that is finally played and shared when the music is shared, and is the final image when the image is shared. Display is the playback of the video when the video is shared.

The step S30 includes:

S31: The call receiving end receives the voice RTP packet sent by the call originating end, in a state in which the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call.

S32. The call receiving end parses the received voice RTP packet, and after the parsing is completed, outputting the music in the voice RTP packet at the call receiving end, and playing the online shared song of the call originating end. .

Or the step S30 further includes:

S33. The call receiving end receives the video RTP packet sent by the call originating end, in a state in which the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call.

S34. The call receiving end parses the received video RTP packet, decompresses and decodes the picture or video after the parsing is completed, displays a picture or plays a video at the call receiving end, and displays the online The picture shared by the call originating party or the video shared by the call originating end.

In order to further illustrate the above technical solutions, the following specific examples are as follows:

As shown in FIG. 2, the process of sharing music to the call receiving end of the call originating end (the call originating end and the call receiving end have previously established a call connection through the VoLTE protocol or the ViLTE protocol):

S101. When the call originating end selects to share music to the call receiving end, the call originating end selects a song and then performs music playing;

S102. When the music is playing, the call originating end packs the audio media data into a voice RTP packet, and sends the voice RTP packet to the call receiving end in real time;

S103. The call receiving end receives the voice RTP packet sent by the call originating end.

S104. The call receiving end parses the received voice RTP packet.

S105: After the parsing is completed, output the music in the voice RTP packet at the call receiving end, and complete the sharing of the music.

As shown in FIG. 3, the process of performing picture or video sharing to the call receiving end of the call originating end (the call originating end and the call receiving end have previously established a call connection through the VoLTE protocol or the ViLTE protocol):

S201. When the call originating end selects to share the picture or video to the call receiving end, the call originating end adds a picture or video;

S202: After the picture or video is added to the call originating end, compression and encoding are performed;

After the S203, the picture or the video is compressed and encoded, the call originating end packs the picture or video media data into a video RTP packet, and sends the data to the call receiving end in real time;

S204. The call receiving end receives the video RTP packet sent by the call originating end.

S205. The call receiving end parses the received video RTP packet.

S206: Decompress and decode the picture or video after the parsing is completed;

S207: Display a picture or play a video on the call receiving end, that is, display the picture shared by the call originating end or play the video shared by the call originating end online.

When the two parties establish a call through VoLTE or ViLTE, start RTP to transmit media data in real time. When playing music, the RTP package is packaged and transmitted to the other party's mobile phone through the RTP packet. When the picture is sent, the picture is compressed into a video stream. The RTP packet is transmitted to the other party's mobile phone and other devices; VoLTE or ViLTE When the call is established, a dedicated bearer and port are created for the RTP, and the multimedia stream (RTP stream) is transmitted in real time, and the multimedia data is encapsulated into an RTP packet for transmission, such as a voice RTP packet, a video RTP packet, a text RTP packet, and the like. The played music is encoded and sent as a voice RTP packet, and the transmission of the picture needs to be compressed (JPEG/JPEG 2000) into video encoded data, a picture as a frame, video encoding, and then the encoded video is packaged into an RTP packet for transmission, after the other party receives the RTP packet, parsing each frame is a picture. If a picture is transmitted, there is only one frame, the encoded video has only one frame, and the parsing is one picture; the video transmission is a combination of multi-frame pictures.

SIP/SDP (Session) when VoLTE or ViLTE calls are established Initiation Protocol/Session Description Protocol, which establishes bearers and ports for RTP packets and negotiates MIME types. During the call, the cyclically packaged multimedia RTP packets are periodically transmitted through the network to form RTP media. flow. Examples are as follows:

V=0

o=mhandley 2890844526 2890842807 IN IP4 126.16.64.4

s=SDP Seminar

i=A Seminar on the session description protocol

u=http://www.cs.ucl.ac.uk/staff/M.Handley/sdp.03.ps

E=mjh@isi.edu (Mark Handley)

c=IN IP4 224.2.17.12/127

t=2873397496 2873404696

a=recvonly

m=audio 49170 RTP/AVP 0

m=video 51372 RTP/AVP 31

m=application 32416 udp wb

a=orient:portrait.

As shown in FIG. 4, the present invention further provides a media data real-time transmission control system, wherein the media data real-time transmission control system includes: a call originating end 10 and a call receiving end 20;

The call originating end 10 and the call receiving end 20 establish a call by using a preset call protocol (VoLTE protocol or ViLTE protocol), and enable a media data real-time transmission channel based on the RTP protocol; when the call originating end 10 selects the call When the call receiving end 20 sends the media data, the call originating end 10 packs the media data into an RTP packet and sends the data to the call receiving end 20; when the call receiving end 20 receives the RTP sent by the call originating end 10 After the packet, the call receiving end 20 parses and processes the RTP packet, and outputs and displays the media data sent by the call originating terminal 10.

The present invention further provides a storage medium, wherein the storage medium stores a media data real-time transmission control program, and the step of realizing the media data real-time transmission control method when the media data real-time transmission control program is executed by the processor; As mentioned above.

FIG. 5 is a block diagram showing a specific structure of a mobile terminal according to an embodiment of the present invention. The mobile terminal may be used to implement a media data real-time transmission control method provided in the foregoing embodiment. The mobile terminal 1200 can be a smartphone or a tablet.

As shown in FIG. 5, the mobile terminal 1200 may include an RF (Radio Frequency) circuit 110, a memory 120 including one or more (only one shown) computer-readable storage medium, an input unit 130, and a display unit. 140, sensor 150, audio circuit 160, transmission module 170, including processor 180 having one or more processing cores (only one shown) and power supply 190 and the like. It will be understood by those skilled in the art that the structure of the mobile terminal 1200 shown in FIG. 5 does not constitute a limitation of the mobile terminal 1200, and may include more or less components than those illustrated, or combine some components, or different components. Arrangement. among them:

The RF circuit 110 is configured to receive and transmit electromagnetic waves, and realize mutual conversion between electromagnetic waves and electrical signals, thereby communicating with a communication network or other devices. The RF circuit 110 may include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption/decryption chip, a Subscriber Identity Module (SIM) card, a memory, and the like. The RF circuit 110 can communicate with various networks such as the Internet, an intranet, a wireless network, or communicate with other devices over a wireless network. The wireless network described above may include a cellular telephone network, a wireless local area network, or a metropolitan area network. The above wireless networks may use various communication standards, protocols and technologies, including but not limited to global mobile communication systems (Global System for Mobile Communication, GSM), Enhanced Mobile Communication Technology (Enhanced Data GSM Environment, EDGE), Wideband Code Division Multiple Access (Wideband Code) Division Multiple Access (WCDMA), Code Division Access (Code Division Access, CDMA), Time Division Multiple Access (TDMA), Wireless Fidelity (Wireless Fidelity, Wi-Fi) (such as the Institute of Electrical and Electronics Engineers Standard IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and / or IEEE 802.11n), VoIP (Voice) Over Internet Protocol, VoIP), Worldwide Interoperability for Microwave Access (Worldwide Interoperability for Microwave Access, Wi-Max, other protocols for mail, instant messaging, and short messages, as well as any other suitable communication protocol, may even include protocols that are not currently being developed.

The memory 120 can be used to store software programs and modules, such as program instructions/modules corresponding to the media data real-time transmission control method in the above embodiment, and the processor 180 executes various functional applications by running software programs and modules stored in the memory 120. And data processing, that is, the function of real-time transmission control of media data. Memory 120 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory. In some examples, memory 120 can further include memory remotely located relative to processor 180, which can be connected to mobile terminal 1200 via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The input unit 130 can be configured to receive input numeric or character information and to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls. In particular, input unit 130 can include touch-sensitive surface 131 as well as other input devices 132. Touch-sensitive surface 131, also referred to as a touch display or trackpad, can collect touch operations on or near the user (such as a user using a finger, stylus, etc., on any suitable object or accessory on touch-sensitive surface 131 or The operation near the touch-sensitive surface 131) and driving the corresponding connecting device according to a preset program. Alternatively, the touch-sensitive surface 131 can include two portions of a touch detection device and a touch controller. Wherein, the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information. The processor 180 is provided and can receive commands from the processor 180 and execute them. In addition, the touch-sensitive surface 131 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch-sensitive surface 131, the input unit 130 can also include other input devices 132. Specifically, other input devices 132 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.

The display unit 140 can be used to display information input by the user or information provided to the user and various graphical user interfaces of the mobile terminal 1200, which can be composed of graphics, text, icons, video, and any combination thereof. The display unit 140 may include a display panel 141, and optionally, an LCD (Liquid may be used) The display panel 141 is configured in the form of a Crystal Display (LCD) or an OLED (Organic Light-Emitting Diode). Further, the touch-sensitive surface 131 may cover the display panel 141, and when the touch-sensitive surface 131 detects a touch operation thereon or nearby, it is transmitted to the processor 180 to determine the type of the touch event, and then the processor 180 according to the touch event The type provides a corresponding visual output on display panel 141. Although in FIG. 5, touch-sensitive surface 131 and display panel 141 are implemented as two separate components to implement input and output functions, in some embodiments, touch-sensitive surface 131 can be integrated with display panel 141 for input. And output function.

Mobile terminal 1200 may also include at least one type of sensor 150, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 141 according to the brightness of the ambient light, and the proximity sensor may close the display panel 141 when the mobile terminal 1200 moves to the ear. And / or backlight. As a kind of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the gesture of the mobile phone (such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for the mobile terminal 1200 can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, here No longer.

The audio circuit 160, the speaker 161, and the microphone 162 can provide an audio interface between the user and the mobile terminal 1200. The audio circuit 160 can transmit the converted electrical data of the received audio data to the speaker 161 for conversion to the sound signal output by the speaker 161; on the other hand, the microphone 162 converts the collected sound signal into an electrical signal by the audio circuit 160. After receiving, it is converted into audio data, and then processed by the audio data output processor 180, transmitted to the mobile terminal 110 via the RF circuit 110, or outputted to the memory 120 for further processing. The audio circuit 160 may also include an earbud jack to provide communication of the peripheral earphones with the mobile terminal 1200.

The mobile terminal 1200 can help the user to send and receive emails, browse web pages, access streaming media, etc. through the transmission module 170 (eg, Wi-Fi module), which provides wireless broadband Internet access to the user. Although FIG. 5 shows the transmission module 170, it can be understood that it does not belong to the essential configuration of the mobile terminal 1200, and may be omitted as needed within the scope of not changing the essence of the invention.

The processor 180 is a control center of the mobile terminal 1200 that connects various portions of the entire handset with various interfaces and lines, by running or executing software programs and/or modules stored in the memory 120, and recalling data stored in the memory 120. The various functions and processing data of the mobile terminal 1200 are executed to perform overall monitoring of the mobile phone. Optionally, the processor 180 may include one or more processing cores; in some embodiments, the processor 180 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and For applications, etc., the modem processor primarily handles wireless communications. It can be understood that the above modem processor may not be integrated into the processor 180.

The mobile terminal 1200 also includes a power source 190 (such as a battery) that powers the various components. In some embodiments, the power source can be logically coupled to the processor 180 through a power management system to manage charging, discharging, and power consumption through the power management system. Management and other functions. Power supply 190 may also include any one or more of a DC or AC power source, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.

Although not shown, the mobile terminal 1200 may further include a camera (such as a front camera, a rear camera), a Bluetooth module, and the like, and details are not described herein. Specifically, in this embodiment, the display unit of the mobile terminal is a touch screen display, the mobile terminal further includes a memory, and one or more programs, wherein one or more programs are stored in the memory and configured to be one or one The above processor executes one or more programs that include instructions for performing the following operations:

The call originating end and the call receiving end establish a call by using a preset call protocol, and start a real-time transmission channel of the media data based on the RTP protocol;

When the call originating end selects to send the media data to the call receiving end, the call originating end packs the media data into an RTP packet and sends the data to the call receiving end, so that when the call receiving end receives the RTP packet sent by the call originating end, the call receiving end The end parses and processes the RTP packet, and outputs and displays the media data sent by the call originating end.

The preset call protocol includes: a VoLTE protocol and a ViLTE protocol.

The step of the call originating end and the call receiving end establishing a call by using a preset call protocol, and starting the real-time transmission channel of the media data based on the RTP protocol, specifically includes:

When the preset call protocol is selected as the VoLTE protocol, the call originating end and the call receiving end establish a high-definition voice call through the VoLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol. Data real-time transmission channel;

When the preset call protocol is selected as the ViLTE protocol, the call originating end and the call receiving end establish a high-definition video call through the ViLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol. Data real-time transmission channel.

The step of: when the call originating end selects to send the media data to the call receiving end, the call originating end packs the media data into an RTP packet and sends the data to the call receiving end, which specifically includes:

After the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call, when the call originating end selects to share music to the call receiving end, the call originating end selects a song and then performs play music;

When the music is in the playing process, the call originating end packs the audio media data into a voice RTP packet, and sends the voice RTP packet to the call receiving end in real time, so that the call receiving end receives the received location The voice RTP packet is parsed, and after the parsing is completed, the music in the voice RTP packet is outputted at the call receiving end, and the song shared by the call originating end is played online.

The step of: when the call originating end selects to send the media data to the call receiving end, the call originating end packs the media data into an RTP packet and sends the data to the call receiving end, which specifically includes:

After the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call, when the call originating end selects to share the picture or video to the call receiving end, the call originating end adds a picture or Compress and encode after the video;

After the picture or video is compressed and encoded, the call originating end packs the picture or video media data into a video RTP packet, and sends the video RTP packet to the call receiving end in real time, so that the call receiving end Parsing the received video RTP packet, decompressing and decoding the image or video after the parsing is completed, displaying a picture or playing a video on the call receiving end, and displaying the picture shared by the call originating end or The video shared by the call originating party is played online.

The RTP package includes: a voice RTP packet, a video RTP packet, and a text RTP packet.

In summary, the present invention provides a media data real-time transmission control method, system, and storage medium. The method includes: a call originating end and a call receiving end establish a call by using a preset call protocol, and start media data in real time based on the RTP protocol. When the call originating end selects to send the media data to the call receiving end, the call originating end packs the media data into an RTP packet and sends it to the call receiving end; when the call receiving end receives the RTP packet sent by the call originating end, the call is made. The receiving end parses and processes the RTP packet, and outputs and displays the media data sent by the call originating end. The invention is based on VoLTE (High Definition Voice Call) and ViLTE (High Definition Video Call) protocol and RTP real-time transport protocol, through VoLTE or When ViLTE is established, in one or more parties, one party can play music to achieve the purpose of sharing music; or transfer pictures and videos to achieve the purpose of sharing pictures or videos online and conveniently, enhance call function and improve call performance.

Certainly, those skilled in the art can understand that all or part of the processes in the foregoing embodiments can be implemented by a computer program to instruct related hardware (such as a processor, a controller, etc.), and the program can be stored in one. In a computer readable storage medium, the program, when executed, may include the processes of the various method embodiments as described above. The storage medium described therein may be a memory, a magnetic disk, an optical disk, or the like.

It is to be understood that the application of the present invention is not limited to the above-described examples, and those skilled in the art can make modifications and changes in accordance with the above description, all of which are within the scope of the appended claims.

Claims (20)

1. A media data real-time transmission control method, wherein the media data real-time transmission control method includes:

   The call originating end and the call receiving end establish a call by using a preset call protocol, and start a real-time transmission channel of the media data based on the RTP protocol;

   When the call originating end selects to send the media data to the call receiving end, the call originating end packs the media data into an RTP packet and sends the data to the call receiving end;

   After receiving the RTP packet sent by the call originating end, the call receiving end parses and processes the RTP packet, and outputs and displays the media data sent by the call originating end.
2. The media data real-time transmission control method according to claim 1, wherein the preset call protocol comprises: a VoLTE protocol and a ViLTE protocol.
3. The media data real-time transmission control method according to claim 2, wherein the step of the call originating end and the call receiving end establishing a call by using a preset call protocol, and starting the real-time transmission channel of the media data based on the RTP protocol, specifically includes:

   When the preset call protocol is selected as the VoLTE protocol, the call originating end and the call receiving end establish a high-definition voice call through the VoLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol. Data real-time transmission channel;

   When the preset call protocol is selected as the ViLTE protocol, the call originating end and the call receiving end establish a high-definition video call through the ViLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol. Data real-time transmission channel.
4. The media data real-time transmission control method according to claim 3, wherein when the call originating end selects to send the media data to the call receiving end, the call originating end packs the media data into an RTP packet and sends the data to the call receiving end. Specifically include:

   After the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call, when the call originating end selects to share music to the call receiving end, the call originating end selects a song and then performs play music;

   When the music is in the playing process, the call originating end packs the audio media data into a voice RTP packet, and sends the voice RTP packet to the call receiving end in real time.
5. The media data real-time transmission control method according to claim 3, wherein when the call originating end selects to send the media data to the call receiving end, the call originating end packs the media data into an RTP packet and sends the data to the call receiving end. Specifically include:

   After the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call, when the call originating end selects to share the picture or video to the call receiving end, the call originating end adds a picture or Compress and encode after the video;

   After the picture or video is compressed and encoded, the call originating end packs the picture or video media data into a video RTP packet, and sends the video RTP packet to the call receiving end in real time.
6. The media data real-time transmission control method according to claim 4, wherein, after the call receiving end receives the RTP packet sent by the call originating end, the call receiving end parses and processes the RTP packet, and outputs and displays the call originating end to send The steps of the media data, specifically include:

   The call receiving end receives the voice RTP packet sent by the call originating end, in a state in which the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call.

   The call receiving end parses the received voice RTP packet, and after the parsing is completed, outputs the music in the voice RTP packet at the call receiving end, and is used to play the song shared by the call originating end online.
7. The media data real-time transmission control method according to claim 5, wherein, after the call receiving end receives the RTP packet sent by the call originating end, the call receiving end parses and processes the RTP packet, and outputs and displays the call originating end to send The steps of the media data, specifically include:

   The call receiving end receives the video RTP packet sent by the call originating end, in a state in which the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call.

   The call receiving end parses the received video RTP packet, decompresses and decodes the picture or video after the parsing is completed, displays a picture or plays a video at the call receiving end, and is used to display the call initiation online. The shared video or the video shared by the call originating party.
8. The media data real-time transmission control method according to claim 1, wherein the RTP package comprises: a voice RTP packet, a video RTP packet, and a text RTP packet.
9. A media data real-time transmission control system, wherein the media data real-time transmission control system comprises: a call originating end and a call receiving end;

   The call originating end and the call receiving end establish a call by using a preset call protocol, and start a media data real-time transmission channel based on the RTP protocol; when the call originating end selects to send media data to the call receiving end, the The call originating end packs the media data into an RTP packet and sends the RTP packet to the call receiving end. After the call receiving end receives the RTP packet sent by the call originating end, the call receiving end parses and processes the RTP packet, and Outputting and displaying media data sent by the call originating end.
10. The media data real-time transmission control system according to claim 9, wherein when the call originating end selects to send media data to the call receiving end, the call originating end packs the media data into an RTP packet and sends the data to the call receiving end. Specifically include:

    After the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call, when the call originating end selects to share music to the call receiving end, the call originating end selects a song and then performs play music;

    When the music is in the playing process, the call originating end packs the audio media data into a voice RTP packet, and sends the voice RTP packet to the call receiving end in real time.
11. The media data real-time transmission control system according to claim 9, wherein when the call originating end selects to send media data to the call receiving end, the call originating end packs the media data into an RTP packet and sends the data to the call receiving end. Specifically include:

    After the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call, when the call originating end selects to share the picture or video to the call receiving end, the call originating end adds a picture or Compress and encode after the video;

    After the picture or video is compressed and encoded, the call originating end packs the picture or video media data into a video RTP packet, and sends the video RTP packet to the call receiving end in real time.
12. The media data real-time transmission control system according to claim 10, wherein, after the call receiving end receives the RTP packet sent by the call originating end, the call receiving end parses and processes the RTP packet, and outputs and displays the call originating end to send The steps of the media data, specifically include:

    The call receiving end receives the voice RTP packet sent by the call originating end, in a state in which the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call.

    The call receiving end parses the received voice RTP packet, and after the parsing is completed, outputs the music in the voice RTP packet at the call receiving end, and is used to play the song shared by the call originating end online.
13. The media data real-time transmission control system according to claim 11, wherein after the call receiving end receives the RTP packet sent by the call originating end, the call receiving end parses and processes the RTP packet, and outputs and displays the call originating end to send The steps of the media data, specifically include:

    The call receiving end receives the video RTP packet sent by the call originating end, in a state in which the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call.

    The call receiving end parses the received video RTP packet, decompresses and decodes the picture or video after the parsing is completed, displays a picture or plays a video at the call receiving end, and is used to display the call initiation online. The shared video or the video shared by the call originating party.
14. The media data real-time transmission control system according to claim 9, wherein the preset call protocol comprises: a VoLTE protocol and a ViLTE protocol.
15. A storage medium, wherein the storage medium stores a media data real-time transmission control program, and the media data real-time transmission control program is executed by the processor as follows:

    The call originating end and the call receiving end establish a call by using a preset call protocol, and start a real-time transmission channel of the media data based on the RTP protocol;

    When the call originating end selects to send the media data to the call receiving end, the call originating end packs the media data into an RTP packet and sends the data to the call receiving end, so that when the call receiving end receives the RTP packet sent by the call originating end, the call receiving end The end parses and processes the RTP packet, and outputs and displays the media data sent by the call originating end.
16. The storage medium of claim 15, wherein the preset call protocol comprises: a VoLTE protocol and a ViLTE protocol.
17. The storage medium of claim 16, wherein the step of the call originating end and the call receiving end establishing a call by using a preset call protocol, and starting the real-time transmission channel of the media data based on the RTP protocol, specifically includes:

    When the preset call protocol is selected as the VoLTE protocol, the call originating end and the call receiving end establish a high-definition voice call through the VoLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol. Data real-time transmission channel;

    When the preset call protocol is selected as the ViLTE protocol, the call originating end and the call receiving end establish a high-definition video call through the ViLTE protocol, and enable the media between the call originating end and the call receiving end according to the RTP protocol. Data real-time transmission channel.
18. The storage medium of claim 17, wherein, when the call originating end selects to send the media data to the call receiving end, the step of the call originating end packaging the media data into an RTP packet and sending the data to the call receiving end comprises:

    After the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call, when the call originating end selects to share music to the call receiving end, the call originating end selects a song and then performs play music;

    When the music is in the playing process, the call originating end packs the audio media data into a voice RTP packet, and sends the voice RTP packet to the call receiving end in real time, so that the call receiving end receives the received location The voice RTP packet is parsed, and after the parsing is completed, the music in the voice RTP packet is outputted at the call receiving end, and the song shared by the call originating end is played online.
19. The storage medium of claim 17, wherein, when the call originating end selects to send the media data to the call receiving end, the step of the call originating end packaging the media data into an RTP packet and sending the data to the call receiving end comprises:

    After the call originating end and the call receiving end have established a high-definition voice call or a high-definition video call, when the call originating end selects to share the picture or video to the call receiving end, the call originating end adds a picture or Compress and encode after the video;

    After the picture or video is compressed and encoded, the call originating end packs the picture or video media data into a video RTP packet, and sends the video RTP packet to the call receiving end in real time, so that the call receiving end Parsing the received video RTP packet, decompressing and decoding the image or video after the parsing is completed, displaying a picture or playing a video on the call receiving end, and displaying the picture shared by the call originating end or The video shared by the call originating party is played online.
20. The storage medium of claim 15, wherein the RTP package comprises: a voice RTP packet, a video RTP packet, and a text RTP packet.