CN117176700A - Multimedia data conversion method, device and system, terminal equipment and network equipment - Google Patents

Multimedia data conversion method, device and system, terminal equipment and network equipment Download PDF

Info

Publication number
CN117176700A
CN117176700A CN202210591978.4A CN202210591978A CN117176700A CN 117176700 A CN117176700 A CN 117176700A CN 202210591978 A CN202210591978 A CN 202210591978A CN 117176700 A CN117176700 A CN 117176700A
Authority
CN
China
Prior art keywords
media
media type
terminal
information
called terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210591978.4A
Other languages
Chinese (zh)
Inventor
朱晓洁
马金兰
彭莉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Telecom Corp Ltd
Original Assignee
China Telecom Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Telecom Corp Ltd filed Critical China Telecom Corp Ltd
Priority to CN202210591978.4A priority Critical patent/CN117176700A/en
Publication of CN117176700A publication Critical patent/CN117176700A/en
Pending legal-status Critical Current

Links

Landscapes

  • Telephonic Communication Services (AREA)

Abstract

The disclosure relates to the technical field of communication, in particular to a method, a device and a system for converting multimedia data, terminal equipment, network equipment and a storage medium. The method comprises the following steps: receiving a first call request of a calling terminal; determining a corresponding convertible media type according to the calling terminal media type information, generating a second call request based on the convertible media type and sending the second call request to the called terminal; receiving second call response information fed back by the called terminal; and generating first call response information based on the called-end media type information and sending the first call response information to the calling terminal so as to construct a media conversion link between the calling terminal and the called terminal. The scheme of the present disclosure can construct a media conversion link between a calling terminal and a called terminal. So that the calling terminal and the called terminal can use the media conversion link established in the core network to communicate in real time by using different types of media data.

Description

Multimedia data conversion method, device and system, terminal equipment and network equipment
Technical Field
The present disclosure relates to the field of communication technologies, and in particular, to a multimedia data conversion method, a multimedia data conversion device, a multimedia data conversion system, a terminal device, a network device, and a storage medium.
Background
With the rapid development of mobile communication technology, 5G (5 th Generation Mobile Communication Technology, fifth generation mobile communication technology) has been able to be applied in various fields. However, existing mobile networks and standards only support two parties to communicate using the same media type, e.g., two parties to communication can conduct voice calls, video calls, and 5G-based high definition audio-video calls, etc. For some special groups, it is not supported that two parties communicate using different media types. International standards have no associated specifications that provide users with automatic conversion of communication media.
It should be noted that the information disclosed in the above background section is only for enhancing understanding of the background of the present disclosure and thus may include information that does not constitute prior art known to those of ordinary skill in the art.
Disclosure of Invention
An object of the present disclosure is to provide a multimedia data conversion method, a multimedia data conversion apparatus, a multimedia data conversion system, a terminal device, a network device, and a storage medium; and further overcomes, at least to some extent, the disadvantages due to the limitations and disadvantages of the related art.
Other features and advantages of the present disclosure will be apparent from the following detailed description, or may be learned in part by the practice of the disclosure.
According to a first aspect of the present disclosure, there is provided a multimedia data conversion method, comprising:
receiving a first call request of a calling terminal; the first call request comprises calling terminal media type information and called terminal identity information;
determining a corresponding convertible media type according to the calling terminal media type information, generating a second call request based on the convertible media type and sending the second call request to the called terminal;
receiving second call response information fed back by the called terminal; wherein the second call response information comprises called-end media type information;
and generating first call response information based on the called-end media type information and sending the first call response information to the calling terminal so as to construct a media conversion link between the calling terminal and the called terminal.
In an exemplary embodiment of the present disclosure, the determining a corresponding switchable media type according to the calling side media type information includes:
and inquiring a target database according to the identity information of the called terminal to determine the preset called terminal media type information of the called terminal so as to generate the second call request based on the preset called terminal media type information.
In an exemplary embodiment of the present disclosure, when the receiving the second call response information fed back by the called terminal, the method further includes:
establishing a media conversion corresponding relation according to the calling terminal media type information corresponding to the calling terminal and the called terminal media type corresponding to the called terminal; the media conversion corresponding relation comprises terminal identity information and media type information.
In an exemplary embodiment of the present disclosure, the method further comprises:
and receiving first media data of a calling terminal media type sent by the calling terminal, converting the first media data into second media data of a called terminal media type, and sending the second media data to the called terminal.
In an exemplary embodiment of the present disclosure, the method further comprises:
and receiving third media data of the called terminal media type sent by the called terminal, and converting the third media data into fourth media data of the calling terminal media type.
In an exemplary embodiment of the present disclosure, when the first media data, the second media data include real-time media data, non-real-time media data, the method further includes:
And when the data packet corresponding to the non-real-time media data does not meet the real-time media packing interval requirement, sending a preset white noise mute packet to keep the media conversion link alive.
In one exemplary embodiment of the present disclosure, the method includes:
receiving the first call request sent by the calling terminal through a core network; and sending the second call request to the called terminal through a core network.
According to a second aspect of the present disclosure, there is provided a multimedia data conversion apparatus comprising:
the call request receiving module is used for receiving a first call request of the calling terminal; the first call request comprises calling terminal media type information and called terminal identity information;
the call request processing module is used for determining a corresponding convertible media type according to the calling terminal media type information, generating a second call request based on the convertible media type and sending the second call request to the called terminal;
the response information receiving module is used for receiving second call response information fed back by the called terminal; wherein the second call response information comprises called-end media type information;
and the response information processing module is used for generating first call response information based on the called terminal media type information and sending the first call response information to the calling terminal so as to construct a media conversion link between the calling terminal and the called terminal.
According to a third aspect of the present disclosure, there is provided a network device comprising:
a processor; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to perform the above-described multimedia data conversion method via execution of the executable instructions.
According to a fourth aspect of the present disclosure, there is provided a storage medium having stored thereon a computer program which, when executed by a processor, implements a multimedia data conversion method as in any of the above embodiments.
According to a fifth aspect of the present disclosure, there is provided a multimedia data conversion method, comprising:
receiving a second call request; wherein the second call request includes: calling terminal identity information and convertible media types;
determining called-side media type information in response to the selection of the switchable media type;
and generating second call response information according to the called-end media type information and feeding back to a multimedia communication service system, wherein the multimedia communication service system is used for generating first call response information according to the second call response information and sending the first call response information to a calling terminal so as to construct a media conversion link between the first call response information and the calling terminal.
In an exemplary embodiment of the present disclosure, the method further comprises: and receiving and displaying the second media data of the called terminal media type.
In an exemplary embodiment of the present disclosure, the method further comprises: and collecting third media data of the called terminal media type and sending the third media data to the multimedia service system, so that the multimedia service system can convert the third media data into fourth media data of the calling terminal media type and send the fourth media data to the calling terminal.
According to a sixth aspect of the present disclosure, there is provided a multimedia data conversion apparatus comprising:
a terminal side call request receiving module for receiving a second call request; wherein the second call request includes: calling terminal identity information and convertible media types;
a request response module for determining called-side media type information in response to the selection of the switchable media type;
and the response information feedback module is used for generating second call response information according to the called-end media type information and feeding back the second call response information to the multimedia communication service system, and is used for generating first call response information according to the second call response information by the multimedia service system and sending the first call response information to the calling terminal so as to construct a media conversion link between the first call response information and the calling terminal.
According to a seventh aspect of the present disclosure, there is provided a terminal device comprising:
a processor; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to perform the above-described multimedia data conversion method applied to the terminal device via execution of the executable instructions.
According to an eighth aspect of the present disclosure, there is provided a storage medium having stored thereon a computer program which, when executed by a processor, implements a multimedia data conversion method as in any of the above embodiments.
According to a ninth aspect of the present disclosure, there is provided a multimedia data conversion system comprising:
a calling terminal for initiating a first call request; the first call request comprises calling terminal media type information and called terminal identity information;
the multimedia communication service system is used for receiving the first call request, determining a corresponding convertible media type according to the calling terminal media type information, generating a second call request based on the convertible media type and sending the second call request to the called terminal; receiving second call response information which is fed back by the called terminal and comprises called terminal media type information, generating first call response information based on the called terminal media type information, and sending the first call response information to the calling terminal so as to construct a media conversion link between the calling terminal and the called terminal;
And the called terminal is used for receiving the second call request, generating the second call response information based on the determined called terminal media type information and feeding back the second call response information to the multimedia communication service system.
In the method for converting multimedia data provided by an embodiment of the present disclosure, after receiving a first call request uploaded by a calling terminal through a core network, a corresponding convertible media type may be determined according to calling terminal media type information included in the first call request, and then a second call request may be generated based on the convertible media type and sent to the called terminal. Then, second call response information which is fed back by the called terminal and comprises called terminal media type information can be received; and generating first call response information based on the called terminal media type information and sending the first call response information to the calling terminal so as to construct a media conversion link between the calling terminal and the called terminal. So that the calling terminal and the called terminal can use the media conversion link established in the core network to communicate in real time by using different types of media data.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure. It will be apparent to those of ordinary skill in the art that the drawings in the following description are merely examples of the disclosure and that other drawings may be derived from them without undue effort.
Fig. 1 schematically illustrates a schematic diagram of a multimedia data conversion method applied to a network device in an exemplary embodiment of the present disclosure;
fig. 2 schematically illustrates a schematic diagram of a multimedia data conversion method applied to a terminal device in an exemplary embodiment of the present disclosure;
fig. 3 schematically illustrates a schematic diagram of a multimedia data conversion system in an exemplary embodiment of the present disclosure;
fig. 4 schematically illustrates a schematic diagram of timing interactions of a multimedia data conversion method in an exemplary embodiment of the present disclosure;
fig. 5 schematically illustrates a schematic diagram of a multimedia data conversion apparatus applied to a network device in an exemplary embodiment of the present disclosure;
fig. 6 schematically illustrates a schematic diagram of a multimedia data conversion apparatus applied to a terminal device in an exemplary embodiment of the present disclosure;
Fig. 7 schematically illustrates a schematic diagram of a network device in an exemplary embodiment of the present disclosure;
fig. 8 schematically illustrates a composition diagram of a terminal device in an exemplary embodiment of the present disclosure.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. However, the exemplary embodiments may be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus a repetitive description thereof will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software or in one or more hardware modules or integrated circuits or in different networks and/or processor devices and/or microcontroller devices.
In the related art, the existing mobile network and standard only support the communication of both parties by adopting the same media type, but do not support the automatic conversion between the media types such as text, voice, sign language video and the like.
In this exemplary embodiment, in order to solve the technical defects existing in the prior art, a multimedia data conversion method is provided first, which can be applied to real-time communication between users with special requirements such as aphasia/language disorder, aphasia/hearing disorder, blindness, etc. by adopting different media types. Referring to fig. 1, the multimedia data conversion method may specifically include:
step S11, receiving a first call request of a calling terminal; the first call request comprises calling terminal media type information and called terminal identity information;
step S12, determining the corresponding convertible media type according to the calling terminal media type information, generating a second call request based on the convertible media type and sending the second call request to the called terminal;
step S13, receiving second call response information fed back by the called terminal; wherein the second call response information comprises called-end media type information;
and step S14, generating first call response information based on the called terminal media type information and sending the first call response information to the calling terminal so as to construct a media conversion link between the calling terminal and the called terminal.
In the method for converting multimedia data provided in this example embodiment, after receiving a first call request uploaded by a calling terminal through a core network, a corresponding convertible media type may be determined according to calling terminal media type information included in the first call request, and then a second call request may be generated based on the convertible media type and sent to the called terminal. Then, second call response information which is fed back by the called terminal and comprises called terminal media type information can be received; and generating first call response information based on the called terminal media type information and sending the first call response information to the calling terminal so as to construct a media conversion link between the calling terminal and the called terminal. So that the calling terminal and the called terminal can use the media conversion link established in the core network to communicate in real time by using different types of media data.
Hereinafter, each step of the multimedia data conversion method in the present exemplary embodiment will be described in more detail with reference to the accompanying drawings and examples.
In step S11, a first call request of a calling terminal is received; the first call request comprises calling terminal media type information and called terminal identity information.
In this example embodiment, the above-described method may be performed by a multimedia service communication system; the multimedia service communication system may be arranged in a core network. For example, the calling terminal and the called terminal may be intelligent terminal devices, for example: and intelligent terminal equipment such as a mobile phone, a tablet personal computer, an intelligent bracelet, an intelligent watch and a computer. When a calling terminal initiates a first call request to a called terminal, a first core network accessed by the calling terminal receives the first call request, forwards the first call request to a multimedia service communication system, and processes the first call request by the multimedia service communication system. The first call request can be used as a media negotiation signaling from the calling terminal to the called terminal, and is used for negotiating usable and converted media types and formats with the called terminal; and establishes a communication link between the calling terminal and the called terminal. The first call request may include media type information of the calling terminal and identity information of the called terminal; the calling terminal media type information may be a media type selected by the calling terminal user. For example, for an impaired person, the media type of his choice may be text, or video for presenting sign language. Of course, in some exemplary embodiments of the present disclosure, the call request described above may also include other parameters based on existing protocols, such as caller identity information, IP information, key information, and so forth.
In step S12, a corresponding switchable media type is determined according to the calling side media type information, and a second call request is generated based on the switchable media type and sent to the called terminal.
In this example embodiment, for a multimedia service communication system, conversion mapping relationships corresponding to different media types may be stored locally. For example, one media type corresponds to at least one media type in a different format that can be converted. After receiving the first call request, the calling terminal media type information contained in the first call request can be firstly extracted, then the corresponding at least one convertible media type which can be converted is determined according to the calling terminal media type information, and a second call request is generated as negotiation signaling which can be identified and processed to the called terminal.
For example, the current calling side media type a, the corresponding switchable media type B, C, D, then a second call request is generated according to the switchable media type B, C, D and sent to the called terminal. For example, a second call request may be generated based on the switchable media type B, C, D, i.e. in a negotiation signaling, containing user selectable media types; and, in the negotiation signaling, the request information of three formats corresponding to the switchable media type B, C, D may be received. For example, the above-mentioned convertible media types are text format, video format, and audio format, respectively, and then a negotiation signaling may include request information in three formats; for example, the request information may be caller identification information such as telephone numbers, nicknames, names, etc. In addition, the calling side media type a may be included in the second call request.
Alternatively, in some exemplary embodiments, after determining the switchable media type B, C, D corresponding to the current calling end media type a, negotiation signaling of three different media formats may also be generated according to the switchable media type B, C, D, and sent to the called terminal synchronously, so that the called user may process the second call request in the interaction interface of the called terminal device.
When the specific media type usable by the user at the called terminal side is not determined, after the convertible media type corresponding to the media type of the calling terminal is determined, respectively sending a second call request to the called terminal in different convertible media formats, and displaying the second call request in different media formats in an interactive interface of the called terminal, for example, respectively displaying the second call request in text, audio and video synchronous directions, so that the user at the called terminal side can select the media type usable by the user according to actual conditions. For example, for a user with visual impairment, an audio format media type may be selected according to a second call request for audio playback; or, for the user with hearing impairment and without understanding to use sign language, selecting the media type in audio format as the called media type according to the second call request displayed by the text; alternatively, for users with hearing impairment, a media type in video sign language format may be selected based on a second call request for video sign language play.
Further, in some exemplary embodiments, the determining a corresponding switchable media type according to the calling side media type information includes:
and inquiring a target database according to the identity information of the called terminal to determine the preset called terminal media type information of the called terminal so as to generate the second call request based on the preset called terminal media type information.
In particular, for multimedia service communication systems, a target database may also be configured, which may store media type information pre-configured by a particular user; or may be media types commonly used by a particular user, as counted from historical call data. The identity information of the user, and corresponding media type information, may be stored in the target database. For example, after the multimedia service communication system receives a call request for a called terminal, the target database may be queried first according to identity information of the called terminal in the call request; if the target database is queried that the preset media type of the called terminal exists, a second call request can be sent to the called terminal in a corresponding media format according to the query result, so that the called terminal can directly process the call request. Or if the preset media type corresponding to the called terminal is not queried in the target database, determining the corresponding convertible media type according to the calling terminal media type, generating a second call request based on the convertible media type, and sending the second call request to the called terminal.
In step S13, receiving second call response information fed back by the called terminal; wherein the second call response information includes called-side media type information.
In this example embodiment, after the user at the called terminal agrees to make a call and selects a media type, the user at the called terminal determines the media type as the called terminal media type and feeds back the media type to the calling terminal. For the multimedia service communication system, the second call response information fed back by the called terminal can be received through the second core network accessed by the called terminal. Wherein, the acknowledgement information in the second call response information may be produced in the called-end media type. The second core network and the first core network may be the same core network; i.e. the calling terminal and the called terminal access the same core network.
Furthermore, in some exemplary embodiments, for a multimedia service communication system, when receiving the second call response information fed back by the called terminal, the method further includes: establishing a media conversion corresponding relation according to the calling terminal media type information corresponding to the calling terminal and the called terminal media type corresponding to the called terminal; the media conversion corresponding relation comprises terminal identity information and media type information. The established temporary media conversion correspondence may be used for format conversion of the media stream in a subsequent communication process.
In step S14, first call response information is generated based on the called-side media type information and is sent to the calling terminal, so as to construct a media conversion link between the calling terminal and the called terminal.
In this example embodiment, for the multimedia service communication system, the second call response information may be received, converted into a calling side media type used by the calling terminal, and the first call response information may be generated; the first call response information may include response confirmation information of the calling side media type. After the first call response information is issued to the calling terminal, the media type negotiation process can be completed, and a media conversion link between the calling terminal and the called terminal is established through a core network and a multimedia service communication system and is used as a real-time communication channel between the calling terminal and the called terminal.
In this example embodiment, the method may further include: and receiving first media data of a calling terminal media type sent by the calling terminal, converting the first media data into second media data of a called terminal media type, and sending the second media data to the called terminal.
In this example embodiment, the method may further include: and receiving third media data of the called terminal media type sent by the called terminal, and converting the third media data into fourth media data of the calling terminal media type.
Specifically, after the media type negotiation is successful and the media conversion link is established, the calling terminal and the called terminal can respectively send media data streams with corresponding formats to the opposite terminal. For example, the calling terminal may transmit first media data in the form of a calling-side media type and first transmit to the multimedia service communication system through the core network. The multimedia service communication system encodes the first media data, converts the first media data into second media data corresponding to the called terminal media type format, and sends the second media data to the called terminal, so that the second media data can be directly displayed at the called terminal. Similarly, the multimedia service communication system may receive the third media data in the called media type format sent by the called terminal to the calling terminal, and perform encoding and decoding and format conversion on the third media data, and convert the third media data into fourth media data in the calling media type format, so that the user at the calling terminal side may directly read the fourth media data at the calling terminal.
In some exemplary embodiments, when the first media data, the second media data comprise real-time media data, non-real-time media data, the method further comprises: and when the data packet corresponding to the non-real-time media data does not meet the real-time media packing interval requirement, sending a preset white noise mute packet to keep the media conversion link alive.
Specifically, when one end uses non-real-time media and the other end uses real-time media in the calling terminal and the called terminal; for example, the calling terminal adopts an audio format, and the called terminal adopts a text format; if the non-real-time media information is too little to meet the real-time media packing interval requirement, a preset white noise mute packet is sent to keep the real-time media channel alive and improve the hearing comfort of the user. For example, the preset packing interval is 20ms, and the called terminal adopts a text format for input, so that the input speed is slower; when the interval of the data packet of the text format data uploaded by the called terminal is greater than 20ms, the multimedia service communication system can send default white noise mute data to the calling terminal, so that the media conversion link between the calling terminal and the called terminal is kept in an active state.
In the present exemplary embodiment, a multimedia data conversion method applied to a terminal device is provided. Specifically, the method can be applied to the called side terminal equipment; referring to fig. 2, the method specifically may include:
step S21, receiving a second call request; wherein the second call request includes: calling terminal identity information and convertible media types;
step S22, the media type information of the called terminal is determined in response to the selection of the convertible media type;
step S23, generating second call response information according to the called terminal media type information and feeding back to the multimedia communication service system, wherein the multimedia service system is used for generating first call response information according to the second call response information and sending the first call response information to the calling terminal so as to construct a media conversion link between the first call response information and the calling terminal.
In this example embodiment, for the called terminal, a second call request issued by the multimedia service communication system in the core network may be received; the second call request is generated after the multimedia service communication system converts the first call request sent by the calling terminal.
After the called terminal receives the second call request, the second call request can be respectively displayed in a format of a convertible media type in an interactive interface of the called terminal. For example, when the convertible media type carried in the second call request includes text and audio format, specific information of the second call request may be displayed in text format in the interactive interface, for example, displaying the number, nickname, name, etc. of the calling terminal; meanwhile, the information such as the number, the nickname, the name and the like of the calling terminal can be played in an audio format. In addition, on the called terminal side, after the second call request is displayed in a video and text format, a confirmation control can be displayed in an interactive interface of the called terminal, and after the user clicks the confirmation button, the second call response information is uploaded to the multimedia service communication system; or after the second call request is played in the audio format, an audio data acquisition process can be activated to acquire voice data input by a user; for example, when acknowledgement information such as "acknowledgement", "consent" and the like input by the user is acquired, the second call response information is uploaded to the multimedia service communication system. Or, the option of displaying a plurality of media types in the interactive interface of the called terminal is also possible, and when the user selects a media type, the second call response information is uploaded to the multimedia service communication system. The second call response information may include a called-side media type selected by the user.
After receiving the second call response information uploaded by the called terminal, the multimedia service communication system can convert the second call response information into first call response information in a calling terminal media type format and send the first call response information to the calling terminal, and a media conversion link is constructed between the calling terminal and the called terminal.
Or in some embodiments, when the user refuses the current second call request at the called terminal side, the refusal response information containing the refusal information may also be uploaded to the multimedia service communication system.
In this example embodiment, the method may further include: and receiving and displaying the second media data of the called terminal media type.
Specifically, for the called terminal, after receiving the second media data of the called terminal media type issued by the multimedia service communication system, the second media data can be directly played and displayed on the called terminal.
In this example embodiment, the method may further include: and collecting third media data of the called terminal media type and sending the third media data to the multimedia service system, so that the multimedia service system can convert the third media data into fourth media data of the calling terminal media type and send the fourth media data to the calling terminal.
In particular, for the called terminal, after responding to the first call request of the calling terminal and establishing the media conversion link, third media data of the selected called-side media type can be transmitted to the multimedia service system. For example, the user may send a media stream in text, audio or video format at the called terminal. After receiving the third media data, the multimedia service system can encode the third media data, convert the third media data into fourth media data corresponding to the media type of the calling terminal, send the media stream to the calling terminal, and display and play the media stream at the calling terminal.
In some embodiments, for the calling terminal, an interactive interface may be provided, where the user may initiate the first call request to the called terminal through touch selection, voice input, and so on. For example, the user may input identity information such as the number, name, nickname, etc. of the called terminal in the interactive interface; and determining the media type of the calling terminal. For example, when the user initiates the first call request in text format, the text format may be determined to be the caller-side media type. The first call request is sent to the multimedia service system through the accessed core network, and the multimedia service system processes the first call request to generate a second call request, and the second call request is sent to the called terminal. After receiving the processed first call response information forwarded by the multimedia service system, the media stream data can be sent to the called terminal. At this time, the first call response information can be displayed and played on the calling terminal in the format of the calling terminal media type, so as to prompt the calling terminal side user to input information and perform real-time information interaction with the called terminal.
In some example implementations, referring to fig. 4, step 401. A user initiates a media type 1 based call request at a calling terminal side; step 402, transmitting a call request based on the call request of the media type 1 to a multimedia service communication system through a calling end core network; in the process, the media type 1 selected by the calling terminal is used as a designated format to transmit negotiation signaling; step 403, the multimedia service communication system may determine, according to a preset list of switchable media types, a switchable media type corresponding to the media type 1, for example, media types 2 and 3; completing media negotiation parameter conversion in the call request based on the media types 1, 2 and 3; step 404, step 405, the call request carrying media types 1, 2, 3 is sent to the called terminal through the called terminal core network. Step 406, the called user selects the local media type, such as media type 2, according to the need at the called terminal side; step 407, step 408, the called end core network accessed by the called terminal returns the call response carrying the media 2 to the multimedia service system; step 409, step 410, the multimedia service communication system converts the call response into a call response in a media type 1 format readable by the user at the calling terminal side, and sends the call response to the calling terminal through the calling terminal core network; and completing call establishment and establishing a media conversion link. Step 411, step 412, the calling terminal sends the media stream of the media type 1 to the multimedia service communication system through the calling terminal core network, and then the multimedia service communication system converts the media stream into the media stream of the media type 2 readable by the called terminal side user, thereby realizing the transmission of the media data of both parties by using the multimedia service communication system; the multimedia service communication system completes the identification and conversion of the media information of the media type 1 and the media type 2; each terminal device presents the received media information to the user. If the calling terminal and the called terminal use the same media type, for example, both media type 1, the multimedia service communication system may not perform format conversion on the media stream. When one end actively ends the real-time communication, the network resources of the currently established media conversion link can be recovered.
According to the multimedia data conversion method provided by the embodiment of the disclosure, through a multimedia service communication system deployed in a core network, a call request containing a calling terminal media type initiated by a calling terminal is received, the call request is processed, and a list of the calling terminal media type and the media type capable of being converted with each other is provided for a called terminal side user to select; after receiving call response information generated by the called terminal based on the selected called terminal media type, establishing a media conversion link between the calling terminal and the called terminal; after the media stream of the calling terminal media type sent by the calling terminal is converted into the media stream of the called terminal media type, the converted media stream is sent to the called terminal; similarly, the media stream of the called media type sent by the called terminal can be converted into the media stream of the calling media type and then sent to the calling terminal. The identification and conversion of the media information between the calling terminal and the called terminal are realized; the calling side and the called side can use different media types to conduct real-time information interaction without manual participation.
It is noted that the above-described figures are only schematic illustrations of processes involved in a method according to an exemplary embodiment of the invention, and are not intended to be limiting. It will be readily appreciated that the processes shown in the above figures do not indicate or limit the temporal order of these processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, for example, among a plurality of modules.
Further, referring to fig. 3, a multimedia data conversion system is provided, which may include a calling terminal 301, a multimedia communication service system 302, and a called terminal 303.
Calling terminal 301 may be configured to initiate a first call request; the first call request comprises calling terminal media type information and called terminal identity information.
The multimedia communication service system 302 may be configured to receive the first call request, determine a corresponding switchable media type according to the calling side media type information, generate a second call request based on the switchable media type, and send the second call request to the called terminal; and receiving second call response information which is fed back by the called terminal and comprises called terminal media type information, generating first call response information based on the called terminal media type information, and sending the first call response information to the calling terminal so as to construct a media conversion link between the calling terminal and the called terminal.
The called terminal 303 may be configured to receive the second call request, generate the second call response information based on the determined called-side media type information, and feed back the second call response information to the multimedia communication service system.
Specifically, the above-described multimedia data conversion system may be applied to the above-described multimedia data conversion method. The multimedia communication service system 302 may be deployed in a core network 304, and performs data interaction with the calling terminal 301 and the called terminal 303 through the core network 304. The multimedia communication service system 302 can include a media conversion control module, a media identification and conversion module. The media conversion control module can be responsible for managing media type lists such as text, voice, sign language video and the like which can be mutually converted; when a call request using the media type 1 initiated by a user at a calling terminal side is received, providing a list of the media type 1 plus the exchangeable media types for the user at a called terminal side to select; after receiving the response of the called terminal side user to select the media type, completing the media type negotiation program; and indicating the media identification and conversion module to complete the media type conversion of the calling and called users. In addition, the media recognition and conversion module can also be responsible for providing media recognition and encoding and decoding functions of media types which can be converted mutually, and completing recognition and conversion of media information between the calling terminal and the called terminal when receiving a media conversion instruction.
Further, referring to fig. 5, there is also provided a multimedia data conversion apparatus 50 in the embodiment of the present example, which may be disposed on a network device; the device comprises: a call request receiving module 501, a call request processing module 502, a response information receiving module 503, and a response information processing module 504. Wherein,
the call request receiving module 501 may be configured to receive a first call request from a calling terminal; the first call request comprises calling terminal media type information and called terminal identity information.
The call request processing module 502 may be configured to determine a corresponding switchable media type according to the calling side media type information, generate a second call request based on the switchable media type, and send the second call request to the called terminal.
The response information receiving module 503 may be configured to receive second call response information fed back by the called terminal; wherein the second call response information includes called-side media type information.
The response information processing module 504 may be configured to generate first call response information based on the called-side media type information, and send the first call response information to the calling terminal, so as to construct a media conversion link between the calling terminal and the called terminal.
In some exemplary embodiments, the call request processing module 502 may include:
and inquiring a target database according to the identity information of the called terminal to determine the preset called terminal media type information of the called terminal so as to generate the second call request based on the preset called terminal media type information.
In some exemplary embodiments, the apparatus 50 may further include: and the media conversion corresponding relation building module.
The media conversion corresponding relation establishing module may be configured to establish a media conversion corresponding relation according to the calling side media type information corresponding to the calling terminal and the called side media type corresponding to the called terminal when receiving the second call response information fed back by the called terminal; the media conversion corresponding relation comprises terminal identity information and media type information.
In some exemplary embodiments, the apparatus 50 may further include: and the first media stream data processing module.
The first media stream data processing module may be configured to receive first media data of a calling side media type sent by the calling terminal, convert the first media data into second media data of a called side media type, and send the second media data to the called terminal.
In some exemplary embodiments, the apparatus 50 may further include: and a second media stream data processing module.
The second media stream data processing module may be configured to receive third media data of the called media type sent by the called terminal, and convert the third media data into fourth media data of the calling media type.
In some exemplary embodiments, the apparatus 50 may further include: and a keep-alive processing module.
The keep-alive processing module may be configured to send a preset white noise mute packet to keep-alive the media conversion link when the data packet corresponding to the non-real-time media data does not meet the real-time media packing interval requirement when the first media data and the second media data include real-time media data and non-real-time media data.
In some exemplary embodiments, the first call request sent by the calling terminal is received through a core network; and sending the second call request to the called terminal through a core network.
Further, referring to fig. 6, in this exemplary embodiment, there is further provided a multimedia data conversion 60, which may be disposed on the terminal device; the device comprises: a terminal side call request receiving module 601, a request response module 602, and a response information feedback module 603. Wherein,
The terminal-side call request receiving module 601 may be configured to receive a second call request; wherein the second call request includes: calling terminal identity information, convertible media type.
The request response module 602 may be configured to determine called-side media type information in response to a selection of a switchable media type.
The response information feedback module 603 may be configured to generate second call response information according to the called media type information and feed back the second call response information to a multimedia service system, where the multimedia service system generates first call response information according to the second call response information and sends the first call response information to a calling terminal, so as to construct a media conversion link with the calling terminal.
In some exemplary embodiments, the apparatus 60 may further include: a media stream presentation module.
The media stream presentation module may be configured to receive and present second media data of the called-side media type.
In some exemplary embodiments, the apparatus 60 may further include: and the media stream acquisition module.
The media stream collection module may be configured to collect third media data of the called media type and send the third media data to the multimedia service system, so that the multimedia service system converts the third media data into fourth media data of the calling media type and sends the fourth media data to the calling terminal.
Further, referring to fig. 7, a network device 70 is also provided in the embodiment of the present example. The network device 70 may include: a processor 701 and a memory 702. Wherein; memory 702 is used to store executable instructions for the processor; the processor 701 is configured to perform the multimedia data conversion method applied to a network device described in the above embodiments via execution of the executable instructions.
The specific details of each module in the above-mentioned multimedia data conversion system, multimedia data conversion device, and network device are described in detail in the corresponding multimedia data conversion method, so that the details are not repeated here.
It should be noted that although in the above detailed description several modules or units of a device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit in accordance with embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into a plurality of modules or units to be embodied.
Fig. 8 shows a schematic diagram of a terminal device suitable for implementing an embodiment of the invention.
It should be noted that the terminal device 1000 shown in fig. 8 is only an example, and should not impose any limitation on the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 8, the terminal device 1000 includes a central processing unit (Central Processing Unit, CPU) 1001 that can perform various appropriate actions and processes according to a program stored in a Read-Only Memory (ROM) 1002 or a program loaded from a storage section 1008 into a random access Memory (Random Access Memory, RAM) 1003. In the RAM 1003, various programs and data required for system operation are also stored. The CPU 1001, ROM 1002, and RAM 1003 are connected to each other by a bus 1004. An Input/Output (I/O) interface 1005 is also connected to bus 1004.
The following components are connected to the I/O interface 1005: an input section 1006 including a keyboard, a mouse, and the like; an output portion 1007 including a Cathode Ray Tube (CRT), a liquid crystal display (Liquid Crystal Display, LCD), and a speaker; a storage portion 1008 including a hard disk or the like; and a communication section 1009 including a network interface card such as a LAN (Local Area Network ) card, a modem, or the like. The communication section 1009 performs communication processing via a network such as the internet. The drive 1010 is also connected to the I/O interface 1005 as needed. A removable medium 1011, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like, is installed on the drive 1010 as needed, so that a computer program read out therefrom is installed into the storage section 1008 as needed.
In particular, according to embodiments of the present application, the processes described below with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present application include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network via the communication portion 1009, and/or installed from the removable medium 1011. When executed by a Central Processing Unit (CPU) 1001, the computer program performs various functions defined in the system of the present application.
Specifically, the terminal device may be an intelligent mobile terminal device such as a mobile phone, a tablet computer or a notebook computer. Alternatively, the terminal device may be an intelligent terminal device such as a desktop computer.
It should be noted that, the computer readable medium shown in the embodiments of the present application may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-Only Memory (ROM), an erasable programmable read-Only Memory (Erasable Programmable Read Only Memory, EPROM), flash Memory, an optical fiber, a portable compact disc read-Only Memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present application, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units involved in the embodiments of the present invention may be implemented by software, or may be implemented by hardware, and the described units may also be provided in a processor. Wherein the names of the units do not constitute a limitation of the units themselves in some cases.
It should be noted that, as another aspect, the present application also provides a computer readable medium, which may be included in an electronic device; or may exist alone without being incorporated into the electronic device. The computer-readable medium carries one or more programs which, when executed by an electronic device, cause the electronic device to implement the methods described in the embodiments below. For example, the electronic device may implement the various steps shown in fig. 1 or fig. 2.
Furthermore, the above-described drawings are only schematic illustrations of processes included in the method according to the exemplary embodiment of the present application, and are not intended to be limiting. It will be readily appreciated that the processes shown in the above figures do not indicate or limit the temporal order of these processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, for example, among a plurality of modules.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (16)

1. A method for converting multimedia data, comprising:
receiving a first call request of a calling terminal; the first call request comprises calling terminal media type information and called terminal identity information;
determining a corresponding convertible media type according to the calling terminal media type information, generating a second call request based on the convertible media type and sending the second call request to the called terminal;
receiving second call response information fed back by the called terminal; wherein the second call response information comprises called-end media type information;
and generating first call response information based on the called-end media type information and sending the first call response information to the calling terminal so as to construct a media conversion link between the calling terminal and the called terminal.
2. The method of claim 1, wherein said determining a corresponding switchable media type based on said calling side media type information comprises:
And inquiring a target database according to the identity information of the called terminal to determine the preset called terminal media type information of the called terminal so as to generate the second call request based on the preset called terminal media type information.
3. The method for multimedia data conversion according to claim 1, wherein when receiving the second call response information fed back by the called terminal, the method further comprises:
establishing a media conversion corresponding relation according to the calling terminal media type information corresponding to the calling terminal and the called terminal media type corresponding to the called terminal; the media conversion corresponding relation comprises terminal identity information and media type information.
4. A multimedia data conversion method according to claim 1 or 3, characterized in that the method further comprises:
and receiving first media data of a calling terminal media type sent by the calling terminal, converting the first media data into second media data of a called terminal media type, and sending the second media data to the called terminal.
5. A multimedia data conversion method according to claim 1 or 3, characterized in that the method further comprises:
And receiving third media data of the called terminal media type sent by the called terminal, and converting the third media data into fourth media data of the calling terminal media type.
6. A method of multimedia data conversion according to claim 1 or 3, wherein when the first media data, second media data comprise real-time media data, non-real-time media data, the method further comprises:
and when the data packet corresponding to the non-real-time media data does not meet the real-time media packing interval requirement, sending a preset white noise mute packet to keep the media conversion link alive.
7. The method of multimedia data conversion according to claim 1, characterized in that the method comprises:
receiving the first call request sent by the calling terminal through a core network; and sending the second call request to the called terminal through a core network.
8. A method for converting multimedia data, comprising:
receiving a second call request; wherein the second call request includes: calling terminal identity information and convertible media types;
determining called-side media type information in response to the selection of the switchable media type;
And generating second call response information according to the called-end media type information and feeding back to a multimedia communication service system, wherein the multimedia communication service system is used for generating first call response information according to the second call response information and sending the first call response information to a calling terminal so as to construct a media conversion link between the first call response information and the calling terminal.
9. The method of multimedia data conversion according to claim 8, further comprising:
and receiving and displaying the second media data of the called terminal media type.
10. The method of multimedia data conversion according to claim 8, further comprising:
and collecting third media data of the called terminal media type and sending the third media data to the multimedia service system, so that the multimedia service system can convert the third media data into fourth media data of the calling terminal media type and send the fourth media data to the calling terminal.
11. A multimedia data conversion apparatus, comprising:
the call request receiving module is used for receiving a first call request of the calling terminal; the first call request comprises calling terminal media type information and called terminal identity information;
The call request processing module is used for determining a corresponding convertible media type according to the calling terminal media type information, generating a second call request based on the convertible media type and sending the second call request to the called terminal;
the response information receiving module is used for receiving second call response information fed back by the called terminal; wherein the second call response information comprises called-end media type information;
and the response information processing module is used for generating first call response information based on the called terminal media type information and sending the first call response information to the calling terminal so as to construct a media conversion link between the calling terminal and the called terminal.
12. A multimedia data conversion apparatus, comprising:
a terminal side call request receiving module for receiving a second call request; wherein the second call request includes: calling terminal identity information and convertible media types;
a request response module for determining called-side media type information in response to the selection of the switchable media type;
and the response information feedback module is used for generating second call response information according to the called-end media type information and feeding back the second call response information to the multimedia communication service system, and is used for generating first call response information according to the second call response information by the multimedia service system and sending the first call response information to the calling terminal so as to construct a media conversion link between the first call response information and the calling terminal.
13. A multimedia data conversion system, comprising:
a calling terminal for initiating a first call request; the first call request comprises calling terminal media type information and called terminal identity information;
the multimedia communication service system is used for receiving the first call request, determining a corresponding convertible media type according to the calling terminal media type information, generating a second call request based on the convertible media type and sending the second call request to the called terminal; receiving second call response information which is fed back by the called terminal and comprises called terminal media type information, generating first call response information based on the called terminal media type information, and sending the first call response information to the calling terminal so as to construct a media conversion link between the calling terminal and the called terminal;
and the called terminal is used for receiving the second call request, generating the second call response information based on the determined called terminal media type information and feeding back the second call response information to the multimedia communication service system.
14. A terminal device, comprising:
a processor; and
a memory for storing executable instructions of the processor;
Wherein the processor is configured to perform the multimedia data conversion method of any one of claims 8 to 10 via execution of the executable instructions.
15. A network device, comprising:
a processor; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to perform the multimedia data conversion method of any one of claims 1 to 7 via execution of the executable instructions.
16. A storage medium having stored thereon a computer program, which when executed by a processor implements the multimedia data conversion method of any of claims 1 to 7, or of claims 8 to 10.
CN202210591978.4A 2022-05-27 2022-05-27 Multimedia data conversion method, device and system, terminal equipment and network equipment Pending CN117176700A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210591978.4A CN117176700A (en) 2022-05-27 2022-05-27 Multimedia data conversion method, device and system, terminal equipment and network equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210591978.4A CN117176700A (en) 2022-05-27 2022-05-27 Multimedia data conversion method, device and system, terminal equipment and network equipment

Publications (1)

Publication Number Publication Date
CN117176700A true CN117176700A (en) 2023-12-05

Family

ID=88936255

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210591978.4A Pending CN117176700A (en) 2022-05-27 2022-05-27 Multimedia data conversion method, device and system, terminal equipment and network equipment

Country Status (1)

Country Link
CN (1) CN117176700A (en)

Similar Documents

Publication Publication Date Title
CN108055496B (en) Live broadcasting method and system for video conference
US20060094472A1 (en) Intelligent codec selection to optimize audio transmission in wireless communications
CN110536028B (en) Video color ring realization method, color ring platform, terminal and storage medium
JP2009514285A (en) Communication involving devices with different communication modes
CN110418098B (en) Method and device for starting video networking conference
CN109728994B (en) Call method, device and computer readable storage medium
US10313502B2 (en) Automatically delaying playback of a message
EP2924985A1 (en) Low-bit-rate video conference system and method, sending end device, and receiving end device
CN1984373B (en) System and method for providing multimedia contents in a communication system
CN112866488A (en) Video color ring back tone playing method, server and terminal
CN108322429B (en) Recording control method in real-time communication, real-time communication system and communication terminal
CN117176700A (en) Multimedia data conversion method, device and system, terminal equipment and network equipment
CN112291497B (en) Intelligent video customer service access method and device
US10818295B1 (en) Maintaining network connections
JPH08223294A (en) Method and device for displaying message designaed by caller
CN112804402A (en) Video color ring back tone display method and device
KR20040022738A (en) SMS system of internet visual phone
JP4925972B2 (en) Media application service system and media application service method
CN101166279A (en) Content transmission method and apparatus using video call
US20190372824A1 (en) Changing a communication session
KR100866786B1 (en) Personal mobile broadcasting service method and system thereof
CN112019791A (en) Multi-party audio and video call method and system based on education examination
CN112637676B (en) Multimedia file processing method, system, communication device and readable storage medium
KR100762085B1 (en) Method and system of automatically originating call in wireless communication network
JP2003023504A (en) Voice control method when distributing voice for image and voice for communication simultaneously

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination