CN109963171B

CN109963171B - Multimedia information transmission method, transmission device and storage medium

Info

Publication number: CN109963171B
Application number: CN201711342139.4A
Authority: CN
Inventors: 范志兴
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2017-12-14
Filing date: 2017-12-14
Publication date: 2021-01-05
Anticipated expiration: 2037-12-14
Also published as: CN109963171A

Abstract

The embodiment of the invention discloses a multimedia information transmission method, transmission equipment and a storage medium. The multimedia information transmission method applied to the proxy server comprises the following steps: receiving a first request sent by a user terminal, wherein an address part of the first request carries first identification information of the proxy server, and the first request also carries predetermined information; acquiring second identification information according to the preset information, wherein the second identification information points to a multimedia server; replacing the first identification information in the first request with the second identification information and forming a second request; and writing the first multimedia information provided by the user terminal into the multimedia server based on the second request, or reading the second multimedia information from the multimedia server based on the second request and sending the second multimedia information to the user terminal.

Description

Multimedia information transmission method, transmission device and storage medium

Technical Field

The present invention relates to the field of internet technologies, and in particular, to a multimedia information transmission method, a transmission device, and a storage medium.

Background

The flow-free service is: the method avoids a business service of data traffic generated in the process of watching videos or listening audios and the like. To differentiate between users using a flow-exempt service and users using a non-flow-exempt service, a proxy server is introduced.

In the prior art, after receiving a request for accessing multimedia information sent by a client in a user terminal held by a user, a proxy server binds with a port of a server providing the multimedia information according to the request, obtains the multimedia information required by the user by sending the request to the port, and sends the obtained multimedia information to the user terminal.

On the first hand, if servers of different multimedia information need to bind different ports with the proxy server, obviously, the number of consumed ports of the proxy server is limited, the number of multimedia servers bound by the proxy server is small, the number of consumed ports is large, and the maintenance cost is high.

In the second aspect, if a plurality of multimedia servers adopt the same service protocol and may need to be connected to the same port of the proxy server, then under the condition that one proxy server has one port of the same type, some multimedia servers have to modify their internal application programs, which causes the problems of difficult port configuration of the proxy server, large application program modification of the multimedia server, and the like.

Disclosure of Invention

In view of the above, embodiments of the present invention are directed to a multimedia information transmission method, a transmission device and a storage medium, which at least partially solve the above problems.

In order to achieve the purpose, the technical scheme of the invention is realized as follows:

in a first aspect, an embodiment of the present invention provides a multimedia information transmission method, applied in a proxy server, including:

receiving a first request sent by a user terminal, wherein an address part of the first request carries first identification information of the proxy server, and the first request also carries predetermined information;

acquiring second identification information according to the preset information, wherein the second identification information points to a multimedia server;

replacing the first identification information in the first request with the second identification information and forming a second request;

and writing the first multimedia information provided by the user terminal into the multimedia server based on the second request, or reading the second multimedia information from the multimedia server based on the second request and sending the second multimedia information to the user terminal.

In a second aspect, an embodiment of the present invention provides a multimedia information transmission method, applied in a user terminal, including:

acquiring preset information of a multimedia server pointed by an operation instruction;

generating a first request of which the address part carries first identification information of the proxy server and simultaneously carries the predetermined information; the predetermined information is used for the proxy server to determine second identification information of a multimedia server accessed by the user terminal;

sending the first request;

sending first multimedia information to the proxy server based on the first request; or, receiving second multimedia information sent to the user terminal by the proxy server based on the first request; the first multimedia information is information written into the multimedia server by the user terminal, and the second multimedia information is multimedia information provided by the multimedia server.

In a third aspect, an embodiment of the present invention provides a multimedia information transmission method, applied in a multimedia system, including:

a user terminal sends a first request, wherein the address part of the first request carries first identification information of a proxy server, and the first request also carries predetermined information;

the proxy server receiving the first request;

the proxy server acquires second identification information according to the preset information;

the proxy server replaces the first identification information in the first request with the second identification information to form a second request, and sends the second request;

and the multimedia server receives the first multimedia information written based on the second request, or sends the second multimedia information to the user terminal through the proxy server based on the second request.

In a fourth aspect, an embodiment of the present invention provides a transmission device, where the transmission device is a proxy server, and the transmission device includes:

a first receiving unit, configured to receive a first request sent by a user terminal, where an address part of the first request carries first identification information of the proxy server, and the first request also carries predetermined information;

the first acquisition unit is used for acquiring second identification information according to the preset information, wherein the second identification information points to the multimedia server;

a replacing unit, configured to replace the first identification information in the first request with the second identification information and form a second request;

and the first transmission unit is used for writing the first multimedia information provided by the user terminal into the multimedia server based on the second request, or reading the second multimedia information from the multimedia server based on the second request and sending the second multimedia information to the user terminal.

In a fifth aspect, an embodiment of the present invention provides a transmission device, where the transmission device is a user terminal, and the transmission device includes:

the second acquisition unit is used for acquiring the preset information of the multimedia server pointed by the operation instruction;

a generating unit, configured to generate a first request, where an address portion carries first identification information of a proxy server and also carries the predetermined information; the predetermined information is used for the proxy server to determine second identification information of a multimedia server accessed by the user terminal;

a second transmission unit, configured to send the first request; sending first multimedia information to the proxy server based on the first request; or, receiving second multimedia information sent to the user terminal by the proxy server based on the first request; the first multimedia information is information written into the multimedia server by the user terminal, and the second multimedia information is multimedia information provided by the multimedia server

In a sixth aspect, an embodiment of the present invention provides a transmission device, including: a transceiver, a memory, a processor, and a computer program stored on the memory and executed by the processor;

the processor is connected with the transceiver and the memory respectively, and is configured to implement the multimedia information transmission method provided by one or more of the foregoing technical solutions by executing the computer program.

In a seventh aspect, an embodiment of the present invention provides a computer storage medium, where a computer program is stored in the computer storage medium; after being executed, the computer program can implement the multimedia information transmission method provided by one or more of the technical solutions.

The embodiment of the invention provides a multimedia information transmission method, transmission equipment and a storage medium, wherein a first request received by a proxy server not only carries own first identification information, but also carries predetermined information, the proxy server can obtain second identification information of a multimedia server which a user terminal wants to access according to the predetermined information, and replaces the first identification information in the first request with the second identification information to form a second request, and the second request can enable the proxy server to access the multimedia server which the user terminal wants to access, so that the first multimedia information provided by the user terminal can be written into a target multimedia server, or the second multimedia information stored in the target multimedia server is read out and sent to the user terminal. Obviously, at this time, since the second request directly carries the second identification information, the request is automatically routed to the multimedia server, and the proxy server does not need to access the multimedia server through the pre-bound port, one port can be used for access of multiple multimedia servers, and the problem of insufficient port number or conflict does not exist. Therefore, the technical problem of port conflict or insufficient port number in the prior art is solved. Meanwhile, the first request carries the predetermined information instead of the port address corresponding to the multimedia server program, and compared with the program modification, the program modification only carrying the predetermined information is smaller, so that the method has the characteristics of stronger compatibility with the prior art and simpler realization.

Drawings

Fig. 1 is a flowchart illustrating a first multimedia information transmission method according to an embodiment of the present invention;

fig. 2 is a schematic diagram illustrating obtaining of first second identification information according to an embodiment of the present invention;

fig. 3 is a schematic diagram illustrating acquisition of second identification information according to an embodiment of the present invention;

fig. 4 is a flowchart illustrating a second method for transmitting multimedia information according to an embodiment of the present invention;

fig. 5 is a flowchart illustrating a third method for transmitting multimedia information according to an embodiment of the present invention;

fig. 6 is a schematic structural diagram of a multimedia system according to an embodiment of the present invention;

fig. 7 is a flowchart illustrating a fourth method for transmitting multimedia information according to an embodiment of the present invention;

fig. 8 is a flowchart illustrating a fifth method for transmitting multimedia information according to an embodiment of the present invention;

fig. 9 is a flowchart illustrating a sixth method for transmitting multimedia information according to an embodiment of the present invention;

fig. 10 is a schematic structural diagram of a proxy server according to an embodiment of the present invention;

fig. 11 is a schematic structural diagram of a user terminal according to an embodiment of the present invention;

fig. 12 is a schematic structural diagram of a transmission device according to an embodiment of the present invention.

Detailed Description

The technical solution of the present invention is further described in detail with reference to the drawings and the specific embodiments of the specification.

As shown in fig. 1, the present embodiment provides a multimedia information transmission method applied in a proxy server, including:

step S110: receiving a first request sent by a user terminal, wherein an address part of the first request carries first identification information of the proxy server, and the first request also carries predetermined information;

step S120: acquiring second identification information according to the preset information, wherein the second identification information points to a multimedia server;

step S130: replacing the first identification information in the first request with the second identification information and forming a second request;

step S140: and writing the first multimedia information provided by the user terminal into the multimedia server based on the second request, or reading the second multimedia information from the multimedia server based on the second request and sending the second multimedia information to the user terminal.

The multimedia information provided by the present embodiment may be various types of multimedia information, such as video and/or audio. The server is a proxy server, which may be a relay device connected between the user terminal and the multimedia server. The user terminal may be a terminal device that requests multimedia information and outputs the multimedia information. The multimedia server can be a server which stores multimedia information and can provide the multimedia information.

For example, taking video as an example, different video providers may issue a video (APP), so that the APP is installed at a user terminal such as a mobile phone or a tablet computer, and a user can watch various videos by operating the APP. And the multimedia server may be the video server, and may store various videos accessed by the user. The proxy server is located between the user terminal and the multimedia server, the user server directly accesses the proxy server, the multimedia server directly issues the multimedia information to the proxy server, and the proxy server, as a transfer device, acquires the multimedia information to be accessed by the user terminal from the multimedia information and issues the acquired multimedia information to the user terminal.

In some embodiments, if the user terminal needs to access the multimedia server through the proxy server, the user terminal needs to submit various right authentication information to the proxy server, so that the proxy server performs right authentication on the user terminal after receiving the first request, and only after the right authentication is passed, the proxy server pulls the multimedia information from the multimedia server or establishes a connection with the multimedia server, and submits the multimedia information provided by the user terminal to the multimedia server.

In this embodiment, the first request may include: the request for obtaining multimedia information from the multimedia server may also include a server sending information to the multimedia server.

In this embodiment, after the first request is obtained, instead of directly initiating the request to the multimedia server by using the specific interface bound to the multimedia server, the second identification information of the multimedia server is obtained first, and then the first identification information in the first request is replaced by the second identification information to form a second request, where the second request may be a request for accessing the multimedia server. Upon a second request, the proxy server establishes a connection with the multimedia server, e.g., a Transmission Control Protocol (TCP) connection, and after the connection is established, the proxy server can relay multimedia information provided by the user terminal and/or the multimedia server using the connection.

For example, if the following is a first request: rtmp// bizid. flowproxy. myqcloud. com, where "flowproxy" is the first identification information, and the second request formed after replacement may be: rtmp// bizid. livepush. myqcloud. com. Wherein the "livepush" is the second identification information.

After replacing the first identification information in the first request with the second identification information, the proxy server may send the second request by using any one of the ports, and the request carries the second identification information and is automatically routed to the corresponding multimedia server, and after receiving the request, the corresponding multimedia server establishes a connection with the proxy server according to the request. After the connection is established, the proxy server establishes connection with both the user terminal and the multimedia server, and can relay multimedia information between the user terminal and the multimedia server. In this way, it is obvious that one port of the proxy server can be used for information interaction with a plurality of multimedia servers, and one port is not bound to each multimedia server, so that fewer ports are obviously needed. On the other hand, if different multimedia servers use the same service protocol, the same port of one server does not need to be contended, and the multimedia server does not need to modify the application provided by the multimedia server, so that the method has the characteristic of simple and convenient implementation.

There are various ways to obtain the second identifier, and several alternative ways are provided below:

alternatively, the step S120 may include:

-presenting a service identity from said first request;

and inquiring second identification information of the multimedia server according to the service identification.

In this embodiment, the first request carries a service identifier, and the service identifier may be used as a query index for querying the second identifier information locally by the proxy server or from a predetermined device. In this embodiment, the service identifier may be carried as a flow parameter of the first request. If the first request may be: rtmp// bizid. flowproxy. myqcloud. com, "bizid" is an example of a service identity.

In some embodiments, the proxy server is preconfigured with a corresponding relationship between the service identifier and the second identifier information, and can know the second identifier information of the multimedia server that the current user terminal needs to access according to the service identifier carried in the first request.

In other embodiments, as shown in fig. 2, the corresponding relationship between the service identifier and the second identifier is configured in a predetermined database, and after the proxy server receives the first request, the service identifier is extracted from the first request, an inquiry request carrying the service identifier is sent to the database, and second identifier information returned by the predetermined database based on the service identifier is received, so that the proxy server obtains the second identifier information.

The second option is: an address part in the first request carries the first identification information, and a parameter part of the first request carries the second identification information; wherein the address portion is to indicate a target node that receives the first request; the parameter part is used for indicating relevant parameters for responding to the first request. Since the address portion of the first request carries the first identification information, the first request will be routed to the proxy server naturally, but the parameter portion in the first request also carries the second identification information, so in step S120, the proxy server may extract the second identification information from the parameter portion. Then, in step S130, the second identification information extracted from the parameter portion is replaced with the first identification information located in the address portion. In this way, the proxy server does not need to query the second identification information locally or remotely, the proxy server and the database do not need to configure the corresponding relation between the service identification and the second identification channel in advance, and the first request directly sent by the client carries the second identification information, so that the acquisition of the second identification information is simplified.

Various stream parameters related to video streaming can be carried in the parameter portion, for example, the stream parameters may include: time parameter indicating the effective time of the video stream, authentication parameter for performing flow-free authentication, check parameter for performing flow parameter check, and the like. In this embodiment, the second identification information may be carried in a target uniform resource address (dx) field of the parameter portion, different parameters in the parameter portion are divided by using a divider, and the proxy server may extract the second identification information in the dx field according to field identifications of fields corresponding to the parameters. In some embodiments, the proxy server may obtain the second identification information through matching of regular expressions. Therefore, as shown in fig. 3, the step S120 may include: analyzing a parameter part of the first request, and extracting the second identification information from the parameter part; the step S130 may include: the first identification information in the first request is replaced with the second identification information.

Optionally, the step S130 may include: analyzing the first request sent according to RTMP, and determining a target stream uniform resource locator (tcURL) field in the first request;

replacing the tcURL field in the first request with the second identifying information.

In this embodiment, the first request may be an RTMP-based request, where a tcURL field in the request is a field carrying the first identification information, and in some embodiments, a tcURL field in the first request may be located by using a regular expression or the like, and then the content in the tcURL field is replaced with the second identification information determined in step S120.

In this embodiment, the tcURL field is a component of the aforementioned address portion. In some embodiments, the first request and the second request further comprise a protocol portion, which typically carries the communication protocol to which the request conforms. For example, if the first request is a first request:

tmp// bizid. flowproxy. myqcloud. com, the "rtmp" is the communication protocol followed.

Optionally, the method further comprises:

establishing a TCP connection with the user terminal;

performing RTMP handshake by using the TCP connection;

the step S110 may include: and after the RTMP handshake, receiving an RTMP public request or an RTMP play request which is sent by the user terminal and carries the first identification information.

And the first identification information is carried in the address part of the RTMP connection request. The proxy server can complete the previous contact with the proxy server through three-way handshake.

Further, the method further comprises:

establishing a TCP connection with the multimedia server;

performing RTMP handshake by using the TCP connection;

the second request is an RTMP public (Publish) request or an RMTP Play (Play) request carrying the second identification information.

In this embodiment, the proxy server is connected with the user terminal and the multimedia server through TCP, and the TCP connection has a characteristic of high stability. In this embodiment, the data transmitted between the user terminal and the multimedia server may be live data. The live broadcast data can be multimedia information acquired by the acquisition equipment on site and uploaded to the multimedia server in real time, and the multimedia server issues the live broadcast multimedia information to the corresponding live broadcast terminal in real time.

The RTMP public request is a request for requesting the user terminal to upload first multimedia information to a multimedia server based on the RTMP; the RTMP playing request is a request that the user terminal requests the second multimedia information from the multimedia server based on the RTMP.

In some embodiments, since there may be a plurality of user terminals accessing the media server through the proxy server, in this embodiment, for repeated establishment of TCP connections, in an embodiment of the present invention, the method further includes:

when the first request sent by a first user terminal is received, determining whether a TCP connection is established with the multimedia server based on the first request of a second user terminal and finishing RTMP handshake;

the S150 may include: and if the TCP connection is established with the multimedia server and RTMP handshake is completed based on the first request of the second user, sending an RTMP public request or an RTMP playing request carrying the second identification information to the multimedia server. In this way, it is clear that repeated establishment of the same TCP connection and repeated execution of the RTMP handshake can be avoided.

In some embodiments, the method further comprises:

determining whether the proxy server already caches the multimedia information accessed by the first request;

and if the proxy server caches the multimedia information accessed by the first request, sending the cached multimedia information to the user terminal.

For example, both the user terminal a and the user terminal B access the same multimedia information of the multimedia server 1, at this time, if the proxy server establishes a TCP connection with the multimedia server first and has pulled the multimedia information from the multimedia server 1 to be stored in the cache, in order to reduce information interaction between the proxy server and the multimedia server and reduce the time delay returned to the user terminal, in this embodiment, it is determined whether the multimedia information accessed by the first request is cached, and if the multimedia information is cached, the cached multimedia information is directly sent to the user terminal, which reduces information interaction between the proxy server and the multimedia server on one hand and reduces the time delay for transmitting the multimedia information to the user terminal on the other hand.

Further, the method further comprises: and recording the access information of the user terminal sending the first request. In this embodiment, the proxy server may record the first access request to form access information, and in this way, when the first request is subsequently received, it may be determined whether the current local multimedia information corresponding to the cache exists through matching of the first request and the access information, if so, the multimedia information corresponding to the cache exists, and the multimedia information is directly issued to the user terminal.

The first identification information may be a domain name or an IP address of the proxy server; likewise, the second identification information may also be a domain name or an IP address of the multimedia server. And if tmp// bizid, flowproxy, myqcloud, com, the first identification information is the domain name of the proxy server.

Therefore, optionally, the step S130 may include at least one of:

replacing the domain name of the proxy server in the first request with the domain name of the multimedia server;

replacing the network protocol IP address of the proxy server in the first request with the domain name of the multimedia server;

replacing the domain name of the proxy server in the first request with the IP address of the multimedia server;

replacing the IP address of the proxy server in the first request with the IP address of the multimedia server;

replacing the domain name of the proxy server in the first request with a target uniform resource address pointing to the multimedia server;

and replacing the IP address of the proxy server in the first request by using the target uniform resource address.

In this embodiment, the target uniform resource address may be: the multimedia information that the user terminal wants to access or the uniform resource address written in the storage path of the multimedia server. Therefore, the target uniform resource address points to the multimedia server which the user terminal needs to access, and points to a certain file or information of the multimedia server.

Therefore, in the embodiment of the present invention, the target uniform resource address may be used to replace the IP address or the domain name of the proxy server.

For example, the domain name of the proxy server is replaced with the domain name or IP address of the multimedia server, or the IP address of the proxy server is replaced with the domain name or IP address of the multimedia server. In summary, in this embodiment, after replacing the IP address or the domain name of the proxy server with the second identification information, a domain name that will be automatically routed to the multimedia server may be formed.

The step S150 further includes:

converting the first multimedia information in the first storage format into first multimedia information in a second storage format;

and sending the first multimedia information in the first storage format and the second storage format to the multimedia server based on the second request.

In this embodiment, the first multimedia information provided by the user terminal may be multimedia information in a single storage format, so that other user terminals may adopt the second storage format when acquiring the multimedia information from the multimedia server. In this embodiment, on one hand, the problem that other user terminals can not output the multimedia information in the second storage format due to format mismatch is avoided; on the other hand, the problem of large output time delay caused by temporary storage format conversion is avoided.

In this embodiment, the storage format may be a file format immediately or a communication protocol followed when multimedia information is transmitted. For example, the first storage format may be: a data format stored based on dynamic rate adaptive (HTTP live streaming, HLS) encoding; the second storage format may be: the stored data format is encoded based on Dynamic Adaptive Streaming Over Http (DASH) of hypertext transfer protocol (Http). For example, the storage format may further include: streaming media format (lash video, FLV). The second storage formats can be multiple, if the number of the second storage formats is N, the first multimedia information in the first storage format is converted into the first multimedia information in the N second storage formats, in this way, the same multimedia information is stored in the multimedia server in N +1 different storage formats, and if other user terminals access the first multimedia information, the multimedia server can directly select one storage format supported by the user terminal and send the selected one storage format to the corresponding user terminal.

As shown in fig. 4, the present embodiment provides a multimedia information transmission method, applied in a user terminal, including:

step S210: acquiring preset information of a multimedia server pointed by an operation instruction;

step S220: generating a first request of which the address part carries first identification information of the proxy server and simultaneously carries the predetermined information; the predetermined information is used for the proxy server to determine second identification information of a multimedia server accessed by the user terminal;

step S230: sending the first request;

step S240: sending first multimedia information to the proxy server based on the first request; or, receiving second multimedia information sent to the user terminal by the proxy server based on the first request; the first multimedia information is information written into the multimedia server by the user terminal, and the second multimedia information is multimedia information provided by the multimedia server.

The multimedia information transmission method provided by the embodiment is a method applied to a user terminal. In this embodiment, the user terminal may be a mobile terminal or a fixed terminal, and the like.

In step S210, the predetermined information pointing to the multimedia server is directly animated, where the predetermined information may be an IP address, a domain name, or a service identifier corresponding to the domain name or the IP address of the multimedia server that the user terminal needs to access.

In this embodiment, a first request is formed, the address part of the request carries the first identification information of the proxy server, and the predetermined information may be a field of the parameter part or a field after the protocol.

In step S230, the user terminal sends the first request, and the first request is automatically routed to the proxy server due to the first identification information of the proxy server directly carried by the address part; and after receiving the first request, the proxy server acquires the second identification information based on the predetermined information, and replaces the first identification information with the second identification information, so that the proxy server can perform information interaction with the multimedia server, and the multimedia information uploaded by the user terminal is stored in the multimedia server, or the multimedia information is acquired from the multimedia server and is issued to the user terminal.

Optionally, the step S210 may include: and acquiring a service identifier corresponding to the second identifier information. The service identifier may be used for the proxy server to locally or remotely query the second identification information, thereby obtaining the second identification information. The service identification can be directly extracted from the link address acted by the operation instruction. In other embodiments, the Application (APP) installed in the user terminal stores a service identifier of multimedia information that the APP itself will provide, so that the service identifier may be locally queried according to a link address of the multimedia information acted by the operation instruction.

In some embodiments, the operation instruction may be an operation instruction of a user input received from a human-computer interaction interface.

In other embodiments, the operation instruction may be a built-in instruction of the APP in an automatic play scene. For example, when a certain tv play is currently being played, generally, after an APP has played a episode, the APP automatically switches to playing the next episode, and the action of automatically playing the next episode is one of the automatic play instructions.

Optionally, the step S210 may include: and acquiring the second identification information of the multimedia server. Correspondingly, the step S230 may include: and sending the first request with the address part carrying the first identification information and the parameter part carrying the second identification information.

And directly reading the second identification information. For example, the user terminal displays a web page, where a link address of a certain multimedia information in the multimedia server is displayed on the web page, and the link address directly carries an IP address or a domain name of the multimedia server, so that the second identification information can be locally read out by acquiring the second identification information. In this embodiment, the predetermined information may be the second identification information directly, and in this case, the second identification information is carried in the parameter portion of the first request and is sent to the proxy server, and the proxy server may obtain the second identification information directly by analyzing the first request, which is simple and convenient to implement.

In some embodiments, the method further comprises: judging whether the user information of the user terminal meets a preset condition or not;

the step S210 may include: and when the preset condition is met, acquiring preset information pointing to the multimedia server.

For example, the user information may be a user identifier, and the user identifier may be a user name and a user account; and determining whether multimedia information transmission needs to be performed through a proxy server at present according to the user account, for example, if the user name or the user account indicates that the user is a streaming-free user, the preset condition may be considered to be met, so that the predetermined information needs to be acquired.

For another example, the user information may be user authority, and if the user authority indicates that the user is a flow-exempt user, the step S210 needs to be performed.

The method further comprises the following steps:

and when the user information does not meet the preset condition, sending a third request directly based on the IP address or the domain name of the multimedia server, wherein the address part of the third request directly carries the IP address or the domain name of the multimedia server, and the third request is directly routed to the multimedia server.

In some embodiments, the predetermined condition may include a bandwidth priority condition determination of whether the bandwidth is large, in addition to the condition determination of whether to exempt from streaming. If the bandwidth for data transmission between the user terminal and the multimedia server through the proxy server is a first bandwidth and the bandwidth between the user terminal and the multimedia server is a second bandwidth, the first bandwidth may be much larger than the second bandwidth.

Of course, the above is merely an example in which the predetermined condition is satisfied, and when the predetermined condition is implemented specifically, the present invention is not limited to any one of the above.

In some embodiments, the parameter part of the first request may further carry a storage format supported by the user terminal of the request, and the proxy server or the multimedia server issues the second multimedia information in the corresponding storage format to the user terminal based on the storage format carried by the parameter part, so as to avoid problems such as a playing error caused by the user terminal not supporting the corresponding storage format.

As shown in fig. 5, the present embodiment provides various multimedia information transmission methods, which are applied in a multimedia system, and include:

step S310: a user terminal sends a first request, wherein the address part of the first request carries first identification information of the proxy server, and the first request also carries predetermined information;

step S320: the proxy server receiving the first request;

step S330: the proxy server acquires second identification information according to the preset information;

step S340: the proxy server replaces the first identification information in the first request with the second identification information to form a second request, and sends the second request;

step S340: and the multimedia server receives the first multimedia information written based on the second request, or sends the second multimedia information to the user terminal through the proxy server based on the second request.

In this embodiment, a proxy server is introduced between the user terminal and the multimedia server, and the proxy server may establish a connection with the multimedia server that the user terminal wants to access through the replacement of the second identification information and the first identification information, and relay various information transmitted between the user terminal and the multimedia server, for example, the uploading of the first multimedia information and/or the issuing of the second multimedia information.

Optionally, the method further comprises:

the stream processing server receives first multimedia information uploaded by the proxy server;

the stream processing server converts the first multimedia information in a first storage format into first multimedia information in a plurality of second storage formats;

and the stream processing server sends the first multimedia information in the first storage format and the second storage format to the multimedia server based on the second request.

In this embodiment, the first multimedia information uploaded by the user terminal may be the first multimedia information in one storage format, and the other user terminals may request the multimedia information in other storage formats.

In this embodiment, a special stream processing server is introduced to perform conversion between different storage formats, so that a proxy service is not required to be responsible for conversion between different storage formats, thereby realizing independence of different server functions and reducing load of the proxy server.

Several specific examples are provided below in connection with any of the above embodiments:

example 1:

as shown in fig. 6, the present example provides a multimedia information system including:

a first type of client (APP) for providing live video; the client in this example may be a live client that is live.

A plug flow proxy server (one of the proxy servers) which is connected with the first type of client and receives the request sent by the first type of client; converting the request into a request of a multimedia information cloud; and sending the rtmp push flow of the first type of client to the multimedia information cloud based on the converted request. The rtmp push stream is a video stream which is transmitted based on rtmp protocol and pushed to the multimedia information cloud.

And the second type of client is used for pulling the live broadcast data from the multimedia information cloud to play. The multimedia information cloud can be a video cloud storing video or an audio cloud storing audio information.

And the stream pulling server (one of the proxy servers) is connected with the first class of clients, receives the request of the second class of clients, replaces the domain name of the second class of clients with the domain name of the multimedia information cloud, pulls the live video from the multimedia information cloud based on the riding cattle after the domain name replacement, and sends the live video to the second class of clients.

In the present embodiment, the multimedia information cloud is accessed through the proxy server regardless of the first type of client or the second type of client, and the multimedia information cloud herein corresponds to the aforementioned multimedia server. After receiving the request of the live broadcast client, the proxy server needs to replace the domain name or the IP address of the proxy server with the IP address or the domain name of the multimedia information cloud, so that the multimedia information cloud can be accessed, live broadcast videos reported by the first class of clients can be stored in the multimedia information cloud, and videos stored in the multimedia information cloud are sent to the second class of clients for the second class of clients to watch. In this example, the proxy server does not need to perform port binding with the multimedia information cloud, but generates a request that can be directly routed to the multimedia information cloud by domain name replacement, IP address replacement, or uniform resource address (URL) replacement in the request, so that obviously, the problem that the proxy server port is insufficient, different video servers need to adopt different ports, and video providers need to modify their own codes to implement port distinction and the like does not exist.

In the multimedia system, the proxy server for uploading the multimedia information and the server for sending the multimedia information are separately arranged, and in other embodiments, the proxy server and the server can be replaced by a server having both the push streaming function and the pull streaming function.

The data stream uploaded or distributed in fig. 5 is an RTMP-based data stream, and in a specific embodiment, may also be a data stream transmitted based on other protocols, and the data stream may be a video stream or an audio stream.

Example 2:

as shown in fig. 7, the present example provides a plug-flow method based on example 1, including:

and replacing the plug-flow domain name by the live APP running in the user terminal, taking the plug-flow domain name after replacement as the domain name 'flowproxy' of the proxy server, carrying the domain name of the video cloud in the flow parameter, and sending the RTMP request as a component of the parameter part.

The live app establishes a TCP connection with an RTMP dynamic reverse proxy server (one of the aforementioned proxy servers);

the live broadcast APP sends RTMP handshake messages C0 and C1 to the RTMP dynamic reverse proxy server;

the RTMP dynamic reverse proxy server sends RTMP handshake response S0, S1 to the live APP;

the live broadcast APP sends RTMP handshake response C2 to the RTMP dynamic reverse proxy server;

the RTMP dynamic reverse proxy server sends an RTMP handshake response S2 to the live APP;

the live broadcast APP sends an RTMP connect command to an RTMP dynamic reverse proxy server;

a live broadcast APP sends a public (publish) request to an RTMP dynamic reverse proxy server;

the RTMP dynamic reverse proxy server resolves the accessed target parameter dx field (the domain name or IP address of the video cloud) from the flow identification (Identity) parameter;

the RTMP dynamic reverse server establishes TCP connection with the video cloud;

the RTMP dynamic reverse proxy server sends RTMP handshake messages C0 and C1 to the video cloud;

the video cloud sends an RTMP handshake response S0, S1 to the RTMP dynamic reverse proxy server;

the video cloud sends an RTMP handshake response C2 to the RTMP dynamic reverse proxy server;

the video cloud sends an RTMP handshake answer S2;

the RTMP dynamic reverse proxy server sends an RTMP connection (connect) command to the video cloud;

the RTMP dynamic reverse proxy server sends an RTM (publish) command to the video cloud; the RTMP publish request is a domain name that has been replaced with a domain name, that is, a connection command that is replaced with a domain name of a video cloud.

After completing the connection establishment, the RTMP dynamic reverse proxy server continues to screw data forwarding. The data transmission path is: live APP and video cloud realize the transmission of RTMP data packet between video cloud and live APP. Live APP- > video cloud mainly includes uploaded multimedia information, and video cloud- > live APP mainly may include related parameters of multimedia information transmission, for example, a storage address, a storage path, or a URL where the video cloud stores the multimedia information uploaded by the live APP.

Example 3:

as shown in fig. 8, the present example provides a pull stream method based on example 1, including:

the method comprises the following steps that a live APP domain name resolution playing address running in a user terminal: myqcloud. liveplant. com; and sending http: // flowproxy. liveplay. com/? dx is the RTMP request of myqcloud, such that due to the domain name of the RTMP dynamic reverse proxy server carried directly by the address part, the RTMP request will be routed to the RTMP dynamic reverse proxy server.

After receiving the RTMP play request, the RTMP dynamic reverse proxy server analyzes a dx field and performs domain name replacement, and replaces the domain name of the address part with a domain name 'myqcloud' carried in the dx field, so that the RTMP play request which can be automatically routed to the corresponding multimedia information cloud is formed.

The RTMP dynamic reverse proxy server sends an RTMP playing request to a Content Distribution Network (CDN) service area device in the multimedia information cloud;

if the CDN server does not store the video stream of the live APP request, sending a source returning request from a Data Center (DC) to the CDN server to request the video stream of the live APP request; and if the DC does not store the video stream requested by the live APP, the DC sends a source return request to the stream processing module to request the video stream to the stream processing module. The DC pulls the video stream from the stream processing module, then stores the video stream and sends the video stream to the CDN server;

the CDN server sends the RTMP dynamic reverse proxy server after pulling the RTMP video stream, and the RTMP dynamic reverse proxy server sends the RTMP video stream to the live APP.

Example 4:

as shown in fig. 9, the present example provides another video streaming method based on the system of example 1, including:

a live broadcast APP resolves a domain name, and sends an RTPM request of which the address part carries the domain name of an RTMP dynamic reverse proxy server and carries a service identifier;

RTMP connection handshake is carried out between the live broadcast APP and the RTMP dynamic reverse proxy server;

RTMP handshake response is carried out between the live broadcast APP and the RTMP dynamic reverse proxy server;

the RTMP dynamic reverse proxy server receives an RTMP connection command of the live APP.

The RTMP dynamic reverse proxy server receives an RTMP request of a live APP, and the RTMP request can include: a Publish command to perform video stream push or a Play command to perform video stream Play;

the RTMP dynamic reverse proxy server analyzes the RTMP request, and replaces a tcURL field of an address part with a domain name of a video cloud corresponding to a service identifier;

a TCP connection is established between the RTMP dynamic reverse proxy server and the video cloud;

the RTMP dynamic reverse proxy server performs RTMP connection handshake with the video cloud;

RTMP handshake response is carried out between the RTMP dynamic reverse proxy server and the video cloud;

the RTMP dynamic reverse proxy server analyzes the RTMP public request/RTMP play request after domain name replacement;

and the RTMP dynamic reverse proxy server sends the RTMP video stream uploaded by the live APP to the video cloud, or sends the RTMP video stream delivered by the video cloud to the live APP.

Example 5:

the present example provides a multimedia information transmission method, which may include the steps of:

the first step is as follows: the live broadcast app plug-flow domain name is changed from the original bizid. live push. myqcloud. com to bizid. flowproxy. myqcloud. com (push-flow proxy server domain name);

the second step is that: the RTMP dynamic reverse proxy service receives an RTMP flow pushing request or a flow pulling request;

the third step: the proxy server and the live APP finish TCP handshake;

the fourth step: the RTMP handshake, for example, is performed by transmission of s0, s1, s 2.

The fifth step: the live app initiates an RTMP connection request;

and a sixth step: the proxy service receives the RTMP connection request;

the seventh step: a live broadcast APP initiates an RTMP public request or a play request;

the eighth step, the proxy server resolves the real accessed target uniform resource address from the stream parameter, and the parameter format can be as follows:

“flowrpdx＝UrlEncode(rpUrl)&rpSecret＝9661a47f85a4e7a56bcc0924bd0c6e24&rpTime＝56698ba6&rpToken＝9661a47f85a4&rpSecret＝9661a47f85a4e7a56bcc0924bd0c6e24”，

the ninth step: the RTMP of the proxy server is connected with a target uniform resource address of a real access multimedia server, and the target uniform resource address is replaced to the domain name or the IP address of the proxy server in the request sent by the proxy server and the user terminal to generate an access request for accessing the corresponding multimedia server.

The tenth step: after the agent server and the video cloud successfully establish RTM and P connection, if the RTM is a stream pushing service, the stream-free server forwards data pushed by a live APP to the video cloud, and if the RTM is a stream pulling service, the stream-free server forwards data issued by the video cloud to the APP.

As shown in fig. 10, the present embodiment provides a proxy server, including:

a first receiving unit 110, configured to receive a first request sent by a user terminal, where the first request carries first identification information of a proxy server;

a first obtaining unit 120, configured to obtain second identification information according to the predetermined information, where the second identification information points to a multimedia server;

a replacing unit 130, configured to replace the first identification information in the first request with the second identification information and form a second request;

a first transmission unit 140, configured to write the first multimedia information provided by the ue into the multimedia server based on the second request, or read the second multimedia information from the multimedia server based on the second request and send the second multimedia information to the ue.

The first receiving unit 110 and the first transmitting unit 140 may both correspond to a communication interface, and may be used for information interaction with a user terminal and a multimedia server.

The first obtaining unit 120 and the replacing unit 130 may correspond to a processor, and the processor may perform parsing in the request, replacing the identification information, and the like, so as to implement transmission of the multimedia information by using the replaced request.

Optionally, the first obtaining unit 120 is configured to provide a service identifier from the first request; and inquiring second identification information of the multimedia server according to the service identification.

After receiving the first request, the first obtaining unit 120 queries second identification information based on the service identifier, and replaces the first identification information of the address part in the first request with the second identification information, thereby generating a second request that can be automatically routed to the multimedia server.

Optionally, an address part in the first request carries the first identifier information, and a parameter part of the first request carries the second identifier information; the first obtaining unit 120 is specifically configured to extract the second identification information from the parameter part carried in the first request.

In this embodiment, the first request does not carry a service identifier, but directly carries second identifier information in the parameter portion, and the proxy server does not need to query the second identifier information, but directly extracts the second identifier information from the parameter portion of the first request to replace the first identifier information in the first request, so as to form a second request for accessing the multimedia server.

Optionally, the replacing unit 130 is specifically configured to parse the first request sent according to a real-time streaming media protocol RTMP, and determine a target stream uniform resource locator (tcURL) field in the first request; replacing the tcURL field in the first request with the second identifying information.

Optionally, the proxy server further includes:

the TCP connection unit is used for establishing transmission control protocol TCP connection with the user terminal; can correspond to the communication interface, can be used for setting up the TCP exercise level with the user terminal;

an RTMP processing unit, which is used for carrying out RTMP handshake by utilizing the TCP connection; for example, a three-way handshake based on RTMP is performed, thereby ensuring a stable connection of RTMP.

The first receiving unit 110 is specifically configured to receive, after the RTMP handshake, an RTMP public request or an RTMP play request that is sent by the user terminal and carries the first identification information.

Optionally, the TCP connection unit is further configured to establish a TCP connection with the multimedia server based on the second request; the RTMP processing unit is also used for carrying out RTMP handshake by utilizing the TCP connection; the second request is an RTMP public request or an RMTP playing request carrying the second identification information.

Further, the replacing unit 130 is specifically configured to perform at least one of the following:

Optionally, the proxy server further includes:

the stream processing unit is used for converting the first multimedia information in the first storage format into first multimedia information in a plurality of second storage formats; and sending the first multimedia information in the first storage format and the second storage format to the multimedia server based on the second request.

As shown in fig. 11, this embodiment further provides a transmission device, where the transmission device is a user terminal, and the transmission device includes:

a second obtaining unit 210, configured to obtain predetermined information of the multimedia server to which the operation instruction points;

a generating unit 220, configured to generate a first request whose address portion carries the first identification information of the proxy server and also carries the predetermined information; the predetermined information is used for the proxy server to determine second identification information of a multimedia server accessed by the user terminal;

a second transmission unit 230, configured to send the first request; sending first multimedia information to the proxy server based on the first request; or, receiving second multimedia information sent to the user terminal by the proxy server based on the first request; the first multimedia information is information written into the multimedia server by the user terminal, and the second multimedia information is multimedia information provided by the multimedia server.

The second obtaining unit 210, which may correspond to a processor, may obtain the predetermined information through resolution of a link address acted by an operation instruction, or may obtain the predetermined information based on a local query.

The generating unit 220 may also correspond to a processor, and may generate a first request that carries the first identification information at the same time in the address portion and carries the predetermined information at the predetermined location.

The second transmission unit 230, which may correspond to a communication interface, may be configured to transmit the first request and transmit the first multimedia information and the second multimedia information transmitted based on the first request.

Optionally, the second obtaining unit 210 may be specifically configured to obtain a service identifier corresponding to the second identifier information.

Optionally, the second obtaining unit 210 may be further configured to obtain the second identification information of the multimedia server; the second transmission unit 230 is specifically configured to send a first request that an address part carries the first identifier information and a parameter part carries the second identifier information.

As shown in fig. 12, the present embodiment provides a proxy server, including: a transceiver 310, a memory 320, a processor 330, and a computer program stored on the memory 320 and executed by the processor 330;

the processor 330 is respectively connected to the transceiver 310 and the memory 320, and is configured to implement one or more multimedia information transmission methods applied to a proxy server, or one or more multimedia information transmission methods applied to a user terminal, or one or more multimedia information transmission methods applied to a multimedia system by executing the computer program.

When the transmission device is the proxy server, at least one or more of the methods shown in fig. 1, 2, and 3 may be performed.

When the transmitting device is the user terminal, at least one or more of the methods shown in fig. 5 may be performed.

When the transmission device is a transmission system, one or more of the methods shown in fig. 7 to 9 may be performed.

The transceiver 310 may correspond to a wired interface or a wireless interface, and the wired interface may include: a cable or optical cable interface; the wireless interface may be a transceiver antenna, or the like.

The memory 320 may be various types of memory 320, and may include: random access memory 320, read only memory 320, or a hard disk, etc.

The processor 330 may be various types of processors 330, and may include: a central processor 330, a microprocessor 330, a digital signal processor 330, an application processor 330, a programmable array, or the like.

The processor 330 may be connected to the memory 320 and the transceiver 310 through a bus, for example, an integrated circuit bus (IIC), and may implement the multimedia information transmission method provided by one or more of the foregoing technical solutions by reading and executing the computer program located in the memory 320.

The number of the transceivers 310, the memory 320 and the processor 330 may be one or more.

The present embodiment provides a computer storage medium storing a computer program; the computer program, when executed, is capable of implementing one or more of the foregoing multimedia information transmission methods applied to the proxy server, or one or more of the foregoing multimedia information transmission methods applied to the user terminal, or one or more of the foregoing multimedia information transmission methods applied to the multimedia system

The storage medium in this embodiment may be: a mobile storage device, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes. Alternatively, the storage medium may be a non-transitory storage medium.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, all the functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may be separately used as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.

Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments.

The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.

Claims

1. A multimedia information transmission method is applied to a proxy server, and comprises the following steps:

receiving a first request sent by a user terminal;

wherein, the address part of the first request carries the first identification information of the proxy server, and the address part is used for indicating a target node receiving the first request;

wherein the first request also carries predetermined information; the predetermined information is second identification information carried by a parameter part of the first request, and the parameter part is used for indicating relevant parameters responding to the first request;

extracting the second identification information pointing to the multimedia server from the parameter part;

2. The method of claim 1,

the replacing the first identification information in the first request with the second identification information includes:

analyzing the first request sent according to a real-time streaming media protocol, and determining a target stream uniform resource positioning field in the first request;

replacing the target stream uniform resource locator field in the first request with the second identification information.

3. The method of claim 2,

the method further comprises the following steps:

establishing a transmission control protocol connection with the user terminal;

performing real-time streaming media protocol handshaking by using the transmission control protocol connection;

the receiving a first request sent by a user terminal includes:

and after the handshake of the real-time streaming media protocol, receiving a real-time streaming media protocol public request or an RTMP play request which is sent by the user terminal and carries the first identification information.

4. The method of claim 2,

the method further comprises the following steps:

establishing a transmission control protocol connection with the multimedia server based on the second request;

the second request is a real-time streaming media protocol open request or a real-time streaming media protocol play request carrying the second identification information.

5. The method of claim 1,

the replacing the first identification information in the first request with the second identification information and forming a second request includes at least one of:

replacing the network protocol address of the proxy server in the first request with the domain name of the multimedia server;

replacing the domain name of the proxy server in the first request with a network protocol address of the multimedia server;

replacing the IP address of the proxy server in the first request with a network protocol address of the multimedia server;

and replacing the network protocol address of the proxy server in the first request by using the target uniform resource address.

6. A multimedia information transmission method is applied to a user terminal, and comprises the following steps:

generating a first request of which the address part carries first identification information of the proxy server and simultaneously carries the predetermined information; wherein the address portion is to indicate a target node that receives the first request; the predetermined information is second identification information carried by a parameter part of the first request, and the parameter part is used for indicating relevant parameters responding to the first request;

sending the first request to enable the proxy server to extract the second identification information of the multimedia server from the parameter part, and replacing the first identification information in the first request with the second identification information to form a second request;

sending first multimedia information to the proxy server based on the first request; or, receiving second multimedia information sent to the user terminal by the proxy server based on the first request; the first multimedia information is information written into the multimedia server by the proxy server based on the second request, and the second multimedia information is multimedia information read from the multimedia server by the proxy server based on the second request.

7. A multimedia information transmission method is applied to a multimedia system and comprises the following steps:

a user terminal sends a first request;

the address part of the first request carries first identification information of a proxy server, and the address part is used for indicating a target node receiving the first request;

the proxy server receiving the first request;

the proxy server extracts the second identification information pointing to the multimedia server from the parameter part;

and the multimedia server receives the first multimedia information written based on the second request, or sends second multimedia information to the user terminal through the proxy server based on the second request.

8. The method of claim 7, further comprising:

the stream processing server converts the first multimedia information in the first storage format into first multimedia information converted into a second storage format;

9. A transmission apparatus, the transmission apparatus being a proxy server, comprising:

a first receiving unit, configured to receive a first request sent by a user terminal;

the first request also carries predetermined information, the predetermined information is second identification information carried by a parameter part of the first request, and the parameter part is used for indicating relevant parameters for responding to the first request;

a first obtaining unit, configured to extract the second identification information pointing to the multimedia server from the parameter portion;

10. A transmission device, the transmission device being a user terminal, comprising:

a generating unit, configured to generate a first request, where an address portion carries first identification information of a proxy server and also carries the predetermined information;

wherein the address portion is to indicate a target node that receives the first request; the predetermined information is second identification information carried by a parameter part of the first request, and the parameter part is used for indicating relevant parameters responding to the first request;

a second transmission unit, configured to send the first request, so that the proxy server extracts the second identification information of the multimedia server from the parameter portion, replaces the first identification information in the first request with the second identification information, and forms a second request; sending first multimedia information to the proxy server based on the first request; or, receiving second multimedia information sent to the user terminal by the proxy server based on the first request; the first multimedia information is information written into the multimedia server by the proxy server based on the second request, and the second multimedia information is multimedia information read from the multimedia server by the proxy server based on the second request.

11. A transmission apparatus, comprising: a transceiver, a memory, a processor, and a computer program stored on the memory and executed by the processor;

the processor is connected to the transceiver and the memory respectively, and is configured to implement the multimedia information transmission method provided in any one of the preceding claims 1 to 8 by executing the computer program.

12. A computer storage medium storing a computer program; the computer program, when executed, is capable of implementing the multimedia information transmission method as provided in any one of claims 1 to 8.