CN117835005A

CN117835005A - Data transmission method, device, storage medium and electronic equipment

Info

Publication number: CN117835005A
Application number: CN202211193124.7A
Authority: CN
Inventors: 毛峻岭
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2022-09-28
Filing date: 2022-09-28
Publication date: 2024-04-05

Abstract

The application discloses a data transmission method, a data transmission device, a storage medium and electronic equipment. Wherein the method comprises the following steps: acquiring video receiving signaling transmitted by a first client and forwarded by a signaling server; responding to the video receiving signaling, determining a specified communication object from M target communication objects belonging to a signaling transmission channel, wherein the specified communication object is a communication object specified by a second client; transmitting video stream data to the first client under the condition that the communication object is designated as the second client; or, in the case that the communication object is designated as at least one media server of the N media servers, sending video stream data to the at least one media server, and forwarding the video stream data to the first client by the at least one media server; the method can be applied to the scenes such as cloud technology, automatic driving field and the like, and can also relate to the technologies such as data transmission, fault detection and the like. The application solves the technical problem of low data transmission efficiency.

Description

Data transmission method, device, storage medium and electronic equipment

Technical Field

The present invention relates to the field of computers, and in particular, to a data transmission method, a data transmission device, a storage medium, and an electronic device.

Background

In the context of data transmission, related art generally utilizes a uniformly scheduled media server to establish a channel for transmitting data;

however, in some scenes with strict requirements on low latency, the uniformly scheduled media server lacks certain pertinence, and cannot form higher adaptation with the object (such as the client) for transmitting data, and the channel established based on the media server cannot naturally provide efficient data transmission service, so that the data transmission efficiency is reduced, and thus the scenes with strict requirements on low latency cannot be satisfied. Therefore, there is a problem in that data transmission efficiency is low.

In view of the above problems, no effective solution has been proposed at present.

Disclosure of Invention

The embodiment of the application provides a data transmission method, a data transmission device, a storage medium and electronic equipment, so as to at least solve the technical problem of low data transmission efficiency.

According to an aspect of the embodiments of the present application, there is provided a data transmission method, including: acquiring a video receiving signaling transmitted by a first client and forwarded by a signaling server, wherein the video receiving signaling is used for requesting to receive video stream data of a second client, and the first client and the second client belong to a signaling transmission channel established by the signaling server; determining a designated communication object from M target communication objects belonging to the signaling transmission channel in response to the video receiving signaling, wherein the designated communication object is a communication object designated by the second client, and the M target communication objects comprise the second client and N media servers belonging to the signaling transmission channel; transmitting the video stream data to the first client when the specified communication target is the second client; or, if the specified communication object is at least one of the N media servers, transmitting the video stream data to the at least one media server, and transferring the video stream data to the first client by the at least one media server.

According to another aspect of an embodiment of the present application, there is provided a data transmission apparatus including: the system comprises an acquisition unit, a signaling server and a signaling server, wherein the acquisition unit is used for acquiring video receiving signaling transmitted by a first client and forwarded by the signaling server, wherein the video receiving signaling is used for requesting to receive video stream data of a second client, and the first client and the second client belong to a signaling transmission channel established by the signaling server; a determining unit, configured to determine, in response to the video reception signaling, a specified communication object from M target communication objects belonging to the signaling transmission channel, where the specified communication object is a communication object specified by the second client, and the M target communication objects include the second client and N media servers belonging to the signaling transmission channel; a transmitting unit configured to transmit the video stream data to the first client when the specified communication target is the second client; or, if the specified communication object is at least one of the N media servers, transmitting the video stream data to the at least one media server, and transferring the video stream data to the first client by the at least one media server.

As an alternative, the apparatus further includes: a first sending unit, configured to send, in response to the video reception signaling, a video push signaling to the at least one media server when a specified communication object is determined from M target communication objects belonging to the signaling transmission channel, where the video push signaling is used to request establishment of a video stream communication relationship among the at least one media server, the first client, and the second client; and the establishing device is used for establishing the video stream communication relationship under the condition of receiving the push stream confirmation signaling returned by the at least one media server after determining the appointed communication object from the M target communication objects belonging to the signaling transmission channel in response to the video receiving signaling.

As an alternative, the transmitting unit includes: and a second transmitting unit configured to transmit the video stream data to the at least one media server and to transfer the video stream data to the first client by the at least one media server when the specified communication object is the at least one media server and the video stream communication relationship is established.

As an alternative, the determining unit includes: an obtaining device, configured to obtain communication attribute information of each target communication object in the M target communication objects in response to the video receiving signaling; and a first determining unit configured to determine the specified communication object from the M target communication objects based on the communication attribute information, wherein the communication attribute information of the specified communication object satisfies a specified condition of the second client.

As an alternative, the determining device includes: and a determining sub-unit configured to determine, when the video reception signaling carries specified object information, the specified communication object from among the M target communication objects based on the specified object information and the communication attribute information, wherein the specified object information is specified by the first client as a communication object from among the M target communication objects.

As an alternative, the apparatus further includes: and the second determining device is used for accessing the second client into the signaling server before the video receiving signaling transmitted by the first client and forwarded by the signaling server is acquired, and determining that the second client belongs to the signaling transmission channel under the condition that the second client passes the authentication of the signaling server, wherein the target signaling in the signaling transmission channel is set to be transparently forwarded by the signaling server, and the target signaling comprises the video receiving signaling.

As an alternative, the apparatus further includes: a transmitting sub-device, configured to transmit, after the determining that the second client belongs to the signaling transmission channel, communication attribute information of the second client to the signaling server according to a preset period; and the deionization device is used for disconnecting the second client from the signaling transmission channel when the communication attribute information of the second client does not meet the available condition after the second client is determined to belong to the signaling transmission channel.

As an alternative, the apparatus further includes: and third determining means, configured to determine, in response to the video reception signaling, a first communication object and a second communication object from the M target communication objects after the video reception signaling transmitted by the first client and forwarded by the signaling server is acquired, where the first communication object is a communication object specified by the second client in a first transmission manner, the first transmission manner is a transmission manner in which the second client transmits data to the first client, the second communication object is a communication object specified by the second client in a second transmission manner, and the second transmission manner is a transmission manner in which the first client transmits data to the second client.

As an alternative, the apparatus further includes: a first receiving sub-device configured to, in response to the video reception signaling, determine a first communication object and a second communication object from the M target communication objects, and then receive data transmitted by the first client when a current transmission scheme is the second transmission scheme and the first communication object is the second client; or, the second receiving sub-device is configured to, after determining the first communication object and the second communication object from the M target communication objects in response to the video reception signaling, receive data transferred by the at least one target media server sent by the first client when the current transmission scheme is the second transmission scheme and the first communication object is at least one target media server of the N media servers.

As an alternative, the determining unit includes: fourth determining means for determining a target multicast media set in response to the video reception signaling, wherein the M target communication objects are divided into at least two multicast media sets, the multicast media set including at least two of the media servers, the at least two multicast media sets including the target multicast media set; fifth determining means for determining a media server in the target multicast media collection as the specified communication object.

According to yet another aspect of embodiments of the present application, there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the data transmission method as above.

According to still another aspect of the embodiments of the present application, there is further provided an electronic device including a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor executes the data transmission method described above through the computer program.

In the embodiment of the application, a video receiving signaling sent by a first client and forwarded by a signaling server is obtained, wherein the video receiving signaling is used for requesting to receive video stream data of a second client, and the first client and the second client belong to a signaling transmission channel established by the signaling server; responding to the video receiving signaling, determining a designated communication object from M target communication objects belonging to a signaling transmission channel, wherein the designated communication object is a communication object designated by a second client, and the M target communication objects comprise the second client and N media servers belonging to the signaling transmission channel, and M, N is a positive integer; transmitting video stream data to the first client under the condition that the communication object is designated as the second client; or, in the case that the communication object is designated as at least one media server of the N media servers, sending video stream data to the at least one media server, and forwarding the video stream data to the first client by the at least one media server;

By using the data transmission method, only the signaling servers, the clients and the media servers which are positioned in the same signaling transmission channel are allowed to perform signaling forwarding and data transmission, so that the purpose of limiting the number of data transmission modes is achieved; further, the second client responds to the video receiving signaling to determine a designated communication object for sending or forwarding video stream data from M target communication objects included in the signaling transmission channel, and the mode of targeted scheduling of the communication objects for data transmission is utilized to form the high adaptation between the target communication object and the second client, so that the aim of improving the adaptation degree between the second client and the target communication object is fulfilled; therefore, on the basis of limiting the data transmission mode in the signaling transmission channel, the second client terminal autonomously selects the exclusive and adaptive appointed communication object to perform data transmission, so that the purposes of improving the selection efficiency of the second client terminal and improving the overall transmission efficiency of the data are achieved, the technical effect of improving the data transmission efficiency is achieved, and the technical problem of lower data transmission efficiency is solved.

Drawings

The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute an undue limitation to the application. In the drawings:

FIG. 1 is a schematic illustration of an application environment of an alternative data transmission method according to an embodiment of the present application;

FIG. 2 is a schematic illustration of a flow of an alternative data transmission method according to an embodiment of the present application;

FIG. 3 is a schematic diagram of an alternative data transmission method according to an embodiment of the present application;

FIG. 4 is a schematic diagram of another alternative data transmission method according to an embodiment of the present application;

FIG. 5 is a schematic diagram of another alternative data transmission method according to an embodiment of the present application;

FIG. 6 is a schematic diagram of another alternative data transmission method according to an embodiment of the present application;

FIG. 7 is a schematic diagram of another alternative data transmission method according to an embodiment of the present application;

FIG. 8 is a schematic diagram of another alternative data transmission method according to an embodiment of the present application;

FIG. 9 is a schematic diagram of another alternative data transmission method according to an embodiment of the present application;

FIG. 10 is a schematic diagram of another alternative data transmission method according to an embodiment of the present application;

FIG. 11 is a schematic diagram of another alternative data transmission method according to an embodiment of the present application;

FIG. 12 is a schematic diagram of an alternative data transmission device according to an embodiment of the present application;

fig. 13 is a schematic structural view of an alternative electronic device according to an embodiment of the present application.

Detailed Description

In order to make the present application solution better understood by those skilled in the art, the following description will be made in detail and with reference to the accompanying drawings in the embodiments of the present application, it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, shall fall within the scope of the present application.

It should be noted that the terms "first," "second," and the like in the description and claims of the present application and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that embodiments of the present application described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

For ease of understanding, the following terms are explained:

cloud technology (Cloud technology) refers to a hosting technology for integrating hardware, software, network and other series resources in a wide area network or a local area network to realize calculation, storage, processing and sharing of data.

Cloud technology (Cloud technology) is based on the general terms of network technology, information technology, integration technology, management platform technology, application technology and the like applied by Cloud computing business models, and can form a resource pool, so that the Cloud computing business model is flexible and convenient as required. Cloud computing technology will become an important support. Background services of technical networking systems require a large amount of computing, storage resources, such as video websites, picture-like websites, and more portals. Along with the high development and application of the internet industry, each article possibly has an own identification mark in the future, the identification mark needs to be transmitted to a background system for logic processing, data with different levels can be processed separately, and various industry data needs strong system rear shield support and can be realized only through cloud computing.

Cloud conferencing is an efficient, convenient, low-cost form of conferencing based on cloud computing technology. The user can rapidly and efficiently share voice, data files and videos with all groups and clients in the world synchronously by simply and easily operating through an internet interface, and the user is helped by a cloud conference service provider to operate through complex technologies such as data transmission, processing and the like in the conference.

At present, domestic cloud conference mainly focuses on service contents mainly in a SaaS (Software as a Service ) mode, including service forms of telephone, network, video and the like, and video conference based on cloud computing is called as a cloud conference.

In the cloud conference era, the transmission, processing and storage of data are all processed by the computer resources of video conference factories, and users can carry out efficient remote conferences without purchasing expensive hardware and installing complicated software.

The cloud conference system supports the dynamic cluster deployment of multiple servers, provides multiple high-performance servers, and greatly improves conference stability, safety and usability. In recent years, video conferences have been widely used in various fields because of their ability to greatly improve communication efficiency, continuously reduce communication costs, and bring about an upgrade in the level of internal management. Undoubtedly, the video conference has stronger attraction in convenience, rapidness and usability after the cloud computing is applied, and the video conference application is required to be stimulated.

According to an aspect of the embodiments of the present application, there is provided a data transmission method, optionally, as an alternative implementation, the above data transmission method may be applied, but not limited to, in the environment shown in fig. 1. Which may include, but is not limited to, a user device 102 and a server 112, which may include, but is not limited to, a display 104, a processor 106, and a memory 108, the server 112 including a database 114 and a processing engine 116.

The specific process comprises the following steps:

step S102, the user equipment 102 obtains a video receiving signaling triggered by the target client, where the video receiving signaling triggered by the target client is used to indicate data transmission in the driving process of the unmanned carrier 118;

step S104-S106, the video receiving signaling triggered by the target client is sent to the server 112 through the network 110;

step S108-S112, the server 112 responds to the video receiving signaling triggered by the target client through the processing engine, determines a specified communication object from M target communication objects belonging to the signaling transmission channel, and carries out data transmission based on the specified communication object of the target client, wherein M is a positive integer;

steps S110-S112, the data transmission mode is sent to the user equipment 102 through the network 110, the user equipment 102 uses the data transmission mode to perform data transmission through the processor 106, and the data transmission result is displayed on the display 104, and the information about the data transmission mode is stored in the memory 108.

In addition to the example shown in fig. 1, the above steps may be performed by the client or the server independently, or by the client and the server cooperatively, such as the steps of determining the specified communication object from the M target communication objects belonging to the signaling transmission channel, performing data transmission based on the specified communication object, and the like, performed by the user equipment 102, thereby reducing the processing pressure of the server 112. The user device 102 includes, but is not limited to, a handheld device (e.g., a mobile phone), a notebook computer, a desktop computer, a vehicle-mounted device, etc., and the present application is not limited to a particular implementation of the user device 102.

Optionally, as an alternative embodiment, as shown in fig. 2, the data transmission method includes:

step S202, obtaining a video receiving signaling transmitted by a first client and forwarded by a signaling server, wherein the video receiving signaling is used for requesting to receive video stream data of a second client, and the first client and the second client belong to a signaling transmission channel established by the signaling server;

step S204, responding to the video receiving signaling, determining a designated communication object from M target communication objects belonging to a signaling transmission channel, wherein the designated communication object is a communication object designated by a second client, and the M target communication objects comprise the second client and N media servers belonging to the signaling transmission channel, and M, N is a positive integer;

step S206, in the case that the appointed communication object is the second client, sending video stream data to the first client; or, in the case that the communication object is designated as at least one media server of the N media servers, transmitting the video stream data to the at least one media server, and forwarding the video stream data to the first client by the at least one media server.

Alternatively, in this embodiment, the above-mentioned data transmission method may be, but not limited to, applied in a live network scenario. In a network live broadcast scene, under the condition of a large number of audiences, the situation of live broadcast video jamming often occurs. For the above-mentioned problems, in the prior art, a plurality of selectable play lines are often set for live data stream push, where play definitions corresponding to different play lines. However, the above-mentioned broadcasting lines are only one relief mode when the traffic of the live broadcasting room is too large, and the audience side can only select one of the broadcasting lines to be selected, so, on one hand, the audience side cannot autonomously determine the transmission path of the live broadcasting data, on the other hand, under the condition of numerous people, the broadcasting lines are all congested, and the problem of low transmission efficiency of the live broadcasting data cannot be effectively solved.

By using the data transmission method, responding to the video receiving signaling triggered by the first client corresponding to the anchor side in the live broadcast scene, determining a designated communication object by the second client corresponding to the audience side from M target communication objects belonging to the signaling transmission channel, wherein the designated communication object is the communication object designated by the second client, the M target communication objects comprise the second client and N media servers belonging to the signaling transmission channel, and M, N is a positive integer; therefore, the second target client corresponding to the audience side can autonomously select the appointed communication object for forwarding the data, the appointed communication object determination standard can be, but is not limited to, minimum in number of users, nearest to the target client and the like, and further video stream data transmission is performed based on the appointed communication object, so that the effect of improving the live broadcast data transmission efficiency is achieved, and the problem of low live broadcast data transmission efficiency is solved.

Alternatively, in the present embodiment, the above-described data transmission method may be applied, but not limited to, in an unmanned scene. Under a full-automatic unmanned situation, the unmanned vehicle collects the environmental information inside and outside the vehicle through the sensor, processes the collected data, realizes detection and identification of the vehicle and the environment, and simultaneously realizes normal running of the unmanned vehicle by acquiring control instructions corresponding to the environmental information inside and outside the current vehicle. The unmanned vehicle may, but is not limited to, encapsulate the obtained in-vehicle environment information and the control instruction request in a video stream format by a client node in the unmanned vehicle, transmit the video stream to a server node, the server node is configured to parse the video stream, generate a corresponding control instruction based on the in-vehicle environment information and the control instruction request indicated by the video stream, and transmit the control instruction to the client node of the unmanned vehicle, where the control instruction is configured to instruct the unmanned vehicle to perform a control operation.

It should be noted that, in the unmanned scene, the accuracy requirement on data transmission is extremely high, the efficiency requirement on data transmission is more strict, and the transmitted data can be ensured to be the data required in the current unmanned scene only on the premise of ensuring low time delay of the transmitted data.

Optionally, in the unmanned scenario, the client node in the unmanned vehicle may include, but is not limited to, a perception module, a planning module, a transmission module, and a control module, wherein the perception module may include, but is not limited to, a recognition module for recognizing road conditions and perceiving surrounding environments, the planning module may include, but is not limited to, a designated communication object (including a media server and a client in a signaling transmission channel) used for designating data stream transmission, may include, but is not limited to, a dedicated transmission manner for determining data stream transmission, the transmission module may include, but is not limited to, a transmission target video stream, and the target video stream may include, but is not limited to, a request for indicating road condition environment information and a target instruction.

Further by way of example, as shown in fig. 3, the above data transmission method is applied in an unmanned scenario, where a client node a in an unmanned vehicle includes a planning module a, a sensing module B, a control module C, and a transmission module d, and a server node B is configured to receive a video stream transmitted by the client node a, and respond to a request transmission target instruction of the client node a, and a media node C is a media node to be selected, which specifically includes the following steps:

Step S302, obtaining a media node: a planning module a in the client node A acquires a plurality of media nodes (including the media node C) to be selected, determines a dedicated media node C for transmitting the data stream from the media nodes, and further determines a specific transmission channel for transmitting the data stream;

step S304, obtaining road condition environment information: the sensing module b in the client node A acquires road condition and environment information including the road condition information and the environment information inside and outside the unmanned vehicle;

step S306, generating a target video stream: a control module c in the client node A generates a target video stream based on the road condition environment information and target instruction request information, wherein the target video stream is transmitted to the server node B by the client node A, and the target instruction request is used for the client node A to request the server node B to acquire a target instruction corresponding to the current road condition environment information;

steps S308 to S310, transmitting the target video stream: the transmission module d in the client node A transmits a target video stream to the server node B based on the exclusive media node and the specific exclusive channel, wherein the target video stream comprises current road condition environment information and a target instruction request;

step S312, analyzing the target video stream to generate a target instruction: the server node B receives and analyzes the target video stream, and generates a target instruction based on road condition environment information indicated by the target video stream and a target instruction request, wherein the target instruction is used for indicating an unmanned vehicle in which the client node A is positioned to execute corresponding target control operation;

Step S314-316, transmitting a target instruction: the server node B transmits a target instruction to the client node A based on the exclusive media node and the specific exclusive channel;

step S318, performing a target control operation: the control module c in the client node a instructs the unmanned vehicle in which the client node a is located to perform a corresponding target control operation based on the received target instruction.

By using the data transmission method, the specified communication objects are determined from M target communication objects belonging to the signaling transmission channel in response to the video receiving signaling triggered by the target client in the unmanned vehicle, and the data transmission mode is determined based on the specified communication objects, so that the purpose of providing an efficient dedicated data transmission channel for the media server and the data transmission object in the unmanned scene is achieved, and the effect of providing efficient data transmission service under the condition of ensuring low data transmission time delay is achieved.

Optionally, in this embodiment, the above data transmission method may be but not limited to being applied in a data transmission system, as shown in fig. 4, where the data transmission system 402 may be but not limited to including a signaling server module 404, a client node module 406, and a media node module 408, where the signaling server module 404 may be but not limited to be used to provide a signaling transmission channel for a client node, a media node, and the like, where access may perform signaling forwarding and data transmission between a client node and a media node in the same signaling transmission channel, and where no dedicated channel is accessed between a client node and a media node that does not allow signaling forwarding or data transmission; the client node module 406 may be used, but is not limited to, for initiating data transmission requests, and may be used, but is not limited to, for receiving, responding to data transmission requests; the media node module 408 may be, but is not limited to, configured to send or forward data in response to a data transmission request from a client node, and may be, but is not limited to, an access multicast network to enable efficient video multicast forwarding between multiple media nodes.

Optionally, in this embodiment, the first client may be, but not limited to, configured to send video reception signaling to the signaling server, where the video reception signaling may be, but not limited to, configured to request video stream data of the second client, and the second client may be, but not limited to, configured to send the video stream data to the first client or the media server in response to the video forwarding signaling.

Optionally, in this embodiment, the signaling transmission channel may be, but not limited to, established by a signaling server, and the signaling service channel may include, but not limited to, a signaling server, a first client, a second client, and N media servers, where the media servers may be, but not limited to, used to forward video stream data sent by the second client to the first client, and N is a positive integer.

It should be noted that, before obtaining the video receiving signaling sent by the first client and forwarded by the signaling server, the method further includes: and accessing the first client to the signaling server, and determining that the first client belongs to the signaling transmission channel under the condition that the first client passes the authentication of the signaling server.

It should be noted that the signaling transmission channel may be, but not limited to, established by a signaling server, and the signaling server is connected to the signaling transmission channel after the signaling server establishes the signaling transmission channel.

Before obtaining the video receiving signaling sent by the first client and forwarded by the signaling server, the method further comprises: and accessing the second client into the signaling server, and determining that the second client belongs to the signaling transmission channel under the condition that the second client passes the authentication of the signaling server.

Optionally, in this embodiment, signaling forwarding and data transmission are allowed between the signaling servers, clients, and media servers in the same signaling transmission channel, while signaling forwarding and data transmission are not allowed between the signaling servers, clients, and media servers that are not in the same signaling transmission channel. Therefore, the number of data transmission modes is limited, the autonomous selection efficiency of the client is improved, and the overall transmission efficiency of video stream data is further improved.

Alternatively, in this embodiment, the signaling server may be, but is not limited to being only responsible for signaling forwarding and authority verification, and not responsible for specific signaling logic processing, for example, the signaling server does not need to parse and logically process signaling, and does not take charge of scheduling and management of the media server. Compared with the prior art, the signaling server is responsible for analyzing and logically processing the signaling and carrying out scheduling processing of a media service link, the problem of single-point processing bottleneck exists, the flexible deployment and management of the media service are dependent on the registration of the signaling server, a large number of states are required to be synchronized with the signaling server, and the problem that the media service is not suitable for being independently deployed outside in many times exists.

It should be noted that the signaling server does not need to analyze and logically process the signaling, and does not bear the scheduling and management of the media server, thus freeing the processing of the signaling server, further achieving the purpose of solving the single-point processing bottleneck and inflexible deployment of the media server in the prior art, and further achieving the effect of improving the data transmission efficiency.

Optionally, in this embodiment, the second client may determine, but not limited to, a specified communication object from M target communication objects in response to the video reception signaling, where the specified communication object may be, but not limited to, a communication object specified for the second client, and may be, but not limited to, video stream data of the second client for sending or forwarding a video reception signaling corresponding request.

It should be noted that the specified communication object may also be, but not limited to, a communication object commonly specified for the second client and the first client, where the first client may be, but not limited to, providing the second client with specified object information of the communication object specified from the M target communication objects.

It should be noted that, the above specified media server may be determined, but not limited to, based on the own requirement of the second client and the requirements of other clients associated with the second client in combination with a certain weight, where the other clients associated with the second client may be, but not limited to, clients for receiving data transmitted by the second client, so as to increase the diversity of possible choices of media nodes and clients based on the adaptation degree, and further achieve the technical effect of improving the fault tolerance of data transmission between two ends by determining the specified media server by the transmitting end and the receiving end together, thereby improving the data transmission efficiency.

Alternatively, in the present embodiment, in the case where the communication object is designated as the second client, the video stream data is directly transmitted to the first client by the second client.

Optionally, in this embodiment, in a case where the communication object is designated as at least one media server of the N media servers, the second client sends video stream data to the at least one media server, and the at least one media server forwards the received video stream data to the first client.

It should be noted that, signaling servers, clients, and media servers in the same signaling transmission channel allow signaling forwarding (including signaling sending), and data transmission, while signaling servers, clients, and media servers not in the same signaling transmission channel do not allow signaling forwarding or data transmission. On the premise of limiting the number of the data transmission modes, the method for determining the specified communication objects and transmitting or forwarding the video stream data based on the specified communication objects is further utilized, so that the target client selects the specified communication object which is most suitable for the client from a plurality of target communication objects to be selected according to the self requirements, video stream data is transmitted through the specified communication object with high adaptation, the autonomous selection efficiency of the client is improved, and the overall transmission efficiency of the video stream data is further improved.

It should be noted that the N media servers, the signaling server, the first client, and the second client may be, but are not limited to, distributed nodes. Therefore, based on the data transmission method, not only is the exclusive mode of video stream data transmission appointed by the second client terminal realized, the data transmission efficiency is improved, but also the safety isolation of the distributed nodes is provided, and the purpose of flexibly dividing exclusive areas of each distributed node is achieved, so that the flexible deployment, the expansion and the division of the distributed nodes including the media server and the target client terminal and the targeted selection are realized, and the effect of improving the flexibility of the data transmission is further realized.

It should be noted that, when the second client is a target client for requesting to transmit data, the first client is a client for responding to the data transmission request, which is also applicable to the above method, and will not be described herein.

By way of further illustration, as shown in fig. 5, after the first client 502 transmits video reception signaling to request reception of the video data stream of the second client 504, the signaling server 506 receives the video reception signaling transmitted by the first client 502 and forwards the video reception signaling to the second client 504.

Before the second client 504 responds to the video receiving signaling, the signaling server 506 establishes a signaling transmission channel 508 based on the first client, the second client, and the plurality of media servers, and the clients in the same signaling transmission channel 508 and the media servers are allowed to perform signaling forwarding and data transmission, but not the same signaling transmission channel 508 does not allow signaling forwarding and data transmission.

The second client 504 determines, in response to the video reception signaling, a specified communication object 510 from M target communication objects belonging to the signaling transport path 508, where the M target communication objects include the second client 504 and N media servers belonging to the signaling transport path 508, and M, N is a positive integer.

In the case where the communication object 510 is designated as the second client 504, video stream data is transmitted to the first client 502; or, in the case where the communication object 510 is designated as at least one of the N media servers, video stream data is transmitted to the at least one media server and is relayed by the at least one media server to the first client 502.

According to the embodiment provided by the application, the video receiving signaling sent by the first client and forwarded by the signaling server is obtained, wherein the video receiving signaling is used for requesting to receive video stream data of the second client, and the first client and the second client belong to a signaling transmission channel established by the signaling server; responding to the video receiving signaling, determining a designated communication object from M target communication objects belonging to a signaling transmission channel, wherein the designated communication object is a communication object designated by a second client, and the M target communication objects comprise the second client and N media servers belonging to the signaling transmission channel, and M, N is a positive integer; transmitting video stream data to the first client under the condition that the communication object is designated as the second client; or, in the case that the communication object is designated as at least one media server of the N media servers, sending video stream data to the at least one media server, and forwarding the video stream data to the first client by the at least one media server; by using the data transmission method, only the signaling servers, the clients and the media servers which are positioned in the same signaling transmission channel are allowed to perform signaling forwarding and data transmission, so that the purpose of limiting the number of data transmission modes is achieved; further, the second client responds to the video receiving signaling to determine a designated communication object for sending or forwarding video stream data from M target communication objects included in the signaling transmission channel, and the mode of targeted scheduling of the communication objects for data transmission is utilized to form the high adaptation between the target communication object and the second client, so that the aim of improving the adaptation degree between the second client and the target communication object is fulfilled; therefore, on the basis of limiting the data transmission mode in the signaling transmission channel, the second client terminal autonomously selects the exclusive and adaptive appointed communication object to perform data transmission, so that the purposes of improving the selection efficiency of the second client terminal and improving the overall transmission efficiency of the data are achieved, the technical effect of improving the data transmission efficiency is achieved, and the technical problem of lower data transmission efficiency is solved.

Optionally, as an optional implementation manner, after determining the specified communication object from the M target communication objects belonging to the signaling transmission channel in response to the video reception signaling, the method further includes:

s1, sending video push stream signaling to at least one media server under the condition that a specified communication object is at least one media server, wherein the video push stream signaling is used for requesting to establish video stream communication relations among the at least one media server, a first client and a second client;

s2, under the condition that a push stream confirmation signaling returned by at least one media server is received, establishing a video stream communication relationship.

Optionally, in this embodiment, the video push instruction may be, but not limited to, configured to request to establish a video stream communication relationship between the second client, the specified communication object, and the first client, and the video stream communication relationship may be, but not limited to, configured to indicate a transmission manner of video stream data, allow transmission of the video stream data between the client that has established the video stream communication relationship and the specified communication object, and not allow transmission of the video stream data between the client that has not established the video stream communication relationship and the specified communication object.

By the embodiment provided by the application, in the case that the specified communication object is at least one media server, sending video push signaling to the at least one media server, wherein the video push signaling is used for requesting to establish a video stream communication relationship among the at least one media server, the first client and the second client; and under the condition that a push stream confirmation signaling returned by at least one media server is received, establishing a video stream communication relationship. By the method for establishing the exclusive video stream communication relationship among the first client, the second client and the appointed communication object, the video stream data is only transmitted between the client corresponding to the exclusive video stream communication relationship and the media server, so that the purpose of providing an efficient exclusive data transmission mode for the video stream data based on the high-adaptation media server is achieved, and the technical effect of improving the data transmission efficiency is achieved.

As an alternative, in a case where the communication object is designated as at least one media server of the N media servers, transmitting video stream data to the at least one media server, and forwarding the video stream data to the first client by the at least one media server, includes:

S1, when the communication object is at least one media server and the video stream communication relation is established, sending video stream data to the at least one media server, and transferring the video stream data to the first client by the at least one media server.

Alternatively, in the present embodiment, in the case where the communication object is designated as at least one media server and the video stream communication relationship has been established, the second client may, but is not limited to, send video stream data to the at least one media server and relay the video stream data to the first client by the at least one media server.

In the case where the communication object is designated as the second client and the video stream communication relationship is established, the second client may transmit video stream data to the first client, but is not limited to this.

Further illustratively, as shown in fig. 6, the signaling transport path 602 includes at least a first client 604, a specified communication object 606, and a second client 608, wherein the specified communication object 606 is determined by the second client 608 from among the M target communication objects belonging to the signaling transport path 602, and the specified communication object 606 is at least one media server.

The corresponding video stream communication relationship 610 is concise based on the second client 608, the specified communication object 606, and the first client 604, wherein the video stream communication relationship 610 may be, but is not limited to, used to indicate a data transmission direction of video stream data from the second client 608 to the specified communication object 606 and video stream data from the specified communication object 606 to the first client 604.

By the embodiment provided by the application, in the case that the communication object is designated as at least one media server and the video stream communication relationship is established, video stream data is sent to the at least one media server, and the video stream data is transferred to the first client by the at least one media server. The video stream data is sent or forwarded by designating the communication object, so that the aim of providing an efficient dedicated data transmission mode for the video stream data based on the high-adaptation media server is fulfilled, and the technical effect of improving the data transmission efficiency is achieved.

As an alternative, in response to the video reception signaling, determining a specified communication object from M target communication objects belonging to the signaling transmission channel, includes:

s1, responding to video receiving signaling, and acquiring communication attribute information of each target communication object in M target communication objects;

S2, determining a specified communication object from M target communication objects based on the communication attribute information, wherein the communication attribute information of the specified communication object meets the specified condition of the second client.

Optionally, in this embodiment, the communication attribute information of the target communication object may include, but is not limited to, reference service information of the media server, and reference client information of the second client, where the reference service information of the media server may include, but is not limited to, adaptation information between the media server and the client, may include, but is not limited to, information such as a reporting node ID, identity verification information, a channel to which the media server accesses a signaling transmission channel, a measurement IP, a node availability level, and the like, and the reference client information of the second client may include, but is not limited to, information such as a reporting node ID, identity verification information, a channel to which the second client accesses the signaling transmission channel, and the like.

It should be noted that, the reference client information of the first client may, but is not limited to, include information such as a reporting node ID, authentication information, a channel to which the first client belongs when accessing the signaling transmission channel.

Further by way of example, as shown in fig. 7 (a), the M target communication objects included in the signaling transmission channel include a media server 702, a media server 704, and a media server 706, and the reference service information 708 is used to indicate reference service information corresponding to the respective media servers, and the determining, based on communication attribute information corresponding to the target communication object, the specified communication object 710 from the M target communication objects includes: based on the reference service information 708 corresponding to each of the media server 702, the media server 704, and the media server 706, the specified communication object 710 is determined, and as shown in (b) of fig. 7, in the case where the specified condition of the second client is that the node availability level corresponding to the media server is not less than 2, the media server 702, and the media server 704 are determined as the specified communication object 710 from among the media server 702, the media server 704, and the media server 706.

As an alternative, determining a specified communication object from the M target communication objects based on the communication attribute information, includes:

s1, determining a specified communication object from M target communication objects based on specified object information and communication attribute information when specified object information is carried in video receiving signaling, wherein the specified object information is specified by a first client from the communication objects specified by the M target communication objects.

Alternatively, in the present embodiment, the specified object information may be, but is not limited to, communication object information specified for the first client from among the M target communication objects.

Alternatively, in the present embodiment, the specified communication object is determined from the M target communication objects based on the specified object information and the communication attribute information.

It should be noted that the specified communication object may be, but not limited to, determined by the second client based on the communication attribute information of the M target communication objects in the signaling transmission channel alone, or may be, but not limited to, determined by the second client based on the specified object information provided by the first client and based on the communication attribute information of the M target communication objects in the signaling transmission channel together.

It should be noted that, the second client may determine the specified communication object according to the specified object information recommended by the first client, where the specified communication object may be a communication object specified by the first client from M target communication objects, or may be a communication object specified by the second client from M target communication objects.

It should be noted that, the second client may not only autonomously select the designated media server that designates the most adaptive second client according to its own requirements (e.g. actual data transmission situation, target data situation, transmission time limit efficiency requirement of the second client, etc.), but also determine the most adaptive designated media server according to its own requirements (e.g. actual data reception situation, target data situation, reception time limit requirement efficiency requirement of the first client, etc.) of the first client on the data receiving side, and further combine the own requirements of the first client and the second client according to a certain weight, thereby increasing the diversity of feasible choices of the media server and the client based on the adaptation degree, and further achieving the technical effect of improving the fault tolerance of data transmission between the two ends by determining the designated communication object together by the transmitting end and the receiving end, thereby improving the data transmission efficiency.

According to the embodiment provided by the application, when the video receiving signaling carries the specified object information, the specified communication object is determined from the M target communication objects based on the specified object information and the communication attribute information, wherein the specified object information is specified by the first client from the communication objects specified by the M target communication objects. The appointed communication object is determined through the appointed object information provided by the first client and the communication attribute information corresponding to each of M communication objects in the signaling transmission channel, so that the diversity of feasible selection of the media server and the client based on the adaptation degree is increased, the fault tolerance of data transmission between two ends is improved through the mode that the sending end and the receiving end jointly determine the appointed communication object, and the technical effect of improving the data transmission efficiency is achieved.

As an alternative, before obtaining the video receiving signaling sent by the first client and forwarded by the signaling server, the method further includes:

and accessing the second client into the signaling server, and determining that the second client belongs to a signaling transmission channel under the condition that the second client passes the authentication of the signaling server, wherein the target signaling in the signaling transmission channel is set to be transparently forwarded by the signaling server, and the target signaling comprises video receiving signaling.

Optionally, in this embodiment, the second client may, but is not limited to, access the signaling transmission channel, including: and the second client reports the node ID, the identity verification information, the channel to which the node ID belongs and other information to the signaling server, completes the access request and waits for the access authentication of the signaling server.

Optionally, in this embodiment, the second client may, but is not limited to, request the signaling server to pull a media service node list, and the media service node list may, but is not limited to, store reference service information of the media server, including: node ID of media server, authentication information, belonging channel, measurement IP, node availability level.

Optionally, in this embodiment, the second client may, but is not limited to, select the specified media service node from the media service node list based on a selection principle, where the selection principle may, but is not limited to, be used to indicate whether the second client needs to forward the specified media service node, may, but is not limited to, determine the specified media service node according to the node measured IP network delay and the node availability level in the case that the second client needs to forward the specified media service node, and may, but is not limited to, be used to indicate other forwarding policies of the second client.

It should be noted that, the client node accesses the signaling server, reports the node ID, the authentication information, the channel to which the node belongs, and the like, completes the access authentication, and determines the second client. The second client may, but is not limited to, request the signaling server to pull the list of media service nodes, and determine 0-K designated media service nodes (corresponding to the designated media servers) based on whether or not a designated media service node forwarding or other forwarding policy is required,

it should be noted that, the target signaling in the signaling transmission channel is set to be transparently forwarded by the signaling server, where the target signaling includes video receiving signaling. The signaling server is only responsible for signaling forwarding and authority verification, does not need to analyze and logically process signaling, and does not bear the scheduling and management of the media server, so that the purpose of knowing and playing the signaling server is achieved, and the overall data transmission efficiency is improved.

By way of further example, as shown in fig. 8, before obtaining the video reception signaling forwarded by the signaling server and sent by the first client, the method further includes:

step S802, the candidate client requests to access the signaling server: the candidate client reports the node ID, the identity verification information, the channel to which the node ID belongs and other information to the signaling server, completes the access request, and waits for the access authentication of the signaling server;

in step S804, the signaling server determines that the candidate client is the second client: under the condition that the candidate client passes the authentication of the signaling server, determining the candidate client as a second client;

step S806, the second client requests the signaling server to pull the media server node list;

step S808: the signaling server returns a media service node list to the second client;

step S810: the second client checks the media service node list, and selects a designated media service node: and the second client determines the appointed communication object according to the information stored in the media service node list and a preset selection principle.

By means of the embodiment provided by the application, the second client is accessed to the signaling server, and the second client is determined to belong to the signaling transmission channel under the condition that the second client passes through authentication of the signaling server, wherein target signaling in the signaling transmission channel is set to be forwarded transparently by the signaling server, and the target signaling comprises video receiving signaling.

As an alternative, after determining that the second client belongs to the signaling transmission channel, the method further includes:

s1, sending communication attribute information of a second client to a signaling server according to a preset period;

s2, disconnecting the second client from the signaling transmission channel under the condition that the communication attribute information of the second client does not meet the available conditions.

Optionally, in this embodiment, after the second client accesses the signaling transmission channel, the communication attribute information of the second client is synchronously updated to the signaling server according to a preset period, and if the communication attribute information of the second client does not meet the availability condition, the second client is detached from the signaling transmission channel.

It should be noted that, after the first client accesses the signaling transmission channel, the communication attribute information of the first client is synchronously updated to the signaling server according to a preset period, and the second client is separated from the signaling transmission channel when the communication attribute information of the first client does not meet the available condition. The communication attribute of the first client is continuously updated to the signaling server according to the preset period, so that the purpose of updating the communication attribute information of the first client in the signaling transmission channel in real time is achieved, accurate matching of the client to the adaptive media server is ensured, and the technical effect of improving the data transmission efficiency is achieved.

It should be noted that, after the N media servers access the signaling transmission channel, the communication attribute information of the media servers is synchronously updated to the signaling server according to a preset period, and the corresponding media servers are separated from the signaling transmission channel when the communication attribute information of the media servers does not meet the available condition. The reference service information of the media server is continuously updated to the signaling server according to the preset period, so that the aim of updating the communication attribute information of the second client in the signaling transmission channel in real time is fulfilled, accurate matching of the client to the adaptive media server is ensured, and the technical effect of improving the data transmission efficiency is realized.

According to the embodiment provided by the application, the communication attribute information of the second client is sent to the signaling server according to the preset period; and in the case that the communication attribute information of the second client does not meet the available condition, disconnecting the second client from the signaling transmission channel. The communication attribute of the second client is continuously updated to the signaling server according to the preset period, so that the purpose of updating the communication attribute information of the second client in the signaling transmission channel in real time is achieved, accurate matching of the client to the adaptive media server is ensured, and the technical effect of improving the data transmission efficiency is achieved.

As an alternative, after obtaining the video reception signaling forwarded by the signaling server and sent by the first client, the method further includes:

s1, responding to video receiving signaling, determining a first communication object and a second communication object from M target communication objects, wherein the first communication object is a communication object appointed by a first transmission mode of a second client, the first transmission mode is a transmission mode of sending data to the first client by the second client, the second communication object is a communication object appointed by the second transmission mode, and the second transmission mode is a transmission mode of sending data to the second client by the first client.

Optionally, in this embodiment, in response to the video receiving signaling, a first communication object and a second communication object for bidirectional data transmission between the first client and the second client are determined from M target communication objects, where the first communication object corresponds to a first transmission manner in which the second client sends data to the first client, the first transmission manner may, but is not limited to, include the second client, the first communication object, and the first client, the second communication object corresponds to a second transmission manner in which the first client sends data to the second client, and the second transmission manner may, but is not limited to, include the first client, the second communication object, and the second client.

The first transmission method may be, but not limited to, a transmission method for unidirectional data transmission from the second client to the first client, the second transmission method may be, but not limited to, a transmission method for unidirectional data transmission from the first client to the second client, and the first transmission method and the second transmission method may be, but not limited to, independent transmission channels having opposite data transmission directions.

It should be noted that, when a single client terminal autonomously designates a media node as a channel for unidirectional transmission of the client terminal, and further data transmission is performed between two client terminals, there is a transmission channel that is optimally adapted to each other, instead of one client terminal compromising the designated media node of the other client terminal, so as to achieve the purpose of maximally improving the smoothness of the data transmission mode, and thus achieve the effect of improving the data transmission efficiency.

By way of further illustration, as shown in fig. 9, a second transmission manner 912 is determined for transmitting data from the first client 902 to the second client 904 based on the first client 902, the second communication object 910, and the second client 904, wherein the second communication object 910 may be, but is not limited to, autonomously selected by the first client 902, or may be, but is not limited to, specified communication object information provided by the first client 902 in combination with the second client 904;

Based on the second client 904, the first communication object 906, and the first client 902, a first transmission manner 908 is determined for transmitting data from the second client 904 to the first client 902, wherein the first communication object 906 may be, but is not limited to, autonomously selected by the second client 904, or may be, but is not limited to, specified communication object information provided by the second client 904 in combination with the first client 902;

the first client 902, the second client 904, the first communication object 906, and the second communication object 910 may be, but are not limited to being, located within a signaling transport channel 914.

According to the embodiment provided by the application, a first communication object and a second communication object are determined from M target communication objects in response to a video receiving signaling, wherein the first communication object is a communication object appointed by a first transmission mode for a second client, the first transmission mode is a transmission mode for sending data to the first client by the second client, the second communication object is a communication object appointed by the second client, and the second transmission mode is a transmission mode for sending data to the second client by the first client. Therefore, when data transmission is carried out between two clients, the transmission channels which are respectively and optimally adapted are arranged instead of the appointed media node of one client to compromise the other client, so that the aim of improving the smoothness of the data transmission mode to the greatest extent is achieved, and the effect of improving the data transmission efficiency is achieved.

As an alternative, after determining the first communication object and the second communication object from the M target communication objects in response to the video reception signaling, the method further includes:

s1, receiving data sent by a first client when the current transmission mode is a second transmission mode and a second communication object is a second client; or alternatively, the first and second heat exchangers may be,

s2, receiving data transmitted by the first client and transferred by at least one target media server under the condition that the current transmission mode is a second transmission mode and the second communication object is at least one target media server in N media servers.

Optionally, in this embodiment, in a case where the current transmission mode is the second transmission mode and the second communication object is the second client, the first client sends data to the second client.

Optionally, in this embodiment, in a case where the current transmission mode is the second transmission mode and the second communication object is at least one target media server of the N media servers, the at least one target media server receives data sent by the first client, and the at least one target media server forwards the received data to the second client.

By the embodiment provided by the application, when the current transmission mode is the second transmission mode and the second communication object is the second client, receiving the data sent by the first client; or, in the case that the current transmission mode is the second transmission mode and the second communication object is at least one target media server of the N media servers, receiving data transmitted by the first client and transferred by the at least one target media server.

s1, responding to video receiving signaling, determining a target multicast media set, wherein M target communication objects are divided into at least two multicast media sets, the multicast media set comprises at least two media servers, and the at least two multicast media sets comprise target multicast media sets;

s2, determining the media server in the target multicast media set as a specified communication object.

Alternatively, in the present embodiment, the specified communication object may be, but is not limited to, a plurality of media servers determined by a plurality of multicast media sets divided by M target communication objects, may be, but is not limited to, a plurality of media servers located in the same multicast media set, and may be, but is not limited to, at least one media server and at least one client located in the same multicast media set.

Alternatively, in this embodiment, multiple media servers located in the target multicast media collection may receive all of the data in the collection, while media servers not joining the target multicast media collection cannot receive the data.

It should be noted that, at least one media server and at least one client located in the target multicast media collection may receive all the data in the collection, while a media server or client not joining the target multicast media collection cannot receive the data.

It should be noted that, by using the method, the target data can be transmitted to a plurality of media servers located in the target multicast media set at a time, and other media servers not joining the target multicast media set can be guaranteed not to be affected.

It should be noted that, in a scenario where multiple people watch video, video stream forwarding between media nodes (equivalent to media servers) is efficiently established. The network forwarding routes for the media nodes may be generated based on the application layer P2P multicast network. When the media node A forwards the same video stream to other media nodes, the media node A can forward according to a route formed by the P2P multicast network so as to improve multicast forwarding efficiency. The signaling for constructing the P2P multicast network can be interacted by the media nodes in the same dedicated channel through the signaling server, and the media nodes of the common channel can be added into the dedicated channel, so that the media nodes in the same dedicated channel can construct the P2P multicast network by themselves, and the media nodes added into the common channel can also be selected to construct the P2P multicast network together.

By the embodiment provided by the application, responding to the video receiving signaling, determining a target multicast media set, wherein M target communication objects are divided into at least two multicast media sets, the multicast media set comprises at least two media servers, and the at least two multicast media sets comprise target multicast media sets; a media server in the target multicast media collection is determined to be a designated communication object. By using the method, the video stream data can be transmitted to a plurality of communication objects positioned in the target multicast media set at one time, and other communication objects which are not added into the target multicast media set can be guaranteed not to be influenced, so that the purpose of efficiently establishing video stream forwarding among media nodes is achieved, and the technical effect of improving the data transmission efficiency is achieved.

As an alternative, the data transmission method is applied in a scenario of media video distribution, for example, as shown in fig. 10, where specific contents corresponding to the signaling server 1002, the client node 1004, the client node 1006, the media node 1008, and the media node 1010 are as follows:

(one) the signaling server 1002:

taking the signaling server 1002, the client node 1004, and the media node 1008 shown in fig. 10 as an example, the signaling server 1002 provides a signaling forwarding channel between the client node 1004 and the media node 1008 for transparent signaling forwarding, and can complete signaling forwarding according to the target node ID and the source node ID. The signaling server 1002 may establish a dedicated channel in which to access the licensed client node 1004 and the media node 1008. Signaling forwarding cannot be performed between nodes not in the same dedicated channel. Media nodes 1008 within the access-specific channel may be viewed by list within the specific channel. The public media nodes can access the public channels, and nodes of the public channels can be checked in all channels.

(two) client node 1004, client node 1006:

taking the example of the client node 1004 and the signaling server 1002 shown in fig. 10, the client node 1004 initiates a video stream push/pull signaling procedure to the signaling server 1002, and can view a media node list in a corresponding channel, where the media node list stores a plurality of media nodes, such as the media node 1008 and the media node 1010, registered on the access signaling server 1002.

(III) media nodes 1006, 1008:

taking the client node 1004 and the media node 1006 shown in fig. 10 as an example, the media node 1006 responds to the video stream signaling of the client node 1004, and performs video push/pull communication or video stream forwarding according to the video stream signaling of the client node 1004. The media node 1004 can access the P2P multicast network to realize efficient video multicast forwarding among a plurality of media nodes.

As an alternative, the data transmission method is applied in a scene of media video viewing, for example, as shown in fig. 11, where a specific flow of viewing a video of a client node B by a client node a is as follows:

step S1102, obtaining a media node: the client node A accesses the signaling server, acquires a media service node list, and selects 0-1 media service nodes;

Step S1104, view video request: the client node A sends a video stream watching request to the client node B through a signaling server, wherein the video stream watching request comprises information such as self node ID, node ID of the client node B, video stream number of the request, selected watching media service node ID, optional suggested video stream distribution mode (P2P, service forwarding) and the like, and the signaling server transparently forwards signaling;

step S1106, obtain media node: after the client node B receives the video stream watching request and under the condition that the video is not pushed, acquiring a media service node list, determining to select 0-1 media service nodes, executing S1108 under the condition that the selected media service nodes are determined, and executing S1116 under the condition that the non-selected media service nodes are determined, wherein the selection principle can be determined according to the media nodes selected by the client node a, the node IP delay, the availability level, the node a suggested distribution mode and the distribution mode policy of the client node B;

step S1108, a video push/push request: sending a video push/push request;

step S1110, the video push/forward request: after receiving a video stream watching request, a client node B sends a video forwarding request to a media service node which has been pushed under the condition that the video is pushed, wherein the video pushing/forwarding request comprises a self node ID, an optional opposite node ID, and information such as a media node ID, a video stream ID, a video pushing SDP, a video pushing/forwarding identifier and the like is selected by an opposite end, and if the video is pushed and forwarded, SDP can be omitted;

Steps S1112-S1114, video push/forward reply: after receiving the video push/forward request, the media node replies the video push SDP (the forward can not reply), establishes video push connection with the client node B, if the opposite terminal selects the media node ID, establishes the video push request to the corresponding media node ID, and comprises the information of the own node ID, the optional opposite terminal node ID, the video stream ID, the video push SDP and the like; and the reply carries the media node ID for confirming the forwarding;

step S1116, video viewing reply: under the condition that the client node B confirms the establishment of the connection with the media push stream/forwarding according to the received video push stream/forwarding reply of the media node, the client node B sends a video watching request reply with a video stream ID and a final forwarded media node ID to the client node A through a signaling server; or no media node is selected, the final forwarded node ID is the node ID of the client node B;

step S1118-S1120, obtain a video streaming node, a video streaming request: the client node A replies according to the received request, and initiates a video streaming request with information such as a video streaming ID, a self ID, a video streaming SDP and the like according to the video streaming ID and the finally forwarded node ID;

Step S1122, video pull-up is repeated: and the corresponding node generates a corresponding SDP according to the video stream ID, replies to the client node A and establishes video streaming communication.

It should be noted that, authentication can be performed on the final forwarding node of the request through the video stream ID and the pull stream node ID, and in the video push stream and forwarding, the end node ID can be optionally carried, so that the final forwarding node can check whether the video stream ID and the end node ID are permitted or not, thereby realizing the effect of authentication protection on the pull stream of the video stream.

It will be appreciated that in the specific embodiments of the present application, related data such as user information is referred to, and when the above embodiments of the present application are applied to specific products or technologies, user permissions or consents need to be obtained, and the collection, use and processing of related data need to comply with related laws and regulations and standards of related countries and regions.

It should be noted that, for simplicity of description, the foregoing method embodiments are all expressed as a series of action combinations, but it should be understood by those skilled in the art that the present application is not limited by the order of actions described, as some steps may be performed in other order or simultaneously in accordance with the present application. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily required in the present application.

According to another aspect of the embodiments of the present application, there is also provided a data transmission apparatus for implementing the above data transmission method. As shown in fig. 12, the apparatus includes:

an obtaining unit 1202, configured to obtain a video receiving signaling sent by a first client and forwarded by a signaling server, where the video receiving signaling is used to request to receive video stream data of a second client, and the first client and the second client belong to a signaling transmission channel established by the signaling server;

a determining unit 1204, configured to determine, in response to the video reception signaling, a specified communication object from M target communication objects belonging to the signaling transmission channel, where the specified communication object is a communication object specified by the second client, and the M target communication objects include the second client and N media servers belonging to the signaling transmission channel;

a transmitting unit 1206 configured to transmit video stream data to the first client in a case where the specified communication object is the second client; or, in the case that the communication object is designated as at least one media server of the N media servers, transmitting the video stream data to the at least one media server, and forwarding the video stream data to the first client by the at least one media server.

Specific embodiments may refer to the examples shown in the data transmission device, and in this example, the details are not repeated here.

As an alternative, the apparatus further includes:

a first sending device, configured to send, in response to the video reception signaling, a video push signaling to at least one media server in a case where the specified communication object is at least one media server after determining the specified communication object from the M target communication objects belonging to the signaling transmission channel, where the video push signaling is used to request establishment of a video stream communication relationship among the at least one media server, the first client, and the second client;

and the establishing device is used for establishing the video stream communication relationship under the condition of receiving the push stream confirmation signaling returned by at least one media server after determining the appointed communication object from the M target communication objects belonging to the signaling transmission channel in response to the video receiving signaling.

As an alternative, the transmitting unit 1206 includes:

and the second sending device is used for sending the video stream data to the at least one media server and transferring the video stream data to the first client by the at least one media server under the condition that the communication object is at least one media server and the video stream communication relation is established.

As an alternative, the determining unit 1204 includes:

the acquisition device is used for responding to the video receiving signaling and acquiring the communication attribute information of each target communication object in the M target communication objects;

and first determining means for determining a specified communication object from the M target communication objects based on the communication attribute information, wherein the communication attribute information of the specified communication object satisfies the specified condition of the second client.

As an alternative, the determining device includes:

and the determining sub-device is used for determining the specified communication object from the M target communication objects based on the specified object information and the communication attribute information under the condition that the video receiving signaling carries the specified object information, wherein the specified object information is the specified object information of the communication object specified by the first client from the M target communication objects.

As an alternative, the apparatus further includes:

and the second determining device is used for accessing the second client into the signaling server before acquiring the video receiving signaling transmitted by the first client and forwarded by the signaling server, and determining that the second client belongs to the signaling transmission channel under the condition that the second client passes the authentication of the signaling server, wherein the target signaling in the signaling transmission channel is set to be transparently forwarded by the signaling server, and the target signaling comprises the video receiving signaling.

As an alternative, the apparatus further includes:

the sending sub-device is used for sending the communication attribute information of the second client to the signaling server according to a preset period after determining that the second client belongs to the signaling transmission channel;

and the deionization device is used for separating the second client from the signaling transmission channel under the condition that the communication attribute information of the second client does not meet the available condition after the second client is determined to belong to the signaling transmission channel.

As an alternative, the apparatus further includes:

and the third determining device is used for determining a first communication object and a second communication object from M target communication objects in response to the video receiving signaling after the video receiving signaling sent by the first client and forwarded by the signaling server is acquired, wherein the first communication object is a communication object designated by the second client as a first transmission mode, the first transmission mode is a transmission mode of sending data to the first client by the second client, the second communication object is a communication object designated by the second client as a second transmission mode, and the second transmission mode is a transmission mode of sending data to the second client by the first client.

As an alternative, the apparatus further includes:

the first receiving sub-device is used for receiving data sent by the first client when the current transmission mode is the second transmission mode and the first communication object is the second client after the first communication object and the second communication object are determined from M target communication objects in response to the video receiving signaling; or alternatively, the first and second heat exchangers may be,

And the second receiving sub-device is used for receiving the data transmitted by the first client and transferred by at least one target media server under the condition that the current transmission mode is the second transmission mode and the first communication object is at least one target media server in N media servers after the first communication object and the second communication object are determined from M target communication objects in response to the video receiving signaling.

As an alternative, the determining unit 1204 includes:

fourth determining means for determining a target multicast media set in response to the video reception signaling, wherein the M target communication objects are divided into at least two multicast media sets, the multicast media sets including at least two media servers, the at least two multicast media sets including a target multicast media set;

fifth determining means for determining a media server in the target multicast media collection as a specified communication object.

According to a further aspect of the embodiments of the present application, there is also provided an electronic device for implementing the above-described data transmission method, as shown in fig. 13, the electronic device comprising a memory 1302 and a processor 1304, the memory 1302 having stored therein a computer program, the processor 1304 being arranged to perform the steps of any of the method embodiments described above by means of the computer program.

Alternatively, in this embodiment, the electronic device may be located in at least one network device of a plurality of network devices of the computer network.

Alternatively, in the present embodiment, the above-described processor may be configured to execute the following steps by a computer program:

s1, acquiring video receiving signaling transmitted by a first client and forwarded by a signaling server, wherein the video receiving signaling is used for requesting to receive video stream data of a second client, and the first client and the second client belong to a signaling transmission channel established by the signaling server;

s2, responding to the video receiving signaling, determining a specified communication object from M target communication objects belonging to a signaling transmission channel, wherein the specified communication object is a communication object specified by a second client, and the M target communication objects comprise the second client and N media servers belonging to the signaling transmission channel, and M, N is a positive integer;

S3, sending video stream data to the first client when the appointed communication object is the second client; or, in the case that the communication object is designated as at least one media server of the N media servers, transmitting the video stream data to the at least one media server, and forwarding the video stream data to the first client by the at least one media server.

Alternatively, it will be understood by those skilled in the art that the structure shown in fig. 13 is only schematic, and the electronic device may also be a terminal device such as a smart phone (e.g. an Android phone, an iOS phone, etc.), a tablet computer, a palm computer, and a mobile internet device (Mobile Internet Devices, MID), a PAD, etc. Fig. 13 is not limited to the structure of the electronic device described above. For example, the electronic device may also include more or fewer components (e.g., network interfaces, etc.) than shown in FIG. 13, or have a different configuration than shown in FIG. 13.

The memory 1302 may be used to store software programs and modules, such as program instructions/modules corresponding to the data transmission method and apparatus in the embodiments of the present application, and the processor 1304 executes the software programs and modules stored in the memory 1302, thereby performing various functional applications and data processing, that is, implementing the data transmission method described above. Memory 1302 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, memory 1302 may further include memory located remotely from processor 1304, which may be connected to the terminal via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof. The memory 1302 may be used for storing information such as, but not limited to, video reception signaling, video stream data, and the like. As an example, as shown in fig. 13, the memory 1302 may include, but is not limited to, the acquisition unit 1202, the determination unit 1204, and the transmission unit 1206 in the data transmission apparatus. In addition, other module units in the data transmission device may be included, but are not limited to, and are not described in detail in this example.

Optionally, the transmission device 1306 is configured to receive or transmit data via a network. Specific examples of the network described above may include wired networks and wireless networks. In one example, the transmission means 1306 comprises a network adapter (Network Interface Controller, NIC) which can be connected to other network devices and routers via network lines so as to communicate with the internet or a local area network. In one example, the transmission device 1306 is a Radio Frequency (RF) module for communicating wirelessly with the internet.

In addition, the electronic device further includes: a display 1308 for displaying information such as the video reception signaling and the video stream data; and a connection bus 1310 for connecting the respective module components in the above-described electronic device.

In other embodiments, the terminal device or the server may be a node in a distributed system, where the distributed system may be a blockchain system, and the blockchain system may be a distributed system formed by connecting the plurality of nodes through a network communication. Among them, the nodes may form a Peer-To-Peer (P2P) network, and any type of computing device, such as a server, a terminal, etc., may become a node in the blockchain system by joining the Peer-To-Peer network.

According to one aspect of the present application, a computer program product is provided, comprising a computer program/instructions containing program code for performing the method shown in the flow chart. In such embodiments, the computer program may be downloaded and installed from a network via a communication portion, and/or installed from a removable medium. When executed by a central processing unit, performs the various functions provided by the embodiments of the present application.

The foregoing embodiment numbers of the present application are merely for describing, and do not represent advantages or disadvantages of the embodiments.

It should be noted that the computer system of the electronic device is only an example, and should not impose any limitation on the functions and the application scope of the embodiments of the present application.

The computer system includes a central processing unit (Central Processing Unit, CPU) which can execute various appropriate actions and processes according to a program stored in a Read-Only Memory (ROM) or a program loaded from a storage section into a random access Memory (Random Access Memory, RAM). In the random access memory, various programs and data required for the system operation are also stored. The CPU, the ROM and the RAM are connected to each other by bus. An Input/Output interface (i.e., I/O interface) is also connected to the bus.

The following components are connected to the input/output interface: an input section including a keyboard, a mouse, etc.; an output section including a Cathode Ray Tube (CRT), a liquid crystal display (Liquid Crystal Display, LCD), and the like, and a speaker, and the like; a storage section including a hard disk or the like; and a communication section including a network interface card such as a local area network card, a modem, and the like. The communication section performs communication processing via a network such as the internet. The drive is also connected to the input/output interface as needed. Removable media such as magnetic disks, optical disks, magneto-optical disks, semiconductor memories, and the like are mounted on the drive as needed so that a computer program read therefrom is mounted into the storage section as needed.

In particular, according to embodiments of the present application, the processes described in the various method flowcharts may be implemented as computer software programs. For example, embodiments of the present application include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flowcharts. In such embodiments, the computer program may be downloaded and installed from a network via a communication portion, and/or installed from a removable medium. The computer program, when executed by a central processing unit, performs the various functions defined in the system of the present application.

According to one aspect of the present application, there is provided a computer-readable storage medium, from which a processor of a computer device reads the computer instructions, the processor executing the computer instructions, causing the computer device to perform the methods provided in the various alternative implementations described above.

Alternatively, in the present embodiment, the above-described computer-readable storage medium may be configured to store a computer program for executing the steps of:

Alternatively, in this embodiment, it will be understood by those skilled in the art that all or part of the steps in the methods of the above embodiments may be performed by a program for instructing a terminal device to execute the steps, where the program may be stored in a computer readable storage medium, and the storage medium may include: flash disk, read-Only Memory (ROM), random-access Memory (Random Access Memory, RAM), magnetic or optical disk, and the like.

The integrated units in the above embodiments may be stored in the above-described computer-readable storage medium if implemented in the form of software functional units and sold or used as separate products. Based on such understanding, the technical solution of the present application may be embodied in essence or a part contributing to the prior art or all or part of the technical solution in the form of a software product stored in a storage medium, including several instructions to cause one or more computer devices (which may be personal computers, servers or network devices, etc.) to perform all or part of the steps of the methods described in the various embodiments of the present application.

In the foregoing embodiments of the present application, the descriptions of the embodiments are emphasized, and for a portion of this disclosure that is not described in detail in this embodiment, reference is made to the related descriptions of other embodiments.

In several embodiments provided in the present application, it should be understood that the disclosed client may be implemented in other manners. The above-described embodiments of the apparatus are merely exemplary, and the division of the units, such as the division of the units, is merely a logical function division, and may be implemented in another manner, for example, multiple units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interfaces, units or modules, or may be in electrical or other forms.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The foregoing is merely a preferred embodiment of the present application and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present application and are intended to be comprehended within the scope of the present application.

Claims

1. A data transmission method, comprising:

acquiring video receiving signaling transmitted by a first client and forwarded by a signaling server, wherein the video receiving signaling is used for requesting to receive video stream data of a second client, and the first client and the second client belong to a signaling transmission channel established by the signaling server;

responding to the video receiving signaling, determining a designated communication object from M target communication objects belonging to the signaling transmission channel, wherein the designated communication object is a communication object designated by the second client, and the M target communication objects comprise the second client and N media servers belonging to the signaling transmission channel;

Transmitting the video stream data to the first client in the case that the specified communication object is the second client; or, in the case that the specified communication object is at least one media server of the N media servers, sending the video stream data to the at least one media server, and forwarding the video stream data to the first client by the at least one media server.

2. The method of claim 1, wherein after determining a specified communication object from among M target communication objects belonging to the signaling transport path in response to the video reception signaling, the method further comprises:

sending video push signaling to the at least one media server if the specified communication object is the at least one media server, wherein the video push signaling is used for requesting to establish a video stream communication relationship among the at least one media server, the first client and the second client;

and under the condition that a push stream confirmation signaling returned by the at least one media server is received, establishing the video stream relation.

3. The method of claim 2, wherein, in the case where the specified communication object is at least one of the N media servers, sending the video stream data to the at least one media server and forwarding the video stream data to the first client by the at least one media server, comprises:

and in the case that the specified communication object is the at least one media server and the video stream communication relationship is established, sending the video stream data to the at least one media server, and transferring the video stream data to the first client by the at least one media server.

4. The method of claim 1, wherein said determining a specified communication object from among M target communication objects belonging to said signaling transport path in response to said video reception signaling comprises:

responding to the video receiving signaling, and acquiring communication attribute information of each target communication object in the M target communication objects;

and determining the appointed communication object from the M target communication objects based on the communication attribute information, wherein the communication attribute information of the appointed communication object meets the appointed condition of the second client.

5. The method of claim 4, wherein determining the specified communication object from the M target communication objects based on the communication attribute information comprises:

and under the condition that the video receiving signaling carries specified object information, determining that the specified communication object is absent from the M target communication objects based on the specified object information and the communication attribute information, wherein the specified object information is specified object information of the communication object specified by the first client from the M target communication objects.

6. The method of claim 1, wherein prior to said obtaining the video reception signaling sent by the first client and forwarded by the signaling server, the method further comprises:

and accessing the second client to the signaling server, and determining that the second client belongs to the signaling transmission channel under the condition that the second client passes the authentication of the signaling server, wherein target signaling in the signaling transmission channel is set to be transparently forwarded by the signaling server, and the target signaling comprises the video receiving signaling.

7. The method of claim 6, wherein after said determining that the second client belongs to the signaling transport channel, the method further comprises:

according to a preset period, sending the communication attribute information of the second client to the signaling server;

and in the case that the communication attribute information of the second client does not meet the available condition, disconnecting the second client from the signaling transmission channel.

8. The method of claim 1, wherein after the obtaining the video reception signaling sent by the first client and forwarded by the signaling server, the method further comprises:

and responding to the video receiving signaling, determining a first communication object and a second communication object from the M target communication objects, wherein the first communication object is a communication object appointed by the second client in a first transmission mode, the first transmission mode is a transmission mode of transmitting data to the first client by the second client, the second communication object is a communication object appointed by the second client in a second transmission mode, and the second transmission mode is a transmission mode of transmitting data to the second client by the first client.

9. The method of claim 8, wherein after said determining a first communication object and a second communication object from said M target communication objects in response to said video reception signaling, said method further comprises:

receiving data sent by the first client under the condition that the current transmission mode is the second transmission mode and the second communication object is the second client; or, when the current transmission mode is the second transmission mode and the second communication object is at least one target media server of the N media servers, receiving data transferred by the at least one target media server and sent by the first client.

10. The method according to any one of claims 1 to 9, wherein said determining a specified communication object from M target communication objects belonging to the signaling transport path in response to the video reception signaling comprises:

determining a target multicast media set in response to the video receiving signaling, wherein the M target communication objects are divided into at least two multicast media sets, the multicast media sets comprise at least two media servers, and the at least two multicast media sets comprise the target multicast media set;

A media server in the target multicast media collection is determined as the specified communication object.

11. A data transmission apparatus, comprising:

the system comprises an acquisition unit, a signaling server and a signaling server, wherein the acquisition unit is used for acquiring video receiving signaling transmitted by a first client and forwarded by the signaling server, wherein the video receiving signaling is used for requesting to receive video stream data of a second client, and the first client and the second client belong to a signaling transmission channel established by the signaling server;

a determining unit, configured to determine, in response to the video reception signaling, a specified communication object from M target communication objects belonging to the signaling transmission channel, where the specified communication object is a communication object specified by the second client, and the M target communication objects include the second client and N media servers belonging to the signaling transmission channel;

a transmitting unit configured to transmit the video stream data to the first client in a case where the specified communication object is the second client; or, in the case that the specified communication object is at least one media server of the N media servers, sending the video stream data to the at least one media server, and forwarding the video stream data to the first client by the at least one media server.

12. A computer-readable storage medium, characterized in that the computer-readable storage medium comprises a stored program, wherein the program is executable by a terminal device or a computer to perform the method of any one of claims 1 to 10.

13. A computer program product comprising computer programs/instructions which, when executed by a processor, implement the steps of the method as claimed in any one of claims 1 to 10.

14. An electronic device comprising a memory and a processor, characterized in that the memory has stored therein a computer program, the processor being arranged to execute the method according to any of the claims 1 to 10 by means of the computer program.