CN117793072A - Data processing method, device and storage medium - Google Patents

Data processing method, device and storage medium Download PDF

Info

Publication number
CN117793072A
CN117793072A CN202211159431.3A CN202211159431A CN117793072A CN 117793072 A CN117793072 A CN 117793072A CN 202211159431 A CN202211159431 A CN 202211159431A CN 117793072 A CN117793072 A CN 117793072A
Authority
CN
China
Prior art keywords
media
computing node
processing
target computing
media data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211159431.3A
Other languages
Chinese (zh)
Inventor
吴滨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
China Mobile Communications Ltd Research Institute
Original Assignee
China Mobile Communications Group Co Ltd
China Mobile Communications Ltd Research Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd, China Mobile Communications Ltd Research Institute filed Critical China Mobile Communications Group Co Ltd
Priority to CN202211159431.3A priority Critical patent/CN117793072A/en
Publication of CN117793072A publication Critical patent/CN117793072A/en
Pending legal-status Critical Current

Links

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Computer And Data Communications (AREA)

Abstract

The embodiment of the application discloses a data processing method, equipment and a storage medium; the media forwarding device sends media data sent by the first terminal device to the target computing node according to the address information of the target computing node sent by the service server; and receiving the processed media data sent by the target computing node. The efficiency of processing media data can be improved.

Description

Data processing method, device and storage medium
Technical Field
The present disclosure relates to the field of network communications technologies, and in particular, to a data processing method, device, and storage medium.
Background
The multimedia telephony service (Multi Media Telephony, MMTel) is an IP multimedia subsystem (IP Multimedia Subsystem, IMS) based multimedia telephony service standard developed jointly by two large standardization organizations, european telecommunication standardization institute (European Telecommunications Standards Institute, ETSI)/telecommunications and internet convergence service (Telecommunications and Internet Converged Services and Protocols for Advanced Networking, TISPAN) and third generation partnership project (3rd Generation Partnership Project,3GPP); at present, some mature applications of artificial intelligence (Artificial Intelligence, AI) such as language identification, image identification, natural language processing and the like can be applied to multimedia telephone service media streams, and the current implementation scheme of the service is that the multimedia service streams sequentially pass through a plurality of serially connected computing nodes according to specific application requirements so as to execute AI processing corresponding to the application requirements, so that when a processing failure occurs in one computing node, the multimedia service streams cannot be processed, and the efficiency of processing the multimedia service streams is seriously affected.
Disclosure of Invention
The embodiment of the application provides a data processing method, data processing equipment and a storage medium, which can improve the efficiency of processing media data.
The technical scheme of the embodiment of the application is realized as follows:
in a first aspect, an embodiment of the present application provides a data processing method, where the method is applied to a media forwarding device; the method comprises the following steps:
according to the address information of the target computing node sent by the service server, media data sent by the first terminal equipment are sent to the target computing node;
and receiving the processed media data sent by the target computing node.
In a second aspect, an embodiment of the present application provides a data processing method, where the method is applied to a computing node, and the computing node includes a target computing node; the method comprises the following steps:
the target computing node receives media data sent by media forwarding equipment;
performing data processing on the media data to obtain processed media data;
and sending the processed media data to the media forwarding device.
In a third aspect, an embodiment of the present application provides a data processing method, where the method is applied to a service server; the method comprises the following steps:
If the data processing is determined based on the service request sent by the first terminal equipment, determining a target computing node in at least one computing node based on the service request;
and sending the address information of the target computing node to a media forwarding device, so that the media forwarding device sends the media data received from the first terminal device to the target computing node according to the address information of the target computing node, and the target computing node performs data processing on the media data to obtain the processed media data.
In a fourth aspect, embodiments of the present application provide a media forwarding device, including a first sending unit and a first receiving unit,
the first sending unit is used for sending the media data sent by the first terminal equipment to the target computing node according to the address information of the target computing node sent by the service server;
the first receiving unit is configured to receive the processed media data sent by the target computing node.
In a fifth aspect, embodiments of the present application provide a computing node, where the computing node includes a target computing node; the computing node comprises a second receiving unit, a first processing unit and a second sending unit,
The second receiving unit is used for receiving the media data sent by the media forwarding device by the target computing node;
the first processing unit is used for carrying out data processing on the media data to obtain processed media data;
the second sending unit is configured to send the processed media data to the media forwarding device.
In a sixth aspect, embodiments of the present application provide a service server, where the service server includes a determining unit and a third sending unit,
the determining unit is used for determining a target power calculation node in at least one power calculation node based on the service request if the data processing is determined based on the service request sent by the first terminal equipment;
the third sending unit is configured to send the address information of the target computing node to a media forwarding device, so that the media forwarding device sends media data received from the first terminal device to the target computing node according to the address information of the target computing node, and the target computing node performs data processing on the media data to obtain processed media data.
In a seventh aspect, embodiments of the present application provide a media forwarding device, where the media forwarding device includes a first processor, and a first memory storing instructions executable by the first processor, where the instructions, when executed by the first processor, implement the method according to the first aspect.
In an eighth aspect, embodiments of the present application provide a computing node, where the computing node includes a target computing node; the computing node comprises a second processor, a second memory storing instructions executable by the second processor, which when executed by the second processor, implement the method according to the second aspect.
In a ninth aspect, an embodiment of the present application provides a service server, where the service server includes a third processor, and a third memory storing instructions executable by the third processor, where the instructions, when executed by the third processor, implement the method according to the third aspect.
In a tenth aspect, embodiments of the present application provide a computer readable storage medium having stored thereon a program for use in a media forwarding device, a computing node and a service server, the program, when executed by a first processor, implementing a method as described in the first aspect; the program, when executed by a second processor, implements a method as described in the second aspect; the program, when executed by a third processor, implements a method as described in the third aspect.
The embodiment of the application provides a data processing method, equipment and a storage medium, wherein the equipment comprises media forwarding equipment, a computing node and a service server; the media forwarding device may send the media data sent by the first terminal device to the target computing node according to the address information of the target computing node sent by the service server; and receiving the processed media data sent by the target computing node. The target computing node receives media data sent by the media forwarding device; performing data processing on the media data to obtain processed media data; and sending the processed media data to the media forwarding device. If the service server determines to process data based on the service request sent by the first terminal device, determining a target computing node in at least one computing node based on the service request; and sending the address information of the target computing node to the media forwarding device, so that the media forwarding device sends the media data received from the first terminal device to the target computing node according to the address information of the target computing node, and the target computing node performs data processing on the media data to obtain the processed media data. It can be seen that, in the present application, after the service server determines to perform data processing in response to the service request sent by the first terminal device, the target computing node may be determined in at least one computing node, so that address information of the target computing node is sent to the media forwarding device, and then the media forwarding device may send media data sent by the first terminal device to the target computing node according to the address information of the target computing node, where the target computing node performs data processing on the media data to obtain processed media data, and then feeds back the processed media data to the media forwarding device; therefore, the target computing node which can correspondingly process the media data according to the content of the service request is determined in the plurality of computing nodes, the targeted processing of the media data is realized, and the efficiency of processing the media data is greatly improved.
Drawings
FIG. 1 is a schematic diagram of a conventional multimedia service flow processing manner;
FIG. 2 is a schematic diagram illustrating an implementation flow of a data processing method according to an embodiment of the present application;
FIG. 3 is a second schematic implementation flow chart of the data processing method according to the embodiment of the present application;
fig. 4 is a schematic diagram of an implementation flow of a data processing method according to an embodiment of the present application;
fig. 5 is a schematic diagram of an implementation flow of a data processing method according to an embodiment of the present application;
fig. 6 is a schematic diagram of an implementation flow of a data processing method according to an embodiment of the present application;
FIG. 7 is a schematic diagram illustrating an implementation of a data processing method according to an embodiment of the present disclosure;
FIG. 8 is a functional schematic of an apparatus according to an embodiment of the present application;
FIG. 9 is a second schematic diagram illustrating an implementation of the data processing method according to the embodiment of the present application;
fig. 10 is a schematic diagram III of an implementation of a data processing method according to an embodiment of the present application;
fig. 11 is a schematic diagram of a composition structure of a media forwarding device according to an embodiment of the present application;
fig. 12 is a schematic diagram of a second component structure of the media forwarding device according to the embodiment of the present application;
FIG. 13 is a schematic diagram of a construction of a computing node according to an embodiment of the present disclosure;
Fig. 14 is a schematic diagram of a second component structure of the computing node according to the embodiment of the present application;
fig. 15 is a schematic diagram of a composition structure of a service server according to an embodiment of the present application;
fig. 16 is a schematic diagram of a second composition structure of the service server according to the embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. It is to be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to be limiting. It should be noted that, for convenience of description, only a portion related to the related application is shown in the drawings.
MMTel is an IMS-based multimedia telephone service standard jointly developed by two large standardization organizations of ETSI/TISPAN and 3GPP, and is a global standard specification; which supports the evolution of traditional circuit switched services into IP-based real-time multimedia telephony services including voice and video calls, messaging services, video image sharing, etc., while supporting fixed and mobile broadband access.
Artificial intelligence is a branch of computer science that attempts to understand the nature of intelligence and to produce a new intelligent machine that can react in a similar manner to human intelligence, research in this field including robotics, language recognition, image recognition, natural language processing, and expert systems.
Some mature applications of artificial intelligence, such as language identification, image identification, natural language processing, etc., are applied to the processing of multimedia telephony service media streams, which can provide a richer multimedia telephony service experience.
Fig. 1 is a schematic diagram of a processing manner of an existing multimedia service flow, and as shown in fig. 1, an existing implementation scheme of the service is that the multimedia service flow sequentially passes through a plurality of serially connected computing nodes according to specific application requirements, including a computing node 1 and a computing node 2 … computing node n; wherein, different computing power nodes correspondingly have different AI processing functions; executing AI processing corresponding to the application requirement; therefore, the possibility that the upper computing node affects the lower computing node exists, and when a processing fault occurs to a certain computing node, the multimedia service flow cannot be processed, so that the transmission failure or communication interruption of the whole media flow is caused, and the efficiency of processing the multimedia service flow is seriously affected.
In order to solve the problems of the data processing method in the prior art, the embodiments of the present application provide a data processing method, a device and a storage medium, where a media forwarding device sends media data sent by a first terminal device to a target computing node according to address information of the target computing node sent by a service server; and receiving the processed media data sent by the target computing node. The computing force nodes comprise target computing force nodes; the target computing node receives media data sent by the media forwarding device; performing data processing on the media data to obtain processed media data; and sending the processed media data to the media forwarding device. If the service server determines to process data based on the service request sent by the first terminal device, determining a target computing node in at least one computing node based on the service request; and sending the address information of the target computing node to the media forwarding device, so that the media forwarding device sends the media data received from the first terminal device to the target computing node according to the address information of the target computing node, and the target computing node performs data processing on the media data to obtain the processed media data. The efficiency of processing media data can be improved.
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
An embodiment of the present application provides a data processing method, where the data processing method is applied to a media forwarding device, fig. 2 is a schematic implementation flow diagram of the data processing method provided in the embodiment of the present application, and as shown in fig. 2, the data processing method of the media forwarding device may include the following steps:
step 101, according to address information of a target computing node sent by a service server, media data sent by a first terminal device are sent to the target computing node.
In the embodiment of the present application, the media forwarding device may send the media data sent by the first terminal device to the target computing node according to the address information of the target computing node sent by the service server.
It should be noted that, in the embodiment of the present application, the target computing node is a node in at least one computing node, and the at least one computing node may have different processing capabilities respectively; the at least one computing node may register respective processing capabilities on the service server in advance, so that the service server determines, after receiving the service request of the first terminal device, a target computing node according to the service request and the respective processing capabilities of the at least one computing node, and is configured to perform data processing corresponding to the content of the service request.
In an exemplary embodiment of the present application, the service request of the first terminal device is a caption added to a piece of video information (media data), so that the service server determines, according to the processing capabilities of the computing node A, B, C and D, that C may execute the processing capability of the caption added to the video, so that the target computing node is C.
It may be appreciated that in the embodiment of the present application, after determining the target computing node, the service server may send the address information of the target computing node to the media forwarding device, so that the media forwarding device may send the media data to the corresponding target computing node according to the address information of the target computing node.
In addition, in the embodiment of the present application, the first terminal device refers to a terminal device that initiates a service request to the service server, and after determining to perform data processing according to the service request, the service server may instruct the first terminal device to send media data to the media forwarding device, so that the media forwarding device may send the media data to the target computing node based on address information of the target computing node sent by the service server.
Illustratively, in an embodiment of the present application, the media forwarding device may receive the target computing node address multicast list sent by the service server, so that the media forwarding device may multicast the media data to the target computing node.
Step 102, receiving the processed media data sent by the target computing node.
In the embodiment of the present application, the media forwarding device may receive the processed media data sent by the target computing node after sending the media data sent by the first terminal device to the target computing node according to the address information of the target computing node sent by the service server.
It should be noted that, in the embodiment of the present application, after receiving the media data, the target computing node may perform data processing on the media data to obtain processed media data, and then send the processed media data to the media forwarding device.
Further, in an embodiment of the present application, the processed media data includes timestamp information.
Further, in an embodiment of the present application, after receiving the processed media data sent by the target computing node, i.e. after step 102, the media forwarding device may further include the following steps:
step 103, sending a query processing logic request to the service server.
In an embodiment of the present application, the media forwarding device may send a query processing logic request to the service server after receiving the processed media data sent by the target computing node.
It should be noted that, in the embodiments of the present application, the processing logic may include mixed-flow processing and non-mixed-flow processing.
Step 104, receiving response information of the service server responding to the query processing logic request.
In an embodiment of the present application, the media forwarding device may receive response information of the service server in response to the query processing logic request after sending the query processing logic request to the service server.
Step 105, if the response information indicates that the processing logic is mixed stream processing, the processed media data is sent to the media processing device, so that the media processing device performs mixed stream processing based on the processed media data to obtain mixed stream media data.
In the embodiment of the application, after receiving the response information of the service server in response to the query processing logic request, if the response information indicates that the processing logic is mixed stream processing, the media forwarding device sends the processed media data to the media processing device, so that the media processing device performs mixed stream processing based on the processed media data to obtain the media data after mixed stream processing.
In an exemplary embodiment of the present application, the service request is video information subtitling, and the response information received by the media forwarding device is mixed stream processing, so that the media forwarding device sends video information (processed media data) subjected to subtitling and other operations to the media processing device, the media processing device sets a media switch function to "mixed stream processing", and performs mixed stream on the original video information (media data) and the video information subjected to subtitling and other operations according to the timestamp information, so as to obtain final subtitled video information (media data after mixed stream).
Further, in the embodiment of the present application, after obtaining the media data after mixed streaming, the media processing device may directly send the media data after mixed streaming to the second terminal device; the second terminal equipment initiates a terminal of a receiving side corresponding to the service request for the first terminal equipment.
Further, in an embodiment of the present application, after receiving the response information of the service server in response to the query processing logic request, i.e. after step 104, the media forwarding device may further include the following steps:
and step 106, if the response information indicates that the processing logic is not mixed flow processing, establishing a data channel with the second terminal equipment.
In the embodiment of the application, after receiving the response information of the service server in response to the query processing logic request, if the response information indicates that the processing logic is not mixed flow processing, the media forwarding device establishes a data channel with the second terminal device.
It should be noted that, in the embodiment of the present application, when the processing logic is not mixed flow processing, the service server instructs the media forwarding device to establish a data channel with the second terminal device, so as to directly send the processed media data to the second terminal device.
Illustratively, in an embodiment of the present application, the media forwarding device performs session description protocol (Session Description Protocol, SDP) negotiation with the second terminal device in response to the data path establishment message indicated by the service server to establish a data path with the second terminal device.
And step 107, the processed media data is sent to the second terminal equipment through the data channel.
In the embodiment of the present application, if the response information of the media forwarding device indicates that the processing logic is not mixed stream processing, a data channel between the media forwarding device and the second terminal device is established, and then the processed media data is sent to the second terminal device through the data channel.
Further, after the media forwarding device sends the media data sent by the first terminal device to the target computing node according to the address information of the target computing node sent by the service server, that is, after step 101, the method may include the following steps:
and step 108, after receiving the fault information sent by the target power node, sending a fault notification of the target power node to the service server, so that the service server instructs the media processing device to start the media transparent function, and sending the media data received from the first terminal device to the second terminal device.
In the embodiment of the present application, after the media forwarding device sends the media data sent by the first terminal device to the target power node according to the address information of the target power node sent by the service server, the media forwarding device may send a fault notification of the target power node to the service server after receiving the fault information sent by the target power node, so that the service server instructs the media processing device to start the media transparent function, and sends the media data received from the first terminal device to the second terminal device.
It should be noted that, in the embodiment of the present application, if the target computing node fails, the media forwarding device is first notified, that is, the failure information is sent to the media forwarding device; and the media forwarding device informs the service server that the target computing node has a fault.
Further, in the embodiment of the present application, the media processing device is provided with a media transparent function, and when the target computing node fails and cannot perform data processing on the media data, the service server may directly instruct the media processing device to start the media transparent function, and simultaneously notify the first terminal device to directly send the media data to the media processing device, and the media processing device sends the media data to the second terminal device through the media transparent function.
The embodiment of the application provides a data processing method, a device and a storage medium, wherein a media forwarding device can send media data sent by a first terminal device to a target computing node according to address information of the target computing node sent by a service server; and receiving the processed media data sent by the target computing node. It can be seen that, in the present application, after the service server determines to perform data processing in response to the service request sent by the first terminal device, the target computing node may be determined in at least one computing node, so that address information of the target computing node is sent to the media forwarding device, and then the media forwarding device may send media data sent by the first terminal device to the target computing node according to the address information of the target computing node, where the target computing node performs data processing on the media data to obtain processed media data, and then feeds back the processed media data to the media forwarding device; therefore, the target computing node which can correspondingly process the media data according to the content of the service request is determined in the plurality of computing nodes, the targeted processing of the media data is realized, and the efficiency of processing the media data is greatly improved.
Another embodiment of the present application proposes a data processing method applied to a computing node, where the computing node includes a target computing node; fig. 3 is a second implementation flow chart of a data processing method according to an embodiment of the present application, where, as shown in fig. 3, the data processing method of the computing node may include the following steps:
step 201, the target computing node receives media data sent by the media forwarding device.
In embodiments of the present application, the target computing node may receive media data sent by the media forwarding device.
It should be noted that, in the embodiment of the present application, the target computing node is a node in at least one computing node, and the at least one computing node may have different processing capabilities respectively; the at least one computing node may register respective processing capabilities on the service server in advance, so that the service server determines, after receiving the service request of the first terminal device, a target computing node according to the service request and the respective processing capabilities of the at least one computing node, and is configured to perform data processing corresponding to the content of the service request.
In an exemplary embodiment of the present application, the service request of the first terminal device is a caption added to a piece of video information (media data), so that the service server determines, according to the processing capabilities of the computing node A, B, C and D, that C may execute the processing capability of the caption added to the video, so that the target computing node is C.
It may be appreciated that in the embodiment of the present application, after determining the target computing node, the service server may send the address information of the target computing node to the media forwarding device, so that the media forwarding device may send the media data to the corresponding target computing node according to the address information of the target computing node.
Step 202, performing data processing on the media data to obtain processed media data.
In the embodiment of the application, after receiving the media data sent by the media forwarding device, the target computing node may perform data processing on the media data to obtain the processed media data.
It may be appreciated that in embodiments of the present application, the data processing performed by the target computing node on the media data corresponds to the processing power of the target computing node itself; for example, if the processing capability of the target computing node is a "video face-changing" operation, the target computing node may perform data processing such as AI face-changing on video information (media data), thereby obtaining video information subjected to the AI face-changing processing.
It should be noted that, in the embodiment of the present application, the processed media data includes time stamp information.
Step 203, the processed media data is sent to a media forwarding device.
In the embodiment of the application, after performing data processing on the media data by the target computing node to obtain the processed media data, the processed media data may be sent to the media forwarding device.
Further, in an embodiment of the present application, after the target computing node receives the media data sent by the media forwarding device, i.e. after step 201, the following steps may be included:
and 204, if the data processing is not performed on the media data, sending fault information to the media forwarding equipment.
In the embodiment of the application, after receiving the media data sent by the media forwarding device, the target computing node sends fault information to the media forwarding device if the media data is not processed.
It should be noted that, in the embodiment of the present application, when the target computing node fails, data processing cannot be performed on the media data, and at this time, failure information may be sent to the media forwarding device.
Further, in the embodiment of the present application, after receiving the fault information sent by the target power node, the media forwarding device may send a fault notification of the target power node to the service server, so that the service server instructs the media processing device to start the media transparent function, and sends the media data received from the first terminal device to the second terminal device.
The embodiment of the application provides a data processing method, wherein a target computing node receives media data sent by media forwarding equipment; performing data processing on the media data to obtain processed media data; and sending the processed media data to the media forwarding device. It can be seen that, in the present application, after the service server determines to perform data processing in response to the service request sent by the first terminal device, the target computing node may be determined in at least one computing node, so that address information of the target computing node is sent to the media forwarding device, and then the media forwarding device may send media data sent by the first terminal device to the target computing node according to the address information of the target computing node, where the target computing node performs data processing on the media data to obtain processed media data, and then feeds back the processed media data to the media forwarding device; therefore, the target computing node which can correspondingly process the media data according to the content of the service request is determined in the plurality of computing nodes, the targeted processing of the media data is realized, and the efficiency of processing the media data is greatly improved.
In yet another embodiment of the present application, a data processing method is provided, which is applied to a service server; fig. 4 is a third implementation flow chart of a data processing method according to an embodiment of the present application, as shown in fig. 4, the data processing method of a service server may include the following steps:
step 301, if it is determined to perform data processing based on the service request sent by the first terminal device, determining a target computing node of the at least one computing node based on the service request.
In an embodiment of the present application, if the service server determines to perform data processing based on the service request sent by the first terminal device, a target computing node of the at least one computing node is determined based on the service request.
It should be noted that, in the embodiment of the present application, after the service server receives the service request sent by the first terminal device, it may be determined whether to perform data processing according to the service subscription condition of the first terminal device.
In an exemplary embodiment of the present application, the service request sent by the first terminal device is a voice processing of the video, and after the service server queries the service subscription condition of the first terminal device, it is determined that the first terminal device has subscribed to related services such as voice processing of the video, so that the service can be supported, and therefore, the service server can determine to perform data processing; on the contrary, if the first terminal device has not subscribed to related services such as voice processing of the video, such services cannot be supported, and the service server determines not to perform data processing.
It should be noted that, in the embodiment of the present application, the target computing node is a node in at least one computing node, and the at least one computing node may have different processing capabilities respectively; the at least one computing node may register respective processing capabilities on the service server in advance, so that the service server determines, after receiving the service request of the first terminal device, a target computing node according to the service request and the respective processing capabilities of the at least one computing node, and is configured to perform data processing corresponding to the content of the service request.
In an exemplary embodiment of the present application, the service request of the first terminal device is a caption added to a piece of video information (media data), so that the service server determines, according to the processing capabilities of the computing node A, B, C and D, that C may execute the processing capability of the caption added to the video, so that the target computing node is C.
Step 302, sending address information of the target computing node to the media forwarding device, so that the media forwarding device sends media data received from the first terminal device to the target computing node according to the address information of the target computing node, and the target computing node performs data processing on the media data to obtain processed media data.
In the embodiment of the present application, if the service server determines to perform data processing based on the service request sent by the first terminal device, after determining the target computing node in the at least one computing node based on the service request, the address information of the target computing node may be sent to the media forwarding device, so that the media forwarding device sends the media data received from the first terminal device to the target computing node according to the address information of the target computing node, so that the target computing node performs data processing on the media data, and obtains the processed media data.
Further, in an embodiment of the present application, after sending the address information of the target computing node to the media forwarding device, the service server may further include the following steps:
step 303, responding to the inquiry processing logic request sent by the media forwarding device, determining processing logic according to the service request, and sending the processing logic to the media forwarding device; wherein the processing logic includes mixed stream processing and non-mixed stream processing.
In the embodiment of the application, after sending the address information of the target computing node to the media forwarding device, the service server may respond to the query processing logic request sent by the media forwarding device, determine the processing logic according to the service request, and send the processing logic to the media forwarding device; wherein the processing logic includes mixed stream processing and non-mixed stream processing.
It should be noted that, in the embodiment of the present application, after the media forwarding device sends the media data to the target computing node according to the address information of the target computing node, the target computing node may perform data processing on the media data to obtain processed media data, and then the target computing node feeds back the processed media data to the media forwarding device; in turn, the media forwarding device may initiate a query processing logic request to the service server.
Further, in an embodiment of the present application, if the service server determines that the processing logic is mixed stream processing, the media forwarding device is instructed to send the processed media data to the media processing device, and the media processing device performs mixed stream processing based on the processed media data.
Further, in the embodiment of the present application, if the service server determines that the processing logic is not mixed stream processing, the media forwarding device is instructed to establish a data channel with the second terminal device, so that the processed media data is directly sent to the second terminal device.
Further, in an embodiment of the present application, after sending the address information of the target computing node to the media forwarding device, the service server may further include the following steps:
Step 304, if the failure notification of the target computing power node sent by the media forwarding device is received, a media transparent instruction is sent to the media processing device, so that the media processing device starts a media transparent function according to the media transparent instruction, and media data received from the first terminal device is sent to the second terminal device.
In the embodiment of the application, after sending the address information of the target power node to the media forwarding device, if the service server receives the fault notification of the target power node sent by the media forwarding device, a media transparent instruction is sent to the media processing device, so that the media processing device starts a media transparent function according to the media transparent instruction, and media data received from the first terminal device is sent to the second terminal device.
It should be noted that, in the embodiment of the present application, after the service server sends the address information of the target computing node to the media forwarding device, the media forwarding device may send the media data to the target computing node according to the address information of the target computing node, and at this time, if the target computing node fails and cannot perform data processing, the service server may send failure information to the media forwarding device, and further, the media forwarding device may send failure notification of the target computing node to the service server.
Further, in the embodiment of the present application, the media processing device is provided with a media transparent function, and when the target computing node fails and cannot perform data processing on the media data, the service server may directly instruct the media processing device to start the media transparent function, and simultaneously notify the first terminal device to directly send the media data to the media processing device, and the media processing device sends the media data to the second terminal device through the media transparent function.
Further, in the embodiment of the present application, if the service server determines to perform data processing based on the service request sent by the first terminal device, before determining the target computing node in the at least one computing node based on the service request, that is, before step 301, the method may further include the following steps:
step 305, determining respective data processing capabilities of the at least one computing node in response to respective capability registration requests of the at least one computing node.
In the embodiment of the present application, if the service server determines to perform data processing based on the service request sent by the first terminal device, before determining the target computing node in the at least one computing node based on the service request, the data processing capability of each of the at least one computing node may be determined in response to the capability registration request of each of the at least one computing node.
It should be noted that, in the embodiment of the present application, at least one computing node may register respective computing capabilities on the service server in advance, so that after the service server receives a service request of any terminal device, the service server may determine, according to respective data processing capabilities of at least one computing node, a target computing node capable of being used to implement the service request.
Further, in an embodiment of the present application, the data processing method of the service server may further include the following steps:
and 306, if the data processing is not performed based on the service request sent by the first terminal equipment, the first terminal equipment is instructed to send the media data to the media processing equipment, and a media transparent instruction is sent to the media processing equipment, so that the media processing equipment starts a media transparent function according to the media transparent instruction, and the media data received from the first terminal equipment is sent to the second terminal equipment.
In the embodiment of the application, if the service server determines that data processing is not performed based on the service request sent by the first terminal device, the first terminal device is instructed to send media data to the media processing device, and a media transparent instruction is sent to the media processing device, so that the media processing device starts a media transparent function according to the media transparent instruction, and sends the media data received from the first terminal device to the second terminal device.
The embodiment of the application provides a data processing method, if a service server determines to process data based on a service request sent by first terminal equipment, determining a target computing node in at least one computing node based on the service request; and sending the address information of the target computing node to the media forwarding device, so that the media forwarding device sends the media data received from the first terminal device to the target computing node according to the address information of the target computing node, and the target computing node performs data processing on the media data to obtain the processed media data. It can be seen that, in the present application, after the service server determines to perform data processing in response to the service request sent by the first terminal device, the target computing node may be determined in at least one computing node, so that address information of the target computing node is sent to the media forwarding device, and then the media forwarding device may send media data sent by the first terminal device to the target computing node according to the address information of the target computing node, where the target computing node performs data processing on the media data to obtain processed media data, and then feeds back the processed media data to the media forwarding device; therefore, the target computing node which can correspondingly process the media data according to the content of the service request is determined in the plurality of computing nodes, the targeted processing of the media data is realized, and the efficiency of processing the media data is greatly improved.
In summary, in still another embodiment of the present application, fig. 5 is a schematic diagram showing a realization flow chart of the data processing method according to the embodiment of the present application, and as shown in fig. 5, the data processing method may include the following steps:
step 401, a service server receives a service request sent by a first terminal device, and determines whether to perform data processing.
Step 402, if the service server determines to perform data processing, determining a target computing node in at least one computing node, and sending address information of the target computing node to the media forwarding device.
Step 403, the media forwarding device sends the media data received from the first terminal device to the target computing node.
And step 404, the target computing node performs data processing on the media data to obtain processed media data.
Step 405, the target computing node sends the processed media data to the media forwarding device.
Step 406, the media forwarding device sends a query processing logic request to the service server.
Step 407, if the processing logic received by the media forwarding device is mixed stream processing, the processed media data is sent to the media processing device, so that the media processing device performs mixed stream processing based on the processed media data to obtain mixed stream media data.
Further, after obtaining the mixed stream media data, the media processing device may send the mixed stream media data to the second terminal device, so as to complete the service request.
Step 408, if the processing logic received by the media forwarding device is not mixed stream processing, a data channel between the media forwarding device and the second terminal device is established, and the processed media data is sent to the second terminal device through the data channel.
Further, after the service server receives the service request sent by the first terminal device and determines whether to perform data processing, i.e. after step 401, the data processing method may further include the following steps:
and 409, if the service server determines that the data processing is not performed, instructing the first terminal device to send the media data to the media processing device, and sending a media transparent instruction to the media processing device, so that the media processing device starts a media transparent function according to the media transparent instruction, and sending the media data received from the first terminal device to the second terminal device.
Further, fig. 6 is a schematic diagram of a flow chart of implementation of the data processing method according to the embodiment of the present application, as shown in fig. 6, after the media forwarding device sends the media data received from the first terminal device to the target computing node, that is, after step 403, the method may further include the following steps:
Step 410, the media forwarding device receives the fault information sent by the target computing node, and sends a fault notification of the target computing node to the service server.
In step 411, the service server instructs the media processing device to start a media transparent function, so that the media processing device sends the media data received from the first terminal device to the second terminal device.
Fig. 7 is a schematic diagram illustrating an implementation of a data processing method according to an embodiment of the present application, as shown in fig. 7, where the data processing method of the present application may be implemented based on a terminal a, a terminal B, a service server, a media forwarding device, an computing node, and a media processing device.
Fig. 8 is a schematic functional diagram of an apparatus according to an embodiment of the present application, as shown in fig. 8, where a terminal a is a first terminal device, a terminal B is a second terminal device, a service server includes a computing power registration function and a service logic function, a media forwarding device includes a media data receiving function and a multicast function, a plurality of computing power nodes, for example, computing power node 1, computing power node 2 …, computing power node n, and a media processing device may include a mixed flow processing function, a media transparent selection function, and a data channel establishment function.
The service server can receive and respond to the registration request of the computing node, receive and respond to the service request of the terminal A, receive and respond to the inquiry processing logic request of the media forwarding function, and send the inquiry processing logic request to relevant materials and element information of the computing node according to the service request; the computing power registration function in the service server can receive the capability registration requests of all computing power nodes, and the service logic function can be responsible for designating computing power nodes and associated actions required by the service requests and for normal service connection after processing failure of the computing power nodes.
The media forwarding device may receive media data from the terminal a and forward and multicast the media data to the computing node and the media processing device; the media forwarding device comprises a media data receiving and forwarding function and a multicast function, wherein the media data receiving function can be responsible for receiving media data, and the multicast function can be responsible for multicasting the media data to the computing nodes according to service requirements.
The power computing node 1 and the power computing node 2 and the power computing node … may have different AI processing functions, for example, voice conversion, machine translation, gesture recognition, expression recognition, and voice keyword recognition.
The media processing device can receive the media data sent by the media forwarding device, process the media data and send the processed media data to the receiving terminal; the mixed stream processing function can align the media data with the processed media data according to the timestamp information and superimpose the media data, thereby completing mixed stream processing; the media transparent transmission selection function can realize media transparent transmission when the media transparent transmission function is started; the data channel establishing function may establish a data channel between the media processing device and the terminal B, so that the processed media data is transmitted to the terminal B through the data channel.
Fig. 9 is a schematic diagram for implementing a data processing method according to an embodiment of the present application, where, as shown in fig. 9, a computing node may perform computing capability registration on a service server in advance; further, when the terminal a initiates a service request to the service server, the service server judges whether to process the media data, if it is determined that the media data does not need to be processed, a normal multimedia telephone call control flow is executed, the media processing device is instructed to start a media transparent transmission function, and the media data is sent to the terminal B; if the service server determines to process the media data, after determining the target computing node, sending the address information of the target computing node to the media forwarding device, and sending the media data to the target computing node by the media forwarding device according to the address information of the target computing node, wherein the target computing node performs data processing on the media data to obtain processed media data, and the processed media data contains timestamp information; the target computing node sends the processed media data to media forwarding equipment, the media forwarding equipment requests to query processing logic from a service server, the service server determines whether mixed flow is needed, if the service server indicates that the processing logic is mixed flow processing, the media forwarding equipment sends the processed media data to media processing equipment, the media processing equipment carries out mixed flow processing based on the processed media data and original media data to obtain media data after mixed flow, and the media data after mixed flow is sent to a terminal B; if the service server indicates that the processing logic is not mixed stream processing, the media forwarding device establishes a data channel with the terminal B, and sends the processed media data to the terminal B through the data channel.
In addition, fig. 10 is a schematic diagram of a third implementation of the data processing method provided in the embodiment of the present application, as shown in fig. 10, after the media forwarding device sends media data to the target power node, if the target power node fails and cannot process the media data, failure information is sent to the media forwarding device, and the media forwarding device sends a failure notification of the target power node to the service server, so that the service server responds and makes a decision according to the failure notification of the target power node, including notifying the media processing device to set a media transparent transmission function, and sending the media data to the terminal B.
The embodiment of the application provides a data processing method, wherein media forwarding equipment can send media data sent by first terminal equipment to a target computing node according to address information of the target computing node sent by a service server; and receiving the processed media data sent by the target computing node. The target computing node receives media data sent by the media forwarding device; performing data processing on the media data to obtain processed media data; and sending the processed media data to the media forwarding device. If the service server determines to process data based on the service request sent by the first terminal device, determining a target computing node in at least one computing node based on the service request; and sending the address information of the target computing node to the media forwarding device, so that the media forwarding device sends the media data received from the first terminal device to the target computing node according to the address information of the target computing node, and the target computing node performs data processing on the media data to obtain the processed media data. It can be seen that, in the present application, after the service server determines to perform data processing in response to the service request sent by the first terminal device, the target computing node may be determined in at least one computing node, so that address information of the target computing node is sent to the media forwarding device, and then the media forwarding device may send media data sent by the first terminal device to the target computing node according to the address information of the target computing node, where the target computing node performs data processing on the media data to obtain processed media data, and then feeds back the processed media data to the media forwarding device; therefore, the target computing node which can correspondingly process the media data according to the content of the service request is determined in the plurality of computing nodes, the targeted processing of the media data is realized, and the efficiency of processing the media data is greatly improved.
Based on the above embodiments, in another embodiment of the present application, fig. 11 is a schematic diagram of the composition structure of the media forwarding device according to the embodiment of the present application, and as shown in fig. 11, the media forwarding device 10 according to the embodiment of the present application may include a first sending unit 11, a first receiving unit 12, and a creating unit 13.
The first sending unit 11 is configured to send media data sent by the first terminal device to a target computing node according to address information of the target computing node sent by the service server.
The first receiving unit 12 is configured to receive the processed media data sent by the target computing node.
Further, the first sending unit 11 is further configured to send a query processing logic request to the service server after the first receiving unit 12 receives the processed media data sent by the target computing node.
Further, the first receiving unit 12 is further configured to receive response information of the service server in response to the query processing logic request.
Further, the first sending unit 11 is further configured to send the processed media data to a media processing device if the response information indicates that the processing logic is mixed stream processing, so that the media processing device performs mixed stream processing based on the processed media data to obtain mixed stream media data.
The creating unit 13 is configured to, after the first receiving unit 12 receives the response information of the service server in response to the query processing logic request, establish a data channel with the second terminal device if the response information indicates that the processing logic is not mixed flow processing; and sending the processed media data to the second terminal equipment through the data channel.
Further, the first sending unit 11 is further configured to send, after sending the media data sent by the first terminal device to the target power node according to the address information of the target power node sent by the service server, after receiving the fault information sent by the target power node, a target power node fault notification to the service server, so that the service server instructs the media processing device to start a media transparent function, and send the media data received from the first terminal device to the second terminal device.
Fig. 12 is a schematic diagram of a second component structure of a media forwarding device according to an embodiment of the present application, as shown in fig. 12, the media forwarding device 10 according to an embodiment of the present application may further include a first processor 14, a first memory 15 storing instructions executable by the first processor 14, and further, the media forwarding device 10 may further include a first communication interface 16, and a first bus 17 for connecting the first processor 14, the first memory 15, and the first communication interface 16.
In an embodiment of the present application, the first processor 14 may be at least one of an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a digital signal processor (Digital Signal Processor, DSP), a digital terminal (Digital Signal Processing Device, DSPD), a programmable logic device (Programmable Logic Device, PLD), a field programmable gate array (Field Programmable Gate Array, FPGA), a central processing unit (Central Processing Unit, CPU), a controller, a microcontroller, and a microprocessor. It will be appreciated that the electronic device for implementing the above-mentioned processor function may be other for different apparatuses, and embodiments of the present application are not specifically limited. The first processor 14 may further comprise a first memory 15, which first memory 15 may be connected to the first processor 14, wherein the first memory 15 is adapted to store executable program code comprising computer operating instructions, which first memory 15 may comprise a high speed RAM memory, and may further comprise a non-volatile memory, e.g. at least two disk memories.
In the embodiment of the present application, the first bus 17 is used to connect the first communication interface 16, the first processor 14 and the first memory 15 and the mutual communication between these devices.
In an embodiment of the present application, the first memory 15 is used for storing instructions and data.
Further, in the embodiment of the present application, the first processor 14 is configured to send, according to address information of a target computing node sent by a service server, media data sent by a first terminal device to the target computing node; and receiving the processed media data sent by the target computing node.
In practical applications, the first Memory 15 may be a volatile Memory (RAM), such as a Random-Access Memory (RAM); or a nonvolatile Memory (non-volatile Memory), such as a Read-Only Memory (ROM), a flash Memory (flash Memory), a Hard Disk (HDD) or a Solid State Drive (SSD); or a combination of the above types of memories and provides instructions and data to the first processor 14.
In an embodiment of the present application, the force calculation node includes a target force calculation node; fig. 13 is a schematic diagram of the composition structure of the computing node according to the embodiment of the present application, as shown in fig. 13, the computing node 20 according to the embodiment of the present application includes a second receiving unit 21, a first processing unit 22, and a second transmitting unit 23.
The second receiving unit 21 is configured to receive, by using the target computing node, media data sent by a media forwarding device;
the first processing unit 22 is configured to perform data processing on the media data to obtain processed media data;
the second sending unit 23 is configured to send the processed media data to the media forwarding device.
Further, the second sending unit 23 is further configured to send failure information to the media forwarding device if the media data is not processed after the second receiving unit 21 receives the media data sent by the media forwarding device.
Fig. 14 is a schematic diagram of a second component structure of the computing node according to the embodiment of the present application, as shown in fig. 14, the computing node 20 according to the embodiment of the present application may further include a second processor 24, a second memory 25 storing executable instructions of the second processor 24, and further, the computing node 20 may further include a second communication interface 26, and a second bus 27 for connecting the second processor 24, the second memory 25, and the second communication interface 26.
In an embodiment of the present application, the second processor 24 may be at least one of an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a digital signal processor (Digital Signal Processor, DSP), a digital terminal (Digital Signal Processing Device, DSPD), a programmable logic device (Programmable Logic Device, PLD), a field programmable gate array (Field Programmable Gate Array, FPGA), a central processing unit (Central Processing Unit, CPU), a controller, a microcontroller, and a microprocessor. It will be appreciated that the electronic device for implementing the above-mentioned processor function may be other for different apparatuses, and embodiments of the present application are not specifically limited. The second processor 24 may further comprise a second memory 25, which second memory 25 may be connected to the second processor 24, wherein the second memory 25 is adapted to store executable program code comprising computer operating instructions, which second memory 25 may comprise a high speed RAM memory, and may further comprise a non-volatile memory, e.g. at least two disk memories.
In the embodiment of the present application, the second bus 27 is used to connect the second communication interface 26, the second processor 24 and the second memory 25, as well as the mutual communication between these devices.
In an embodiment of the present application, the second memory 25 is used for storing instructions and data.
Further, in the embodiment of the present application, the second processor 24 is configured to receive, by the target computing node, media data sent by the media forwarding device; performing data processing on the media data to obtain processed media data; and sending the processed media data to the media forwarding device.
In practical applications, the second Memory 25 may be a volatile Memory (RAM), such as a Random-Access Memory (RAM); or a nonvolatile Memory (non-volatile Memory), such as a Read-Only Memory (ROM), a flash Memory (flash Memory), a Hard Disk (HDD) or a Solid State Drive (SSD); or a combination of the above types of memories and provides instructions and data to the second processor 24.
Fig. 15 is a schematic diagram of the composition structure of a service server according to an embodiment of the present application, and as shown in fig. 15, a service server 30 according to an embodiment of the present application may include a determining unit 31 and a third sending unit 32.
The determining unit 31 is configured to determine, if it is determined to perform data processing based on a service request sent by the first terminal device, a target computing node of at least one computing node based on the service request;
the third sending unit 32 is configured to send the address information of the target computing node to a media forwarding device, so that the media forwarding device sends media data received from the first terminal device to the target computing node according to the address information of the target computing node, and the target computing node performs data processing on the media data to obtain processed media data.
Further, the determining unit 31 is further configured to, after the third sending unit 32 sends the address information of the target computing node to a media forwarding device, determine processing logic according to the service request in response to a query processing logic request sent by the media forwarding device, and send the processing logic to the media forwarding device; wherein the processing logic includes mixed stream processing and non-mixed stream processing.
Further, the third sending unit 32 is further configured to send a media transparent instruction to a media processing device after sending the address information of the target power node to the media forwarding device, if a failure notification of the target power node sent by the media forwarding device is received, so that the media processing device starts a media transparent function according to the media transparent instruction, and sends the media data received from the first terminal device to the second terminal device.
Further, the third sending unit 32 is further configured to instruct the first terminal device to send the media data to a media processing device if it is determined that data processing is not performed based on the service request sent by the first terminal device, and send a media transparent instruction to the media processing device, so that the media processing device starts a media transparent function according to the media transparent instruction, and sends the media data received from the first terminal device to a second terminal device.
Further, the determining unit 31 is further configured to determine, if data processing is determined based on the service request sent by the first terminal device, respective data processing capabilities of at least one computing node in response to respective capability registration requests of the at least one computing node before determining, based on the service request, a target computing node of the at least one computing node.
Fig. 16 is a schematic diagram of a second component structure of the service server according to the embodiment of the present application, as shown in fig. 16, the service server 30 according to the embodiment of the present application may further include a third processor 33, a third memory 34 storing executable instructions of the third processor 33, and further, the terminal 10 may further include a third communication interface 35, and a third bus 36 for connecting the third processor 33, the third memory 34, and the third communication interface 35.
In an embodiment of the present application, the third processor 33 may be at least one of an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a digital signal processor (Digital Signal Processor, DSP), a digital terminal (Digital Signal Processing Device, DSPD), a programmable logic device (Programmable Logic Device, PLD), a field programmable gate array (Field Programmable Gate Array, FPGA), a central processing unit (Central Processing Unit, CPU), a controller, a microcontroller, and a microprocessor. It will be appreciated that the electronic device for implementing the above-mentioned processor function may be other for different apparatuses, and embodiments of the present application are not specifically limited. The third processor 33 may further comprise a third memory 34, which third memory 34 may be connected to the third processor 33, wherein the third memory 34 is adapted to store executable program code comprising computer operation instructions, and the third memory 34 may comprise a high speed RAM memory or may further comprise a non-volatile memory, e.g. at least two disk memories.
In the embodiment of the present application, the third bus 36 is used to connect the third communication interface 35, the third processor 33, and the third memory 34, and the mutual communication between these devices.
In an embodiment of the present application, the third memory 34 is used for storing instructions and data.
Further, in the embodiment of the present application, the third processor 33 is configured to determine, if it is determined to perform data processing based on a service request sent by the first terminal device, a target computing node of at least one computing node based on the service request; and sending the address information of the target computing node to a media forwarding device, so that the media forwarding device sends the media data received from the first terminal device to the target computing node according to the address information of the target computing node, and the target computing node performs data processing on the media data to obtain the processed media data.
In practical applications, the third Memory 34 may be a volatile Memory (RAM), such as a Random-Access Memory (RAM); or a nonvolatile Memory (non-volatile Memory), such as a Read-Only Memory (ROM), a flash Memory (flash Memory), a Hard Disk (HDD) or a Solid State Drive (SSD); or a combination of memories of the above kind and providing instructions and data to the third processor 33.
In addition, each functional module in the present embodiment may be integrated in one analysis unit, each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional modules.
The integrated units, if implemented in the form of software functional modules, may be stored in a computer-readable storage medium, if not sold or used as separate products, and based on this understanding, the technical solution of the present embodiment may be embodied essentially or partly in the form of a software product, or all or part of the technical solution, which is stored in a storage medium, and includes several instructions to cause a computer device (which may be a personal computer, a server, or a terminal, etc.) or processor (processor) to perform all or part of the steps of the method of the present embodiment. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The embodiment of the application provides a device, wherein a media forwarding device can send media data sent by a first terminal device to a target computing node according to address information of the target computing node sent by a service server; and receiving the processed media data sent by the target computing node. The target computing node receives media data sent by the media forwarding device; performing data processing on the media data to obtain processed media data; and sending the processed media data to the media forwarding device. If the service server determines to process data based on the service request sent by the first terminal device, determining a target computing node in at least one computing node based on the service request; and sending the address information of the target computing node to the media forwarding device, so that the media forwarding device sends the media data received from the first terminal device to the target computing node according to the address information of the target computing node, and the target computing node performs data processing on the media data to obtain the processed media data. It can be seen that, in the present application, after the service server determines to perform data processing in response to the service request sent by the first terminal device, the target computing node may be determined in at least one computing node, so that address information of the target computing node is sent to the media forwarding device, and then the media forwarding device may send media data sent by the first terminal device to the target computing node according to the address information of the target computing node, where the target computing node performs data processing on the media data to obtain processed media data, and then feeds back the processed media data to the media forwarding device; therefore, the target computing node which can correspondingly process the media data according to the content of the service request is determined in the plurality of computing nodes, the targeted processing of the media data is realized, and the efficiency of processing the media data is greatly improved.
Specifically, the program instructions corresponding to one data processing method in the present embodiment may be stored on a storage medium such as an optical disc, a hard disc, a usb disk, or the like; when the program instructions in the storage medium corresponding to one of the data processing methods are read or executed by the first processor, the method comprises the steps of:
according to the address information of the target computing node sent by the service server, media data sent by the first terminal equipment are sent to the target computing node;
and receiving the processed media data sent by the target computing node.
When the program instructions in the storage medium corresponding to one data processing method are read or executed by the second processor, the method comprises the following steps:
the target computing node receives media data sent by the media forwarding device;
performing data processing on the media data to obtain processed media data;
and sending the processed media data to the media forwarding device.
When the program instructions in the storage medium corresponding to one of the data processing methods are read or executed by the third processor, the method comprises the steps of:
if the data processing is determined based on the service request sent by the first terminal equipment, determining a target computing node in at least one computing node based on the service request;
And sending the address information of the target computing node to a media forwarding device, so that the media forwarding device sends the media data received from the first terminal device to the target computing node according to the address information of the target computing node, and the target computing node performs data processing on the media data to obtain the processed media data.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, magnetic disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of implementations of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each block and/or flow of the flowchart illustrations and/or block diagrams, and combinations of blocks and/or flow diagrams in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart block or blocks and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart block or blocks and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks and/or block diagram block or blocks.
The foregoing is illustrative of the preferred embodiments of the present application and is not intended to limit the scope of the present application.

Claims (18)

1. A data processing method, characterized in that the method is applied to a media forwarding device; the method comprises the following steps:
according to the address information of the target computing node sent by the service server, media data sent by the first terminal equipment are sent to the target computing node;
And receiving the processed media data sent by the target computing node.
2. The method of claim 1, wherein after receiving the processed media data sent by the target computing node, the method further comprises:
sending a query processing logic request to the service server;
receiving response information of the service server responding to the query processing logic request;
and if the response information indicates that the processing logic is mixed stream processing, sending the processed media data to media processing equipment so that the media processing equipment performs mixed stream processing based on the processed media data to obtain mixed stream media data.
3. The method of claim 2, wherein after receiving the response information of the service server in response to the query processing logic request, the method further comprises:
if the response information indicates that the processing logic is not mixed flow processing, a data channel between the second terminal equipment and the second terminal equipment is established;
and sending the processed media data to the second terminal equipment through the data channel.
4. The method according to claim 1, wherein after the media data sent by the first terminal device is sent to the target computing node according to the address information of the target computing node sent by the service server, the method further comprises:
And after receiving the fault information sent by the target power node, sending a fault notification of the target power node to the service server, so that the service server instructs the media processing device to start a media transparent transmission function, and sending the media data received from the first terminal device to the second terminal device.
5. A data processing method, wherein the method is applied to a computing node, and the computing node comprises a target computing node; the method comprises the following steps:
the target computing node receives media data sent by media forwarding equipment;
performing data processing on the media data to obtain processed media data;
and sending the processed media data to the media forwarding device.
6. The method of claim 5, wherein after the target computing node receives the media data sent by the media forwarding device, the method further comprises:
and if the media data is not processed, sending fault information to the media forwarding equipment.
7. A data processing method, characterized in that the method is applied to a service server; the method comprises the following steps:
If the data processing is determined based on the service request sent by the first terminal equipment, determining a target computing node in at least one computing node based on the service request;
and sending the address information of the target computing node to a media forwarding device, so that the media forwarding device sends the media data received from the first terminal device to the target computing node according to the address information of the target computing node, and the target computing node performs data processing on the media data to obtain the processed media data.
8. The method of claim 7, wherein after the sending the address information of the target computing node to a media forwarding device, the method further comprises:
responding to a query processing logic request sent by the media forwarding device, determining processing logic according to the service request, and sending the processing logic to the media forwarding device; wherein the processing logic includes mixed stream processing and non-mixed stream processing.
9. The method of claim 7, wherein after the sending the address information of the target computing node to a media forwarding device, the method further comprises:
And if the target power node fault notification sent by the media forwarding device is received, sending a media transparent instruction to the media processing device, so that the media processing device starts a media transparent function according to the media transparent instruction, and sending the media data received from the first terminal device to the second terminal device.
10. The method of claim 7, wherein the method further comprises:
and if the data processing is not performed based on the service request sent by the first terminal equipment, the first terminal equipment is instructed to send the media data to the media processing equipment, and a media transparent instruction is sent to the media processing equipment, so that the media processing equipment starts a media transparent function according to the media transparent instruction, and the media data received from the first terminal equipment is sent to the second terminal equipment.
11. The method of claim 7, wherein if the data processing is determined based on the service request sent by the first terminal device, before determining the target computing node of the at least one computing node based on the service request, the method further comprises:
Responsive to the respective capability registration request of the at least one computing node, a respective data processing capability of the at least one computing node is determined.
12. A media forwarding device, characterized in that the media forwarding device comprises a first transmitting unit and a first receiving unit,
the first sending unit is used for sending the media data sent by the first terminal equipment to the target computing node according to the address information of the target computing node sent by the service server;
the first receiving unit is configured to receive the processed media data sent by the target computing node.
13. A computing force node, wherein the computing force node comprises a target computing force node; the computing node comprises a second receiving unit, a first processing unit and a second sending unit,
the second receiving unit is used for receiving the media data sent by the media forwarding device by the target computing node;
the first processing unit is used for carrying out data processing on the media data to obtain processed media data;
the second sending unit is configured to send the processed media data to the media forwarding device.
14. A service server, characterized in that the service server comprises a determining unit and a third transmitting unit,
the determining unit is used for determining a target power calculation node in at least one power calculation node based on the service request if the data processing is determined based on the service request sent by the first terminal equipment;
the third sending unit is configured to send the address information of the target computing node to a media forwarding device, so that the media forwarding device sends media data received from the first terminal device to the target computing node according to the address information of the target computing node, and the target computing node performs data processing on the media data to obtain processed media data.
15. A media forwarding device comprising a first processor, a first memory storing instructions executable by the first processor, which when executed by the first processor, implement the method of any of claims 1-4.
16. A computing force node, wherein the computing force node comprises a target computing force node; the computing node comprising a second processor, a second memory storing instructions executable by the second processor, which when executed by the second processor, implement the method of claim 5 or 6.
17. A service server comprising a third processor, a third memory storing instructions executable by the third processor, which when executed by the third processor, implement the method of any of claims 7-11.
18. A computer readable storage medium having stored thereon a program for use in a media forwarding device, a computing node and a service server, wherein the program, when executed by a first processor, implements the method of any of claims 1-4; the program, when executed by a second processor, implementing the method of claim 5 or 6; the program, when executed by a third processor, implements the method of any of claims 7-11.
CN202211159431.3A 2022-09-22 2022-09-22 Data processing method, device and storage medium Pending CN117793072A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211159431.3A CN117793072A (en) 2022-09-22 2022-09-22 Data processing method, device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211159431.3A CN117793072A (en) 2022-09-22 2022-09-22 Data processing method, device and storage medium

Publications (1)

Publication Number Publication Date
CN117793072A true CN117793072A (en) 2024-03-29

Family

ID=90389689

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211159431.3A Pending CN117793072A (en) 2022-09-22 2022-09-22 Data processing method, device and storage medium

Country Status (1)

Country Link
CN (1) CN117793072A (en)

Similar Documents

Publication Publication Date Title
US20160119395A1 (en) Method for supporting multicast of streaming media, and related apparatus and system
CN113709190B (en) Service setting method and device, storage medium and electronic equipment
EP2672678B1 (en) Method, apparatus and terminal device for internet protocol television content sharing
EP2375670B1 (en) Setting up metohd, pushing system and corresponding deivce for pushing sessions
US8170590B2 (en) Method, system and apparatus for forking transmission of short message service
KR102132266B1 (en) Secondary node type based control for data streaming
RU2647654C2 (en) System and method of delivering audio-visual content to client device
CN101895569B (en) Implementation method of video browsing, IMS video monitoring system and front monitoring front-end
CN109379244B (en) Network acceleration communication method and device and electronic equipment
CN107277420A (en) A kind of video calling implementation method and terminal
KR20190015521A (en) Methods and devices for determining popular live broadcast video
CN107689945B (en) Media conversion equipment control method and device and media gateway
US20220329986A1 (en) Multicast service implementation method and apparatus, and communications device
CN110380876B (en) Group chat service implementation method, device, system, terminal, server and medium
CN117793072A (en) Data processing method, device and storage medium
US20110289166A1 (en) Method for realizing a message interaction and a converged service system
US9065702B2 (en) Method and system for a communication session initialization in a telecommunication network
CN109120578A (en) A kind of method and device for realizing link connection processing
EP3136756A1 (en) System, device and method for implementing ring back tone service
CN108738089B (en) Method and device for interoffice transmission of subscriber number
CN109167730B (en) User equipment detection method, device, equipment and storage medium based on multicast
WO2023185854A1 (en) Information processing method and apparatus, and communication device and storage medium
KR100861125B1 (en) Method and system for providing a substitute image service based on mobile communication network
CN117675774A (en) Streaming media data transmission method and device and electronic equipment
CN114095308A (en) Method, device, equipment and storage medium for enhancing multimedia conference quality

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination