CN114760209A - Data processing method, system, device and storage medium - Google Patents
Data processing method, system, device and storage medium Download PDFInfo
- Publication number
- CN114760209A CN114760209A CN202210318594.5A CN202210318594A CN114760209A CN 114760209 A CN114760209 A CN 114760209A CN 202210318594 A CN202210318594 A CN 202210318594A CN 114760209 A CN114760209 A CN 114760209A
- Authority
- CN
- China
- Prior art keywords
- data
- network element
- network
- management warehouse
- processed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/14—Network analysis or design
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2462—Approximate or statistical queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Probability & Statistics with Applications (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Mathematical Physics (AREA)
- Fuzzy Systems (AREA)
- Computer And Data Communications (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data processing method, a system, a device and a storage medium, wherein the method comprises the following steps: and the NF receives the data subscription message of the NWDAF and sends the non-emergency first subscription data to the data management warehouse. And when the NF is in an idle state, the NF actively sends a cooperative computing request to the data management warehouse and receives a cooperative computing response of the data management warehouse, after the verification is completed according to the cooperative computing response, the NF receives first data to be processed sent by the data management warehouse, performs corresponding data processing on the first data to be processed, and returns a generated data processing result to the data management warehouse. The embodiment of the application provides that the non-emergency first subscription data is stored through a data management warehouse, which is beneficial to relieving the storage pressure of the NWDAF; and the NF in an idle state assists the NWDAF to complete part of data processing work, so that the data analysis and calculation pressure of the NWDAF is further relieved.
Description
Technical Field
The present application relates to the field of communications technologies, and in particular, to a data processing method, system, apparatus, and storage medium.
Background
With the development of communication technology, the amount of data in a network is also increasing. In order to realize the statistical analysis of mass Network Data, an NWDAF (Network Data analysis Function) Network element is added in a 5G core Network, and the NWDAF Network element can collect Data of a specific NF (Network Function) and analyze the Data so as to help other Network elements in the Network make decisions and realize the automatic operation and maintenance of the Network. However, in the automatic operation and maintenance process, the NWDAF bears huge data processing pressure, and the core network puts very high requirements on the data storage and calculation capacity of the NWDAF.
Disclosure of Invention
The present application is directed to solving, at least to some extent, one of the technical problems in the related art. Therefore, the application provides a data processing method, a system, a device and a storage medium.
In a first aspect, an embodiment of the present application provides a data processing method, which is applied to a network functional network element, and includes: receiving a data subscription message from a network data analysis function network element; sending the first subscription data with the data analysis task identifier to a data management warehouse; the data analysis task identifier corresponding to the first subscription data is non-urgent; when the network functional network element is in an idle state, sending an assisted calculation request to the data management warehouse; receiving an assisted calculation response from the data management warehouse, and acquiring first to-be-processed data according to the assisted calculation response; and performing data processing on the first data to be processed, and sending a data processing result obtained after the data processing to the data management warehouse.
Optionally, the receiving an assisted computation response from the data management warehouse, and acquiring the first to-be-processed data according to the assisted computation response includes: analyzing the assisted calculation response to obtain data block information corresponding to the first to-be-processed data; the data block information comprises a data block identifier, a data block size and a data block algorithm; and checking the data block information, and receiving the first data to be processed sent by the data management warehouse after the data block information is successfully checked.
Optionally, the method further comprises: after the data processing process is completed, acquiring a current load; if the current load is smaller than or equal to a preset first load threshold value, sending the assisted calculation request to the data management warehouse again; and if the current load is greater than the first load threshold value, determining that the network function network element is switched from an idle state to a busy state.
Optionally, the method further comprises; and if the first to-be-processed data is determined to be empty and the network functional network element is still in an idle state according to the assisted calculation response, periodically sending the assisted calculation request to the data management warehouse.
Optionally, when the network functional network element is in an idle state, sending an assisted computation request to the data management repository, including; keeping heartbeat connection with a network warehousing function network element, and periodically acquiring a current load according to heartbeat information; if the current load is less than or equal to the second load threshold, determining that the network functional network element is in an idle state, and sending the assisted calculation request to the data management warehouse; and if the current load is greater than a preset second load threshold value, determining that the network function network element is in a busy state, returning to keep heartbeat connection with the network warehousing function network element, and periodically acquiring the current load according to heartbeat information.
Optionally, the method further comprises; respectively sending the second subscription data with the data analysis task identifier to a network data analysis function network element and the data management warehouse; and the data analysis task identifier corresponding to the second subscription data is urgent.
In a second aspect, an embodiment of the present application provides a data processing method, which is applied to a data management warehouse and includes; receiving first subscription data from a network function network element; the first subscription data carries a data analysis task identifier; according to the data analysis task identifier, the first subscription data is stored in a classified mode; receiving an assisted calculation request from the network function network element, and sending an assisted calculation response to the network function network element; sending first data to be processed to the network functional network element; receiving a data processing result of the first data to be processed sent by the network functional network element; and sending the second data to be processed to a network data analysis function network element.
In a third aspect, an embodiment of the present application provides a data processing system, including a network data analysis function network element, a network function network element, and a data management warehouse; the network function network element is used for receiving a data subscription message from the network data analysis function network element; sending first subscription data with a data analysis task identifier to the data management warehouse; the data analysis task identifier corresponding to the first subscription data is non-urgent; when the network functional network element is in an idle state, sending an assisted calculation request to the data management warehouse; receiving an assisted calculation response from the data management warehouse, and acquiring first data to be processed according to the assisted calculation response; processing the first data to be processed, and sending a data processing result obtained after data processing to the data management warehouse; the data management warehouse is used for receiving the first subscription data from the network function network element; according to the data analysis task identifier, the first subscription data is stored in a classified mode; receiving the assisted calculation request from the network function network element, and sending the assisted calculation response to the network function network element; sending the first data to be processed to the network function network element; receiving a data processing result of the first data to be processed sent by the network functional network element; sending second data to be processed to the network data analysis function network element; and the network data analysis function network element is used for sending the data subscription message to the network function network element and receiving second data to be processed from the data management warehouse.
In a fourth aspect, an embodiment of the present application provides a data processing apparatus, including: at least one processor; at least one memory for storing at least one program; when the at least one program is executed by the at least one processor, the at least one processor is caused to implement the above-described data processing method.
In a fifth aspect, the present application provides a computer storage medium, in which a program executable by a processor is stored, and the program executable by the processor is used for implementing the above data processing method when executed by the processor.
The beneficial effects of the embodiment of the application are as follows: the NF receives a data subscription message of the NWDAF and sends non-urgent first subscription data to a data management warehouse. And when the NF is in an idle state, the NF actively sends a cooperative computing request to the data management warehouse and receives a cooperative computing response of the data management warehouse, after the verification is completed according to the cooperative computing response, the NF receives first data to be processed sent by the data management warehouse, performs corresponding data processing on the first data to be processed, and returns a generated data processing result to the data management warehouse. The embodiment of the application provides that the non-emergency first subscription data is stored through the data management warehouse, which is beneficial to relieving the storage pressure of the NWDAF; and the NF in an idle state assists the NWDAF to complete partial data processing work, so that the data analysis and calculation pressure of the NWDAF is further relieved.
Drawings
The accompanying drawings are included to provide a further understanding of the claimed subject matter and are incorporated in and constitute a part of this specification, illustrate embodiments of the subject matter and together with the description serve to explain the principles of the subject matter and not to limit the subject matter.
Fig. 1 is a flowchart of a first step of a data processing method according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a NF according to an embodiment of the present application;
fig. 3 is a flowchart of a second step of a data processing method according to an embodiment of the present application;
FIG. 4 is a schematic diagram of a data processing system provided by an embodiment of the present application;
fig. 5 is a schematic diagram of a data processing apparatus according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
It should be noted that although functional block divisions are provided in the system drawings and logical orders are shown in the flowcharts, in some cases, the steps shown and described may be performed in different orders than the block divisions in the systems or in the flowcharts. The terms first, second and the like in the description and in the claims, and the drawings described above, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order.
The embodiments of the present application will be further explained with reference to the drawings.
Referring to fig. 1, fig. 1 is a flowchart of a first step of a data processing method provided in an embodiment of the present application, where the method is applied to an NF (Network Function) in a core Network, and the method includes, but is not limited to, steps S100 to S140:
s100, receiving a data subscription message from a network element with a network data analysis function;
specifically, in order to perform statistical analysis on mass data in the network and achieve intelligent and automatic operation and maintenance of the network, the 5G core network is added with an NWDAF, and the NWDAF has the capabilities of data acquisition, data analysis and the like. To collect data for different NFs in the core network, the NWDAF needs to subscribe to the NFs. Thus, the NF may receive a data subscription message from the NWDAF indicating that the NWDAF requests to subscribe to data from the NF.
S110, sending the first subscription data with the data analysis task identifier to a data management warehouse;
specifically, according to the data type subscribed by the NWDAF, the subscription initiation rule, and the like, the NF may determine whether the subscription data that the current NWDAF needs to obtain is urgent, data that needs to be calculated and analyzed as soon as possible, or is periodic, and has low requirements on time limit. The NF distinguishes these different data by using a data analysis task identifier, for example, the data analysis task identifier of the data which is urgent and needs to complete the calculation analysis as soon as possible is determined to be urgent, and the data analysis task identifier of the data which is periodic and has low requirement on time limit, or needs to wait for other NFs to complete data transmission NWDAF to develop the calculation analysis is determined to be non-urgent. In the embodiment of the application, the subscription data of the NF is divided into first subscription data and second subscription data, wherein the data analysis task identifier corresponding to the first subscription data is non-urgent, and the data analysis task identifier corresponding to the second subscription data is urgent.
It can be understood that, since the first subscription data does not need the NWDAF to complete as quickly as possible, in this step, the NF first subscription data with the data analysis task identifier is sent to the data management repository first. The data management warehouse is a device of a non-3 GPP standard protocol, and in order to relieve data analysis and storage pressure of the NWDAF, the embodiment of the application provides that non-emergency first subscription data are sent to the data management warehouse for temporary storage, so that the data high concurrency condition faced by the NWDAF is reduced, and the storage pressure of the NWDAF is reduced.
And for the emergency second subscription data, the NF directly sends the second subscription data with the data analysis task identifier to the NWDAF and the data management warehouse respectively, the NWDAF performs data analysis on the second subscription data, and the data management warehouse performs storage backup on the second subscription data.
S120, when the network functional network element is in an idle state, sending an assisted calculation request to the data management warehouse;
specifically, it is mentioned in the above, the subscription data of the NF includes the urgent second subscription data and the non-urgent first subscription data, and although the first subscription data is temporarily stored in the data management repository, the NWDAF computing resources still need to be occupied to complete the data processing of the first subscription data. Therefore, the embodiment of the present application provides that idle NFs may share a part of data processing work of the first subscription data, and further relieve the data processing pressure of the NWDAF.
In order to achieve the purpose of letting the NF share the data processing work, it is proposed in the embodiment of the present application that the NF may be logically divided into two parts. Referring to fig. 2, fig. 2 is a schematic diagram of NF proposed in the embodiment of the present application. As shown in fig. 2, in the embodiment of the present application, the NF 200 is divided into a standard service module 210 and a data calculation module 220, where the standard service module is configured to execute a standard service that the NF itself needs to execute, and the data calculation module is configured to assist the NWDAF in performing calculation. The data computation module may therefore be considered a functional enhancement module for the NF. When the standard service module of the NF is busy and needs to occupy more NF resources, the data calculation module does not share the data processing task of the NWDAF; on the contrary, when the standard service module does not execute the task or only executes the relatively simple standard service, the data calculation module may share the data processing task of the NWDAF.
In the embodiment of the application, whether the NF is in an idle state capable of sharing the data processing task is determined according to the current load of the NF. According to the TS 3GPP standard protocol, the NF will maintain heartbeat connection with an NRF (Network redundancy Function, Network storage Function Network element), and periodically submit a load in a heartbeat message, so that the current load of the NF can be periodically obtained according to heartbeat information. If the second load threshold is set to be 20% of the maximum load of the NF, determining that the NF is in a busy state if the current load of the NF is greater than a preset second load threshold in the process that the NF only executes the standard service function, and no redundant resource can assist the NWDAF to perform calculation, so that the procedure of returning to keep heartbeat connection with the network storage function network element and periodically acquiring the current load according to heartbeat information is performed, that is, the load condition of the NF is continuously monitored; after a period of time, if the current load of the NF is less than or equal to a preset second load threshold, the current NF is considered to be in an idle state, and can share the data processing work of the NWDAF, and the NF actively sends an assisted calculation request to the data management warehouse, wherein the assisted calculation request indicates that the NF requests the assistance of processing partial data of the NWDAF.
S130, receiving an assisted calculation response from the data management warehouse, and acquiring first data to be processed according to the assisted calculation response;
specifically, if data needing NF assistance processing exists in the data management warehouse, the NF may receive an assistance calculation response from the data management warehouse, and the NF may obtain the first to-be-processed data needing assistance processing according to the assistance calculation response. The first to-be-processed data refers to non-emergency subscription data processed by the NF.
In the embodiment of the application, the NF analyzes the received assisted calculation response, and can obtain data block information corresponding to the first data to be processed; wherein the data block information comprises a data block identifier, a data block size and a data block algorithm. The data block identifier is used for indicating which calculation processes the data block has undergone, and preventing subsequent repeated processing on the data block.
It should be noted that, in order to better manage the stored data, prevent the excessive first data to be processed from occupying too long processing time of the NF, and effectively control the calculation assisting process of the NF, the data management warehouse may store the received first subscription data in a classified manner, and divide the first subscription data into a plurality of data blocks, where each data block has information such as a data block identifier, a data block size, and a data block algorithm corresponding to the data block. The data management warehouse transmits the data to be processed to the NF by taking the data block as a unit, and the NF can check the data block information in the assisted calculation response, such as checking whether the size of the data block exceeds the data amount which can be processed by the NF currently, checking whether the NF supports the data block algorithm of the first data to be processed, and the like. And after the verification is successful, the NF establishes a transmission channel with the data management warehouse and receives the first to-be-processed data sent by the data management warehouse.
In some embodiments, when the NF sends the assisted calculation request to the data management repository, and it is possible that the first to-be-processed data allocated to the NF is not needed in the data management repository at this time, the NF receives the assisted calculation response, and the first to-be-processed data is empty. If the NF is still in an idle state after receiving the assisted calculation response, the NF periodically sends the assisted calculation request to the data management warehouse until the first data to be processed is obtained for assisted calculation or the NF exits from the idle state and is switched to a busy state, and the NF stops sending the assisted calculation request to the data management warehouse.
S140, performing data processing on the first data to be processed, and sending a data processing result obtained after the data processing to the data management warehouse;
specifically, the NF performs data processing on the received first data to be processed by using idle network resources, and after the processing is completed, returns an obtained data processing result to the data management warehouse and stores the data processing result by the data management warehouse. The NF may perform corresponding processing on the first data to be processed by referring to different data block algorithms, and the data processing process performed by the NF is not described herein again.
And after the data processing process is finished, the NF acquires the current load of the NF, and if the current load is less than or equal to a preset first load threshold value, the NF sends the assistance calculation request to the data management warehouse again. For example, the first load threshold is set to 50% of the maximum load of the NF, and the current load is less than or equal to 50%, which indicates that the resources occupied by the standard service module of the current NF are not too much, and the NF can continue to share the data processing work of the NWDAF, and then the NF sends the assisted calculation request to the data management warehouse again to continue processing the data to be processed. Otherwise, if the current load is greater than 50%, determining that the standard service module of the current NF has exited the idle state, switching the current NF from the idle state to a busy state, and not sharing the NWDAF assistance calculation work.
Through steps S100 to S140, the present embodiment provides a data processing method applied to an NF, where first, the NF receives a data subscription message of an NWDAF, and sends non-emergency first subscription data to a data management repository. And when the NF is in an idle state, the NF actively sends a cooperative computing request to the data management warehouse and receives a cooperative computing response of the data management warehouse, after the verification is completed according to the cooperative computing response, the NF receives first data to be processed sent by the data management warehouse, performs corresponding data processing on the first data to be processed, and returns a generated data processing result to the data management warehouse. The embodiment of the application provides that the non-emergency first subscription data is stored through a data management warehouse, which is beneficial to relieving the storage pressure of the NWDAF; and the NF in an idle state assists the NWDAF to complete partial data processing work, so that the data analysis and calculation pressure of the NWDAF is further relieved.
In the following, the data processing method according to the embodiment of the present application is described in the perspective of a data management warehouse.
Referring to fig. 3, fig. 3 is a flowchart illustrating a second step of a data processing method provided by the embodiment of the present application, where the method is applied to a data management warehouse, and the method includes, but is not limited to, steps S300 to S350:
s300, receiving first subscription data from a network function network element;
specifically, for step S110, the NF sends the first subscription data with the "non-urgent" data analysis task identifier to the data management repository.
S310, storing the first subscription data in a classified mode according to the data analysis task identifier;
specifically, the first subscription data includes a variety of data, and according to the above content, in addition to the first subscription data, the second subscription data with the "urgent" data analysis task identifier is also sent to the data management warehouse by the NF, so that the data management warehouse may store the first subscription data and the second subscription data sent by the NF in a classified manner according to the information such as the data analysis task identifier, the data type, and the data source.
It can be understood that, in addition to information such as data source and data type, a processing process of data is also an important classification index when the data is stored and managed by the data management warehouse, for example, according to whether the data is processed, the data is marked as three data states, namely source data (without NF calculation), intermediate data (intermediate data obtained by NF calculation), and result data (data for which a corresponding result has been calculated). And when the subsequent NWDAF acquires data from the data management warehouse, the required data can be accurately acquired according to different data marks.
S320, receiving an assisted calculation request from the network function network element, and sending an assisted calculation response to the network function network element;
specifically, referring to step S120, the data management warehouse receives an assisted calculation request from the NF, checks whether there is first data to be processed that can be allocated to the NF for assisted calculation, and sends an assisted calculation response to the NF according to a check result.
S330, sending first data to be processed to the network function network element;
specifically, referring to step S320, if the data management warehouse checks that there is currently the first to-be-processed data that can be allocated to the NF, the first to-be-processed data is sent to the NF; otherwise, if the check finds that there is no first to-be-processed data, the related content of the first to-be-processed data given in the assisted calculation response is empty.
S340, receiving a data processing result of the first data to be processed sent by the network functional network element;
specifically, referring to step S140, if the data management warehouse receives the data processing result of the first to-be-processed data sent by the NF, the data management warehouse may store the data processing result, and acquire the data processing result when the subsequent NWDAF needs to analyze the data processing result or the data result needs to participate in the secondary calculation.
S350, sending second data to be processed to a network data analysis function network element;
specifically, in addition to the portion allocated to idle NF processing, the non-urgent first subscription data in the data management repository has a portion that requires NWDAF to handle in person, and this portion of data is referred to as second pending data. And when the NWDAF has spare computing resources, the data management warehouse sends second data to be processed to the NWDAF, and the NWDAF processes the second data to be processed.
Referring to fig. 4, fig. 4 is a schematic diagram of a data processing system provided in an embodiment of the present application, where the system includes an NWDAF, an NF, and a data management repository. As shown in fig. 4, after the NF receives the data subscription message from the NWDAF, the NF sends the non-emergency first subscription data to the data management repository, and sends the emergency second subscription data to the NWDAF and the data management repository, respectively. And the data management warehouse stores the acquired first subscription data and the acquired second subscription data in a classified manner. If the current NF is in an idle state, a standard service module in the NF activates the function of a data calculation module, the NF actively sends an assisted calculation request to a data management warehouse, the data management warehouse sends an assisted calculation response to the NF, and sends first data to be processed to the NF through a transmission channel between the data management warehouse and the NF, the NF processes the first data to be processed, and sends a data processing result obtained after data processing to the data management warehouse. And if the NF exits the idle state, closing the assistant calculation function of the data calculation module. And the data management warehouse sends the second data to be processed in the first subscription data to the NWDAF through the transmission channel for processing.
Referring to fig. 5, fig. 5 is a schematic diagram of a data processing apparatus 500 provided in an embodiment of the present application, where the apparatus 500 includes at least one processor 510 and at least one memory 520 for storing at least one program; in fig. 5, a processor and a memory are taken as an example.
The processor and memory may be connected by a bus or other means, such as by a bus in FIG. 5.
The memory, which is a non-transitory computer readable storage medium, may be used to store non-transitory software programs as well as non-transitory computer executable programs. Further, the memory may include high speed random access memory, and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory optionally includes memory located remotely from the processor, and these remote memories may be connected to the device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The above-described embodiments of the apparatus are merely illustrative, wherein the units illustrated as separate components may or may not be physically separate, i.e. may be located in one place, or may also be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.
The embodiment of the application also discloses a computer storage medium, wherein a program executable by a processor is stored, and the program executable by the processor is used for realizing the method provided by the application when being executed by the processor.
One of ordinary skill in the art will appreciate that all or some of the steps, systems, and methods disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as is well known to those of ordinary skill in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by a computer. In addition, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media as is well known to those skilled in the art.
While the preferred embodiments of the present invention have been described, the present invention is not limited to the above embodiments, and those skilled in the art can make various equivalent modifications or substitutions without departing from the spirit of the present invention, and such equivalent modifications or substitutions are included in the scope of the present invention defined by the claims.
Claims (10)
1. A data processing method is applied to a network function network element, and is characterized by comprising the following steps:
receiving a data subscription message from a network data analysis function network element;
sending the first subscription data with the data analysis task identifier to a data management warehouse;
the data analysis task identifier corresponding to the first subscription data is non-urgent;
when the network functional network element is in an idle state, sending an assisted calculation request to the data management warehouse;
receiving an assisted calculation response from the data management warehouse, and acquiring first data to be processed according to the assisted calculation response;
and processing the first data to be processed, and sending a data processing result obtained after data processing to the data management warehouse.
2. The data processing method according to claim 1, wherein the receiving of the assisted calculation response from the data management warehouse and the obtaining of the first to-be-processed data according to the assisted calculation response comprises:
analyzing the assisted calculation response to obtain data block information corresponding to the first to-be-processed data;
the data block information comprises a data block identifier, a data block size and a data block algorithm;
and checking the data block information, and receiving the first data to be processed sent by the data management warehouse after the data block information is successfully checked.
3. A data processing method according to any one of claim 1, characterized in that the method further comprises:
after the data processing process is finished, acquiring a current load;
if the current load is smaller than or equal to a preset first load threshold value, sending the assisted calculation request to the data management warehouse again;
and if the current load is greater than the first load threshold value, determining that the network function network element is switched from an idle state to a busy state.
4. The data processing method of claim 1, wherein the method further comprises;
and if the first to-be-processed data is determined to be empty and the network functional network element is still in an idle state according to the assisted calculation response, periodically sending the assisted calculation request to the data management warehouse.
5. The data processing method of claim 1, wherein when the network functional network element is in an idle state, sending an assistance calculation request to the data management repository, including;
keeping heartbeat connection with a network warehousing function network element, and periodically acquiring a current load according to heartbeat information;
if the current load is less than or equal to a preset second load threshold value, determining that the network functional network element is in an idle state, and sending the assisted calculation request to the data management warehouse;
and if the current load is greater than the second load threshold value, determining that the network function network element is in a busy state, returning to keep heartbeat connection with the network warehousing function network element, and periodically acquiring the current load according to heartbeat information.
6. The data processing method of claim 1, wherein the method further comprises;
respectively sending the second subscription data with the data analysis task identifier to a network data analysis function network element and the data management warehouse;
and the data analysis task identifier corresponding to the second subscription data is urgent.
7. A data processing method is applied to a data management warehouse and is characterized by comprising the following steps of;
receiving first subscription data from a network function network element;
the first subscription data is provided with a data analysis task identifier;
according to the data analysis task identifier, the first subscription data is stored in a classified mode;
receiving an assisted calculation request from the network function network element, and sending an assisted calculation response to the network function network element;
sending first data to be processed to the network functional network element;
receiving a data processing result of the first data to be processed sent by the network functional network element;
and sending the second data to be processed to a network data analysis function network element.
8. A data processing system is characterized by comprising a network data analysis function network element, a network function network element and a data management warehouse;
the network function network element is used for receiving a data subscription message from the network data analysis function network element; sending first subscription data with a data analysis task identifier to the data management warehouse; the data analysis task identifier corresponding to the first subscription data is non-urgent; when the network functional network element is in an idle state, sending an assisted calculation request to the data management warehouse; receiving an assisted calculation response from the data management warehouse, and acquiring first data to be processed according to the assisted calculation response; processing the first data to be processed, and sending a data processing result obtained after data processing to the data management warehouse;
the data management warehouse is used for receiving the first subscription data from the network function network element; according to the data analysis task identifier, the first subscription data is stored in a classified mode; receiving the assistance calculation request from the network function network element, and sending the assistance calculation response to the network function network element; sending the first data to be processed to the network function network element; receiving a data processing result of the first data to be processed sent by the network function network element; sending second data to be processed to the network data analysis function network element;
and the network data analysis function network element is used for sending the data subscription message to the network function network element and receiving second data to be processed from the data management warehouse.
9. A data processing apparatus, characterized by comprising:
at least one processor;
at least one memory for storing at least one program;
when executed by the at least one processor, cause the at least one processor to implement the data processing method of any one of claims 1-7.
10. A computer storage medium in which a processor-executable program is stored, wherein the processor-executable program, when executed by the processor, is for implementing a data processing method as claimed in any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210318594.5A CN114760209B (en) | 2022-03-29 | 2022-03-29 | Data processing method, system, device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210318594.5A CN114760209B (en) | 2022-03-29 | 2022-03-29 | Data processing method, system, device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114760209A true CN114760209A (en) | 2022-07-15 |
| CN114760209B CN114760209B (en) | 2022-11-18 |
Family
ID=82327866
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210318594.5A Active CN114760209B (en) | 2022-03-29 | 2022-03-29 | Data processing method, system, device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114760209B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111901135A (en) * | 2019-05-05 | 2020-11-06 | 华为技术有限公司 | Data analysis method and device |
| CN111901367A (en) * | 2019-05-06 | 2020-11-06 | 华为技术有限公司 | Network data analysis method and device |
| WO2021063627A1 (en) * | 2019-10-04 | 2021-04-08 | Nokia Technologies Oy | Apparatus and method for subscribing analytic services to a user repository in the 5g core network |
| US20210297843A1 (en) * | 2020-03-20 | 2021-09-23 | Samsung Electronics Co., Ltd. | Method and apparatus for data analytics in telecommunication network |
| CN113647148A (en) * | 2019-03-15 | 2021-11-12 | 中兴通讯股份有限公司 | Supporting non-public networks with integrated public networks |
-
2022
- 2022-03-29 CN CN202210318594.5A patent/CN114760209B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113647148A (en) * | 2019-03-15 | 2021-11-12 | 中兴通讯股份有限公司 | Supporting non-public networks with integrated public networks |
| CN111901135A (en) * | 2019-05-05 | 2020-11-06 | 华为技术有限公司 | Data analysis method and device |
| CN111901367A (en) * | 2019-05-06 | 2020-11-06 | 华为技术有限公司 | Network data analysis method and device |
| WO2021063627A1 (en) * | 2019-10-04 | 2021-04-08 | Nokia Technologies Oy | Apparatus and method for subscribing analytic services to a user repository in the 5g core network |
| US20210297843A1 (en) * | 2020-03-20 | 2021-09-23 | Samsung Electronics Co., Ltd. | Method and apparatus for data analytics in telecommunication network |
Non-Patent Citations (2)
| Title |
|---|
| 3GPP: ""23502-fa0"", 《3GPP SPECS\ARCHIVE》 * |
| 3GPP: ""23791-g20"", 《3GPP SPECS\23_SERIES》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114760209B (en) | 2022-11-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10884623B2 (en) | Method and apparatus for upgrading a distributed storage system | |
| US20210036907A1 (en) | Methods and apparatuses for pushing a message | |
| CN111966289B (en) | Partition optimization method and system based on Kafka cluster | |
| US20210042578A1 (en) | Feature engineering orchestration method and apparatus | |
| CN110457176B (en) | Monitoring method and device for distributed system, storage medium and electronic equipment | |
| CN110659151B (en) | Data verification method and device and storage medium | |
| CN112223284A (en) | Robot elevator taking fault processing method and device, electronic equipment and storage medium | |
| WO2024007995A1 (en) | Network fault recovery method and apparatus, device, and storage medium | |
| CN114189482A (en) | Control method, device and system for cluster resources | |
| US20220182305A1 (en) | Request Processing System and Method Thereof | |
| CN114760209B (en) | Data processing method, system, device and storage medium | |
| CN116319810A (en) | Flow control method, device, equipment, medium and product of distributed system | |
| CN114285903B (en) | Request processing method, device and system and electronic equipment | |
| CN110490737B (en) | Transaction channel control method and device and electronic equipment | |
| CN111586841A (en) | Terminal paging optimization method, system, device and readable storage medium | |
| CN112422598A (en) | Resource scheduling method, intelligent front-end equipment, intelligent gateway and distributed system | |
| CN115086296B (en) | Log transmission system, log transmission method and related device | |
| CN111524059A (en) | Memory utilization method, system, terminal and storage medium during image caching | |
| CN116347467B (en) | Method and system for managing user data by UDR in 5G network | |
| CN110536325B (en) | Method for improving communication connection success rate of vehicle-mounted intelligent equipment | |
| CN112543213B (en) | Data processing method and device | |
| CN111224861B (en) | Method, system, equipment and storage medium for opening instant message service | |
| CN116743750A (en) | Traffic distribution method and device, storage medium and electronic equipment | |
| CN117762652A (en) | Distributed transaction processing method and device based on message middleware | |
| CN117251211A (en) | Instruction processing method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |