CN112039934A - Information feedback method, feedback information processing method and device - Google Patents
Information feedback method, feedback information processing method and device Download PDFInfo
- Publication number
- CN112039934A CN112039934A CN201910477700.2A CN201910477700A CN112039934A CN 112039934 A CN112039934 A CN 112039934A CN 201910477700 A CN201910477700 A CN 201910477700A CN 112039934 A CN112039934 A CN 112039934A
- Authority
- CN
- China
- Prior art keywords
- service provider
- algorithm
- feedback information
- sent
- algorithm model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 230000010365 information processing Effects 0.000 title claims abstract description 17
- 238000003672 processing method Methods 0.000 title claims abstract description 9
- 238000007405 data analysis Methods 0.000 claims abstract description 5
- 230000006870 function Effects 0.000 claims description 18
- 238000011161 development Methods 0.000 claims description 8
- 238000011156 evaluation Methods 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 20
- 238000012549 training Methods 0.000 description 10
- 230000004044 response Effects 0.000 description 9
- 238000004590 computer program Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 6
- 238000013473 artificial intelligence Methods 0.000 description 5
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/566—Grouping or aggregating service requests, e.g. for unified processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/14—Network analysis or design
- H04L41/145—Network analysis or design involving simulating, designing, planning or modelling of a network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/34—Network arrangements or protocols for supporting network services or applications involving the movement of software or configuration parameters
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The application discloses an information feedback method and device, and a feedback information processing method and device, which are used for realizing the accuracy of an algorithm model fed back to an algorithm service provider by an NWDAF entity, and the algorithm service provider carries out accuracy evaluation and adjustment on the algorithm model according to the feedback. An information feedback method provided in an embodiment of the present application is applied to a network data analysis function NWDAF entity, and includes: receiving a subscription message sent by an algorithm service provider; and sending algorithm model feedback information corresponding to the identifier to an algorithm service provider according to the algorithm model identifier carried in the subscription message.
Description
Technical Field
The present application relates to the field of communications technologies, and in particular, to an information feedback method and an information feedback processing method and apparatus.
Background
In the prior art, after a big data analysis function is deployed in a mobile network, an operator needs to introduce different Artificial Intelligence (AI) algorithm models for different big data analysis targets. Obviously, the operator does not develop all the AI algorithm models, however, the AI algorithm models developed by the AI algorithm provider are not universal, that is, the algorithm model calibrated for the operator a may not be suitable for the service scenario of the operator B. Therefore, an algorithm model provider should be able to adjust and calibrate algorithm parameters continuously based on the operation results of algorithm models in different operator networks, so as to ensure the accuracy of the algorithm models.
At present, interaction between an AI algorithm provider and a Network data analysis function (NWDAF) is not considered in the protocol, and closed-loop feedback of algorithm model effect evaluation and parameter adjustment cannot be formed.
Disclosure of Invention
The embodiment of the application provides an information feedback method and device, and a feedback information processing method and device, which are used for realizing the feedback of the accuracy of an algorithm model from an NWDAF entity to an algorithm service provider, and the algorithm service provider performs accuracy evaluation and adjustment on the algorithm model according to the feedback.
An information feedback method provided in an embodiment of the present application is applied to an NWDAF entity, and includes:
receiving a subscription message sent by an algorithm service provider;
and sending algorithm model feedback information corresponding to the identifier to an algorithm service provider according to the algorithm model identifier carried in the subscription message.
By the method, a subscription message sent by an algorithm service provider is received; and sending algorithm model feedback information corresponding to the identifier to an algorithm service provider according to the algorithm model identifier carried in the subscription message, thereby realizing the feedback of the accuracy of the algorithm model to the algorithm service provider.
Optionally, sending algorithm model feedback information corresponding to the identifier to an algorithm service provider according to the algorithm model identifier carried in the subscription message, specifically including:
and detecting a deviation value of the prediction result of the algorithm model corresponding to the identifier deviating from the actual operation result, and sending algorithm model feedback information corresponding to the identifier to an algorithm service provider when the deviation value is greater than a threshold value.
Optionally, the threshold value is provided in the subscription message by a local configuration or by an algorithmic service provider.
Optionally, the feedback information is a notification for indicating to an algorithm service provider that the deviation value is greater than a threshold value;
or, the feedback information is a corresponding data set when the deviation value is greater than a threshold value.
Optionally, when the feedback information sent to the algorithm service provider is a notification, the method further includes: and receiving a data request message sent by the algorithm service provider, and sending a corresponding data set when the deviation value is larger than a threshold value to the algorithm service provider.
Optionally, the method further comprises:
and detecting a deviation value of the prediction result of the updated algorithm model from the actual operation result, and stopping sending the feedback information to the algorithm service provider when the deviation value of the prediction result of the updated algorithm model from the actual operation result is not greater than the threshold value.
Alternatively,
the subscription message is sent directly to the NWDAF entity by an algorithmic service provider;
the feedback information is directly sent to an algorithm service provider;
the data request message is sent directly to the NWDAF entity by an algorithmic service provider;
or,
the subscription message is sent by an algorithm service provider and forwarded to the NWDAF entity by a network capability development function NEF;
the feedback information is sent to the NEF and forwarded by the NEF to the algorithmic service provider;
the data request message is sent by an algorithmic service provider and forwarded to the NWDAF entity via the NEF.
The feedback information processing method provided by the embodiment of the application is applied to an algorithm service provider and comprises the following steps:
sending a subscription message to an NWDAF entity, wherein the subscription message carries an algorithm model identifier;
and receiving algorithm model feedback information corresponding to the identifier sent by the NWDAF entity.
Sending a subscription message to an NWDAF entity by the method, wherein the subscription message carries an algorithm model identifier; and receiving the algorithm model feedback information corresponding to the identifier sent by the NWDAF entity, so that an algorithm service provider can evaluate and adjust the accuracy of the algorithm model according to the feedback.
Optionally, the method further comprises: and judging whether parameter adjustment needs to be carried out on the algorithm model or not according to the feedback information.
Optionally, the feedback information is sent when the NWDAF entity detects that a deviation value of the predicted result of the algorithm model from the actual operation result is greater than a threshold value.
Optionally, the threshold value is configured by the NWDAF entity side or provided in the subscription message.
Optionally, the feedback information is a notification indicating that the deviation value is greater than a threshold value;
or, the feedback information is a corresponding data set when the deviation value is greater than a threshold value.
Optionally, when the feedback information is a notification indicating that the deviation value is greater than the threshold value, the method further includes: and sending a data request message to the NWDAF entity, and receiving a corresponding data set sent by the NWDAF entity when a deviation value of a prediction result of the algorithm model deviating from an actual operation result is greater than a threshold value.
Alternatively,
the subscription message is sent directly to an NWDAF entity;
the feedback information is directly sent by an NWDAF entity;
the data request message is sent directly to an NWDAF entity;
or, the subscription message is sent to the NEF and forwarded by the NEF to the NWDAF entity;
the feedback information is sent by an NWDAF entity and forwarded through a NEF;
the data request message is sent to the NEF and forwarded by the NEF to the NWDAF entity.
An information feedback device provided in an embodiment of the present application is applied to an NWDAF entity, and includes:
a memory for storing program instructions;
a processor for calling the program instructions stored in the memory and executing according to the obtained program:
receiving a subscription message sent by an algorithm service provider;
and sending algorithm model feedback information corresponding to the identifier to an algorithm service provider according to the algorithm model identifier carried in the subscription message.
Optionally, when the processor is configured to send, according to the algorithm model identifier carried in the subscription message, algorithm model feedback information corresponding to the identifier to an algorithm service provider, the processor is specifically configured to:
and detecting a deviation value of the prediction result of the algorithm model corresponding to the identifier deviating from the actual operation result, and sending algorithm model feedback information corresponding to the identifier to an algorithm service provider when the deviation value is greater than a threshold value.
Optionally, the threshold value is provided in the subscription message by a local configuration or by an algorithmic service provider.
Optionally, the feedback information is a notification for indicating to an algorithm service provider that the deviation value is greater than a threshold value;
or, the feedback information is a corresponding data set when the deviation value is greater than a threshold value.
Optionally, when the feedback information sent to the algorithm service provider is a notification, the processor is further specifically configured to: and receiving a data request message sent by the algorithm service provider, and sending a corresponding data set when the deviation value is larger than a threshold value to the algorithm service provider.
Optionally, the processor is further configured to:
and detecting a deviation value of the prediction result of the updated algorithm model from the actual operation result, and stopping sending the feedback information to the algorithm service provider when the deviation value of the prediction result of the updated algorithm model from the actual operation result is not greater than the threshold value.
Alternatively,
the subscription message is sent directly to the NWDAF entity by an algorithmic service provider;
the feedback information is directly sent to an algorithm service provider;
the data request message is sent directly to the NWDAF entity by an algorithmic service provider;
or,
the subscription message is sent by an algorithm service provider and forwarded to the NWDAF entity by a network capability development function NEF;
the feedback information is sent to the NEF and forwarded by the NEF to the algorithmic service provider;
the data request message is sent by an algorithmic service provider and forwarded to the NWDAF entity via the NEF.
The feedback information processing apparatus provided in an embodiment of the present application, applied to an algorithm service provider, includes:
a memory for storing program instructions;
a processor for calling the program instructions stored in the memory and executing according to the obtained program:
sending a subscription message to an NWDAF entity, wherein the subscription message carries an algorithm model identifier;
and receiving algorithm model feedback information corresponding to the identifier sent by the NWDAF entity.
Optionally, the processor is further configured to:
and judging whether parameter adjustment needs to be carried out on the algorithm model or not according to the feedback information.
Optionally, the feedback information is sent when the NWDAF entity detects that a deviation value of the predicted result of the algorithm model from the actual operation result is greater than a threshold value.
Optionally, the threshold value is configured by the NWDAF entity side or provided in the subscription message. Optionally, the feedback information is a notification indicating that the deviation value is greater than a threshold value;
or, the feedback information is a corresponding data set when the deviation value is greater than a threshold value.
Optionally, when the feedback information is a notification indicating that the deviation value is greater than the threshold value, the processor is further specifically configured to:
and sending a data request message to the NWDAF entity, and receiving a corresponding data set sent by the NWDAF entity when a deviation value of a prediction result of the algorithm model deviating from an actual operation result is greater than a threshold value.
Alternatively,
the subscription message is sent directly to an NWDAF entity;
the feedback information is directly sent by an NWDAF entity;
the data request message is sent directly to an NWDAF entity;
or, the subscription message is sent to the NEF and forwarded by the NEF to the NWDAF entity;
the feedback information is sent by an NWDAF entity and forwarded through a NEF;
the data request message is sent to the NEF and forwarded by the NEF to the NWDAF entity.
Correspondingly, on the device side, an information feedback device provided in an embodiment of the present application is applied to an NWDAF entity, and the device includes:
the first unit is used for receiving a subscription message sent by an algorithm service provider;
and the second unit is used for sending algorithm model feedback information corresponding to the identifier to an algorithm service provider according to the algorithm model identifier carried in the subscription message.
An embodiment of the present application further provides a feedback information processing apparatus, which is applied to an algorithm service provider, and the apparatus includes:
a sending unit, configured to send a subscription message to an NWDAF entity, where the subscription message carries an algorithm model identifier;
and the receiving unit is used for receiving the algorithm model feedback information corresponding to the identifier sent by the NWDAF entity.
Another embodiment of the present application provides a computer storage medium having stored thereon computer-executable instructions for causing a computer to perform any one of the methods described above.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic diagram of an information feedback method according to an embodiment of the present disclosure;
fig. 2 is a schematic diagram of a feedback information processing method further provided in the embodiment of the present application;
fig. 3 is a schematic diagram of an NWDAF and an application function AF establishing a direct connection for data transmission according to an embodiment of the present application;
fig. 4 is a schematic diagram of another NWDAF and AF establishing a direct connection for data transmission according to an embodiment of the present application;
fig. 5 is a schematic diagram illustrating data transmission between the NWDAF and the AF through a network capability development function NEF according to an embodiment of the present application;
FIG. 6 is a schematic diagram of an information feedback apparatus provided by an NWDAF entity in accordance with an embodiment of the present application;
fig. 7 is a schematic diagram of a feedback information processing apparatus provided by an SP side of an algorithm service provider according to an embodiment of the present application;
fig. 8 is a schematic diagram of an information feedback apparatus further provided in an NWDAF entity in an embodiment of the present application;
fig. 9 is a schematic diagram of a feedback information processing apparatus further provided by the SP side of the algorithm service provider according to the embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Various embodiments of the present application will be described in detail below with reference to the accompanying drawings. It should be noted that the display sequence of the embodiment of the present application only represents the sequence of the embodiment, and does not represent the merits of the technical solutions provided by the embodiments.
On the NWDAF entity side, referring to fig. 1, an information feedback method provided in an embodiment of the present application includes:
s101, receiving a subscription message sent by an algorithm service provider;
s102, sending algorithm model feedback information corresponding to the identification to an algorithm service provider according to the algorithm model identification carried in the subscription message.
Receiving a subscription message sent by a Service Provider (SP), for example, including: receiving a subscription message directly sent by the SP, or receiving a subscription message sent by the SP and forwarded by a Network capability development Function (NEF).
The subscription message is used for requesting the accuracy of the NWDAF feedback algorithm model, and the message carries the identifier algorithmid of the algorithm model and the threshold of the predicted deviation/error of the algorithm model, or carries the ID of the NWDAF, the identifier algorithmid of the algorithm model and the threshold of the predicted deviation/error of the algorithm model; the subscription message carries an algorithm model identifier algorithmID for the NWDAF to detect the algorithm model corresponding to the identifier, thereby feeding back the prediction accuracy to the algorithm service provider.
Optionally, sending algorithm model feedback information corresponding to the identifier to an algorithm service provider according to the algorithm model identifier carried in the subscription message, specifically including:
and detecting a deviation value of the prediction result of the algorithm model corresponding to the identifier deviating from the actual operation result, and sending algorithm model feedback information corresponding to the identifier to an algorithm service provider when the deviation value is greater than a threshold value.
Optionally, the threshold value is provided in the subscription message by a local configuration or by an algorithmic service provider. The threshold value is specifically configured as follows: at the NWDAF entity side, threshold values for the corresponding algorithmic model are determined by the service agreement and the algorithmic service provider.
Optionally, the feedback information is a notification for indicating to an algorithm service provider that the deviation value is greater than a threshold value;
or, the feedback information is a corresponding data set when the deviation value is greater than a threshold value.
Optionally, when the feedback information sent to the algorithm service provider is a notification, the method further includes: and receiving a data request message sent by the algorithm service provider, and sending a corresponding data set when the deviation value is larger than a threshold value to the algorithm service provider.
The data request message is sent when the algorithm service provider determines that the parameter of the algorithm model needs to be adjusted according to the times of receiving the notification and the deviation value carried in the notification. The NWDAF entity may send the algorithm service provider a corresponding data set a number of times when a deviation value of a predicted result of the algorithm model from an actual run result is greater than an error threshold value.
Optionally, the method further comprises:
and detecting a deviation value of the prediction result of the updated algorithm model from the actual operation result, and stopping sending the feedback information to the algorithm service provider when the deviation value of the prediction result of the updated algorithm model from the actual operation result is not greater than the threshold value.
Alternatively,
the subscription message is sent directly to the NWDAF entity by an algorithmic service provider;
the feedback information is directly sent to an algorithm service provider;
the data request message is sent directly to the NWDAF entity by an algorithmic service provider;
or,
the subscription message is sent by an algorithm service provider and forwarded to the NWDAF entity by a network capability development function NEF;
the feedback information is sent to the NEF and forwarded by the NEF to the algorithmic service provider;
the data request message is sent by an algorithmic service provider and forwarded to the NWDAF entity via the NEF.
Correspondingly, on the side of the algorithm service provider SP, referring to fig. 2, a feedback information processing method provided in the embodiment of the present application includes:
sending a subscription message to an NWDAF entity, wherein the subscription message carries an algorithm model identifier;
and receiving algorithm model feedback information corresponding to the identifier sent by the NWDAF entity.
Sending a subscription message to the NWDAF entity, for example, includes: and directly sending a subscription message to the NWDAF entity, or directly sending the subscription message to the NEF, and forwarding the subscription message to the NWDAF entity by the NEF.
Optionally, the method further comprises: and judging whether parameter adjustment needs to be carried out on the algorithm model or not according to the feedback information.
Optionally, the feedback information is sent when the NWDAF entity detects that a deviation value of the predicted result of the algorithm model from the actual operation result is greater than a threshold value.
Optionally, the threshold value is configured by the NWDAF entity side or provided in the subscription message.
Optionally, the feedback information is a notification indicating that the deviation value is greater than a threshold value;
or, the feedback information is a corresponding data set when the deviation value is greater than a threshold value.
Optionally, when the feedback information is a notification indicating that the deviation value is greater than the threshold value, the method further includes: and sending a data request message to the NWDAF entity, and receiving a corresponding data set sent by the NWDAF entity when a deviation value of a prediction result of the algorithm model deviating from an actual operation result is greater than a threshold value.
And the algorithm service provider determines that the parameter of the algorithm model needs to be adjusted according to the times of the received notifications and the deviation value carried in the notifications. And the algorithm service provider receives a corresponding data set which is sent by the NWDAF entity for many times when the deviation value of the prediction result of the algorithm model deviating from the actual operation result is greater than the error threshold value.
Alternatively,
the subscription message is sent directly to an NWDAF entity;
the feedback information is directly sent by an NWDAF entity;
the data request message is sent directly to an NWDAF entity;
or, the subscription message is sent to the NEF and forwarded by the NEF to the NWDAF entity;
the feedback information is sent by an NWDAF entity and forwarded through a NEF;
the data request message is sent to the NEF and forwarded by the NEF to the NWDAF entity.
Referring to fig. 3, a schematic diagram of establishing a direct connection between an NWDAF and an Application Function (AF) for data transmission according to an embodiment of the present disclosure is shown; the AF is a specific application server on the SP side.
An algorithm service provider SP sends a Subscription message Nnwdaf _ EventExposure _ Subscription Req of an event report to an NWDAF, wherein the Subscription message carries an identifier algorithmID of an algorithm model and a predicted deviation threshold of the algorithm model, and is used for indicating the NWDAF to send a notification to the SP when the deviation between a predicted result and an actual result of the algorithm model is greater than a threshold value; the NWDAF sends a response message Nnwdaf _ EventExposure _ Subscription Resp to the SP and confirms the event report;
the method comprises the steps that NWDAF sends an error report Nnwdaf _ EventExposure _ Notify to SP when detecting that deviation between a prediction result and an actual result of an algorithm corresponding to an algorithm model identification is larger than a threshold value, wherein the report carries a deviation value of the detected prediction result of the algorithm model deviating from the actual operation result; if the NWDAF detects that the deviation between the prediction result and the actual result of the algorithm is larger than the threshold value for multiple times, the NWDAF continuously sends a report to the SP; the SP determines whether algorithm parameter adjustment is needed according to the continuous report of the NWDAF, if the SP determines that the algorithm parameter adjustment is needed, a corresponding training data set is needed to be obtained from the NWDAF request when the deviation between the prediction result and the actual result of the algorithm is larger than a threshold value; therefore, the SP will Request the NWDAF _ Connection _ Setup _ Request to establish a Connection, where the Request message is NWDAF _ Connection _ Setup _ Request, and carries an algorithm model identifier algorithmid in the Request, which is used to Request the NWDAF to provide training data of a related algorithm;
the NWDAF receives the Connection establishment request of the SP, returns a Response message Nnwdaf _ Connection _ Setup _ Response and completes the establishment of the data Connection; after the data connection is established, the NWDAF sends training data of the algorithm model to the SP; and after the SP adjusts parameters of the algorithm model, updating the algorithm model.
Referring to fig. 4, a schematic diagram of establishing a direct connection between an NWDAF and an application function AF for data transmission according to another embodiment of the present application is shown;
an algorithm Service Provider (SP) sends a Subscription message Nnwdaf _ EventExposure _ Subscription Req of an event report to an NWDAF, wherein the Subscription message carries an identifier algorithmID of an algorithm model and a predicted deviation threshold of the algorithm model, and is used for indicating the NWDAF to report a data set corresponding to an actual result to the SP when finding that the deviation between the predicted result and the actual result of the algorithm model is greater than the threshold value; the NWDAF sends a response message Nnwdaf-EventExposure _ Subscription Resq to the SP and confirms the event report;
when detecting that the deviation between the prediction result and the actual result of the algorithm corresponding to the algorithm ID of the algorithm model identifier algorithmID is greater than a threshold value, the NWDAF reports a data set (Nnwdaf _ EventExposure _ Notify) with the deviation to the SP, wherein the report carries the input parameters of the prediction and the corresponding actual result data; the SP adds the input parameters and the actual results of the model into training data to carry out algorithm adjustment; the NWDAF may continuously report the input parameters deviating from the prediction and the corresponding actual result data, so that the SP obtains more training data for algorithm adjustment; and after the SP completes parameter adjustment, updating the algorithm model.
Referring to fig. 5, a schematic diagram of data transmission between an NWDAF and an AF through an NEF according to an embodiment of the present application is shown;
an algorithm Service Provider (SP) sends a Subscription message Nnef _ EventExposure _ Subscription Req of an event report to an NEF, wherein the Subscription message carries an ID of an NWDAF, an identifier algorithmm ID of an algorithm model and a prediction deviation threshold of the algorithm model, the Subscription message is used for indicating the NWDAF to send a notification to the SP when the deviation between a prediction result and an actual result of the algorithm model is found to be larger than a threshold value, and the NEF forwards the Subscription message Nnwdaf _ EventExposure _ Subscription Req of the event report to the NWDAF;
the NWDAF sends a response message Nnwdaf _ EventExpo _ Subscription Resq to the NEF to confirm the event report, and the NEF forwards the message Nnef _ EventExpo _ Subscription Resq to the SP; when the NWDAF detects that the deviation between the prediction result and the actual result of the algorithm is larger than a threshold value, sending an error notification or reporting the deviation data (Nnwdaf _ EventExposure _ Notify) to the NEF, and forwarding the notification or report (Nnef _ EventExposure _ Notify) to the SP by the NEF;
if the NWDAF only sends an error notification and does not report training data, the SP determines whether to adjust algorithm parameters according to the notification message, for example, if the prediction error is too large, the SP adjusts parameters; if the algorithm parameter is determined to be needed to be adjusted, a corresponding training data set with errors is required to be requested to the NWDAF; therefore, the SP will Request the NEF to establish a Connection Nnef _ Connection _ Setup _ Request, and carry the algorithmic ID in the Request, which is used to Request the NWDAF to provide the training data of the relevant algorithm model; the NEF forwards a Connection establishment Request Nwdaf _ Connection _ Setup _ Request to the NWDAF; the NWDAF receives the Connection establishment request of the SP, sends a Response message Nnwdaf _ Connection _ Setup _ Response to the NEF, and the NEF forwards the Response request Nnef _ Connection _ Setup _ Response to complete the establishment of the data Connection; after the data connection is established, the NWDAF sends the training data of the algorithm model to the NEF, and the NEF forwards the training data to the SP; and after the SP completes parameter adjustment, updating the algorithm model.
If the NWDAF reports the data set with deviation to the NEF, the NEF forwards the data set to the SP, and after the SP receives the data set, the SP carries out parameter adjustment on the corresponding algorithm model and updates the algorithm model.
Accordingly, on the device side (e.g., NWDAF entity side), referring to fig. 6, an information feedback device provided in an embodiment of the present application includes:
a first unit 11, configured to receive a subscription message sent by an algorithm service provider;
and a second unit 12, configured to send, according to the algorithm model identifier carried in the subscription message, algorithm model feedback information corresponding to the identifier to an algorithm service provider.
On the device side (e.g., algorithm service provider side), referring to fig. 7, an embodiment of the present application provides a feedback information processing device, including:
a sending unit 21, configured to send a subscription message to an NWDAF entity, where the subscription message carries an algorithm model identifier;
a receiving unit 22, configured to receive algorithm model feedback information corresponding to the identifier sent by the NWDAF entity.
Referring to fig. 8, for example, at the NWDAF entity side 610, an information feedback apparatus according to an embodiment of the present application includes:
the processor 300, which is used to read the program in the memory 310, executes the following processes:
receiving a subscription message sent by an algorithm service provider;
and sending algorithm model feedback information corresponding to the identifier to an algorithm service provider according to the algorithm model identifier carried in the subscription message.
Receiving, by the device, a subscription message sent by an algorithmic service provider; and sending algorithm model feedback information corresponding to the identifier to an algorithm service provider according to the algorithm model identifier carried in the subscription message, thereby realizing the feedback of the accuracy of the algorithm model to the algorithm service provider.
Optionally, when the processor is configured to send, according to the algorithm model identifier carried in the subscription message, algorithm model feedback information corresponding to the identifier to an algorithm service provider, the processor is specifically configured to:
and detecting a deviation value of the prediction result of the algorithm model corresponding to the identifier deviating from the actual operation result, and sending algorithm model feedback information corresponding to the identifier to an algorithm service provider when the deviation value is greater than a threshold value.
Optionally, the threshold value is provided in the subscription message by a local configuration or by an algorithmic service provider.
Optionally, the feedback information is a notification for indicating to an algorithm service provider that the deviation value is greater than a threshold value;
or, the feedback information is a corresponding data set when the deviation value is greater than a threshold value.
Optionally, when the feedback information sent to the algorithm service provider is a notification, the processor is further specifically configured to: and receiving a data request message sent by the algorithm service provider, and sending a corresponding data set when the deviation value is larger than a threshold value to the algorithm service provider.
Optionally, the processor is further configured to:
and detecting a deviation value of the prediction result of the updated algorithm model from the actual operation result, and stopping sending the feedback information to the algorithm service provider when the deviation value of the prediction result of the updated algorithm model from the actual operation result is not greater than the threshold value.
Alternatively,
the subscription message is sent directly to the NWDAF entity by an algorithmic service provider;
the feedback information is directly sent to an algorithm service provider;
the data request message is sent directly to the NWDAF entity by an algorithmic service provider;
or,
the subscription message is sent by an algorithm service provider and forwarded to the NWDAF entity by a network capability development function NEF;
the feedback information is sent to the NEF and forwarded by the NEF to the algorithmic service provider;
the data request message is sent by an algorithmic service provider and forwarded to the NWDAF entity via the NEF.
Referring to fig. 9, for example, on the side 800 of the algorithm service provider SP, an embodiment of the present application further provides a feedback information processing apparatus, including:
a processor 400 for reading the program in the memory 410, and performing the following processes:
sending a subscription message to an NWDAF entity, wherein the subscription message carries an algorithm model identifier;
and receiving algorithm model feedback information corresponding to the identifier sent by the NWDAF entity.
Sending a subscription message to an NWDAF entity through the device, wherein the subscription message carries an algorithm model identifier; and receiving the algorithm model feedback information corresponding to the identifier sent by the NWDAF entity, so that an algorithm service provider can evaluate and adjust the accuracy of the algorithm model according to the feedback.
Optionally, the processor is further configured to:
and judging whether parameter adjustment needs to be carried out on the algorithm model or not according to the feedback information.
Optionally, the feedback information is sent when the NWDAF entity detects that a deviation value of the predicted result of the algorithm model from the actual operation result is greater than a threshold value.
Optionally, the threshold value is configured by the NWDAF entity side or provided in the subscription message.
Optionally, the feedback information is a notification indicating that the deviation value is greater than a threshold value;
or, the feedback information is a corresponding data set when the deviation value is greater than a threshold value.
Optionally, when the feedback information is a notification indicating that the deviation value is greater than the threshold value, the processor is further specifically configured to:
and sending a data request message to the NWDAF entity, and receiving a corresponding data set sent by the NWDAF entity when a deviation value of a prediction result of the algorithm model deviating from an actual operation result is greater than a threshold value.
Alternatively,
the subscription message is sent directly to an NWDAF entity;
the feedback information is directly sent by an NWDAF entity;
the data request message is sent directly to an NWDAF entity;
or, the subscription message is sent to the NEF and forwarded by the NEF to the NWDAF entity;
the feedback information is sent by an NWDAF entity and forwarded through a NEF;
the data request message is sent to the NEF and forwarded by the NEF to the NWDAF entity.
Where in fig. 8 and 9 the bus architecture may include any number of interconnected buses and bridges, in particular one or more processors represented by a processor and various circuits of memory represented by a memory linked together. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. The bus interface provides an interface.
The embodiment of the application provides a display terminal, which may be specifically a desktop computer, a portable computer, a smart phone, a tablet computer, a Personal Digital Assistant (PDA), and the like. The Display terminal may include a Central Processing Unit (CPU), a memory, an input/output device, etc., the input device may include a keyboard, a mouse, a touch screen, etc., and the output device may include a Display device, such as a Liquid Crystal Display (LCD), a Cathode Ray Tube (CRT), etc.
For different display terminals, the user interface may optionally be an interface capable of interfacing with a desired device externally, including but not limited to a keypad, display, speaker, microphone, joystick, etc.
The processor is responsible for managing the bus architecture and the usual processing, and the memory may store data used by the processor in performing operations.
Alternatively, the processor may be a CPU (central processing unit), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a CPLD (Complex Programmable Logic Device).
The memory may include Read Only Memory (ROM) and Random Access Memory (RAM), and provides the processor with program instructions and data stored in the memory. In the embodiments of the present application, the memory may be used for storing a program of any one of the methods provided by the embodiments of the present application.
The processor is used for executing any one of the methods provided by the embodiment of the application according to the obtained program instructions by calling the program instructions stored in the memory.
Embodiments of the present application provide a computer storage medium for storing computer program instructions for an apparatus provided in the embodiments of the present application, which includes a program for executing any one of the methods provided in the embodiments of the present application.
The computer storage media may be any available media or data storage device that can be accessed by a computer, including, but not limited to, magnetic memory (e.g., floppy disks, hard disks, magnetic tape, magneto-optical disks (MOs), etc.), optical memory (e.g., CDs, DVDs, BDs, HVDs, etc.), and semiconductor memory (e.g., ROMs, EPROMs, EEPROMs, non-volatile memory (NAND FLASH), Solid State Disks (SSDs)), etc.
In summary, the embodiments of the present application provide a method and an apparatus for information feedback and feedback information processing, so as to implement the accuracy of feeding back an algorithm model from an NWDAF to an algorithm service provider, and the algorithm service provider performs accuracy evaluation and adjustment on the algorithm model according to feedback sent by the NWDAF.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.
Claims (31)
1. An information feedback method applied to a network data analysis function (NWDAF) entity, the method comprising:
receiving a subscription message sent by an algorithm service provider;
and sending algorithm model feedback information corresponding to the identifier to an algorithm service provider according to the algorithm model identifier carried in the subscription message.
2. The method according to claim 1, wherein sending algorithm model feedback information corresponding to an identifier to an algorithm service provider according to the algorithm model identifier carried in the subscription message specifically includes:
and detecting a deviation value of the prediction result of the algorithm model corresponding to the identifier deviating from the actual operation result, and sending algorithm model feedback information corresponding to the identifier to an algorithm service provider when the deviation value is greater than a threshold value.
3. The method of claim 2, wherein the threshold value is provided in a subscription message by a local configuration or by an algorithmic service provider.
4. The method of claim 2, wherein the feedback information is a notification indicating to an algorithmic service provider that the deviation value is greater than a threshold value;
or, the feedback information is a corresponding data set when the deviation value is greater than a threshold value.
5. The method of claim 4, wherein when the feedback information sent to the algorithm service provider is a notification, the method further comprises: and receiving a data request message sent by the algorithm service provider, and sending a corresponding data set when the deviation value is larger than a threshold value to the algorithm service provider.
6. The method of claim 5, further comprising:
and detecting a deviation value of the prediction result of the updated algorithm model from the actual operation result, and stopping sending the feedback information to the algorithm service provider when the deviation value of the prediction result of the updated algorithm model from the actual operation result is not greater than the threshold value.
7. The method according to any one of claims 1 to 6,
the subscription message is sent directly to the NWDAF entity by an algorithmic service provider;
the feedback information is directly sent to an algorithm service provider;
the data request message is sent directly to the NWDAF entity by an algorithmic service provider;
or,
the subscription message is sent by an algorithm service provider and forwarded to the NWDAF entity by a network capability development function NEF;
the feedback information is sent to the NEF and forwarded by the NEF to the algorithmic service provider;
the data request message is sent by an algorithmic service provider and forwarded to the NWDAF entity via the NEF.
8. A feedback information processing method applied to an algorithm service provider, the method comprising:
sending a subscription message to an NWDAF entity, wherein the subscription message carries an algorithm model identifier;
and receiving algorithm model feedback information corresponding to the identifier sent by the NWDAF entity.
9. The method of claim 8, further comprising: and judging whether parameter adjustment needs to be carried out on the algorithm model or not according to the feedback information.
10. The method of claim 9, wherein the feedback information is sent when an NWDAF entity detects that a deviation value of the predicted outcome of the algorithm model from the actual operational outcome is greater than a threshold value.
11. The method of claim 10, wherein the threshold value is configured by an NWDAF entity side or provided in the subscription message.
12. The method of claim 10, wherein the feedback information is a notification indicating that the deviation value is greater than a threshold value;
or, the feedback information is a corresponding data set when the deviation value is greater than a threshold value.
13. The method of claim 12, wherein when the feedback information is a notification indicating that the deviation value is greater than a threshold value, the method further comprises:
and sending a data request message to the NWDAF entity, and receiving a corresponding data set sent by the NWDAF entity when a deviation value of a prediction result of the algorithm model deviating from an actual operation result is greater than a threshold value.
14. The method according to any one of claims 8 to 13,
the subscription message is sent directly to an NWDAF entity;
the feedback information is directly sent by an NWDAF entity;
the data request message is sent directly to an NWDAF entity;
or, the subscription message is sent to the NEF and forwarded by the NEF to the NWDAF entity;
the feedback information is sent by an NWDAF entity and forwarded through a NEF;
the data request message is sent to the NEF and forwarded by the NEF to the NWDAF entity.
15. An information feedback device applied to an NWDAF entity, comprising:
a memory for storing program instructions;
a processor for calling the program instructions stored in the memory and executing according to the obtained program:
receiving a subscription message sent by an algorithm service provider;
and sending algorithm model feedback information corresponding to the identifier to an algorithm service provider according to the algorithm model identifier carried in the subscription message.
16. The apparatus according to claim 15, wherein the processor, when configured to send, to an algorithm service provider, algorithm model feedback information corresponding to an identifier according to the algorithm model identifier carried in the subscription message, is specifically configured to:
and detecting a deviation value of the prediction result of the algorithm model corresponding to the identifier deviating from the actual operation result, and sending algorithm model feedback information corresponding to the identifier to an algorithm service provider when the deviation value is greater than a threshold value.
17. The apparatus of claim 16, wherein the threshold value is provided in a subscription message by a local configuration or by an algorithmic service provider.
18. The apparatus of claim 16, wherein the feedback information is a notification indicating to an algorithmic service provider that the deviation value is greater than a threshold value;
or, the feedback information is a corresponding data set when the deviation value is greater than a threshold value.
19. The apparatus according to claim 18, wherein the processor, when configured to send the feedback information to the algorithm service provider as a notification, is further specifically configured to: and receiving a data request message sent by the algorithm service provider, and sending a corresponding data set when the deviation value is larger than a threshold value to the algorithm service provider.
20. The apparatus of claim 19, wherein the processor is further configured to:
and detecting a deviation value of the prediction result of the updated algorithm model from the actual operation result, and stopping sending the feedback information to the algorithm service provider when the deviation value of the prediction result of the updated algorithm model from the actual operation result is not greater than the threshold value.
21. The apparatus of any one of claims 15 to 20,
the subscription message is sent directly to the NWDAF entity by an algorithmic service provider;
the feedback information is directly sent to an algorithm service provider;
the data request message is sent directly to the NWDAF entity by an algorithmic service provider;
or,
the subscription message is sent by an algorithm service provider and forwarded to the NWDAF entity by a network capability development function NEF;
the feedback information is sent to the NEF and forwarded by the NEF to the algorithmic service provider;
the data request message is sent by an algorithmic service provider and forwarded to the NWDAF entity via the NEF.
22. A feedback information processing apparatus applied to an algorithm service provider, comprising:
a memory for storing program instructions;
a processor for calling the program instructions stored in the memory and executing according to the obtained program:
sending a subscription message to an NWDAF entity, wherein the subscription message carries an algorithm model identifier;
and receiving algorithm model feedback information corresponding to the identifier sent by the NWDAF entity.
23. The apparatus of claim 22, wherein the processor is further configured to:
and judging whether parameter adjustment needs to be carried out on the algorithm model or not according to the feedback information.
24. The apparatus of claim 23 wherein the feedback information is sent when an NWDAF entity detects that a deviation value of the predicted outcome of the algorithmic model from an actual operational outcome is greater than a threshold value.
25. The apparatus of claim 24, wherein the threshold value is configured by an NWDAF entity side or provided in the subscribe message.
26. The apparatus of claim 24, wherein the feedback information is a notification indicating that the deviation value is greater than a threshold value;
or, the feedback information is a corresponding data set when the deviation value is greater than a threshold value.
27. The apparatus of claim 26, wherein the processor, when configured to indicate the deviation value is greater than the threshold value, is further specifically configured to:
and sending a data request message to the NWDAF entity, and receiving a corresponding data set sent by the NWDAF entity when a deviation value of a prediction result of the algorithm model deviating from an actual operation result is greater than a threshold value.
28. The apparatus of any one of claims 22 to 27,
the subscription message is sent directly to an NWDAF entity;
the feedback information is directly sent by an NWDAF entity;
the data request message is sent directly to an NWDAF entity;
or, the subscription message is sent to the NEF and forwarded by the NEF to the NWDAF entity;
the feedback information is sent by an NWDAF entity and forwarded through a NEF;
the data request message is sent to the NEF and forwarded by the NEF to the NWDAF entity.
29. An information feedback apparatus applied to an NWDAF entity, the apparatus comprising:
the first unit is used for receiving a subscription message sent by an algorithm service provider;
and the second unit is used for sending algorithm model feedback information corresponding to the identifier to an algorithm service provider according to the algorithm model identifier carried in the subscription message.
30. A feedback information processing apparatus applied to an algorithm service provider, the apparatus comprising:
a sending unit, configured to send a subscription message to an NWDAF entity, where the subscription message carries an algorithm model identifier;
and the receiving unit is used for receiving the algorithm model feedback information corresponding to the identifier sent by the NWDAF entity.
31. A computer storage medium having stored thereon computer-executable instructions for causing a computer to perform the method of any one of claims 1 to 14.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910477700.2A CN112039934A (en) | 2019-06-03 | 2019-06-03 | Information feedback method, feedback information processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910477700.2A CN112039934A (en) | 2019-06-03 | 2019-06-03 | Information feedback method, feedback information processing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112039934A true CN112039934A (en) | 2020-12-04 |
Family
ID=73576640
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910477700.2A Pending CN112039934A (en) | 2019-06-03 | 2019-06-03 | Information feedback method, feedback information processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112039934A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115202712A (en) * | 2022-06-30 | 2022-10-18 | 北京亚控科技发展有限公司 | Application management method, application subscription method and related equipment |
| CN115470936A (en) * | 2022-09-23 | 2022-12-13 | 广州爱浦路网络技术有限公司 | NWDAF-based machine learning model updating method and device |
| WO2023179604A1 (en) * | 2022-03-25 | 2023-09-28 | 中国移动通信有限公司研究院 | Information processing method and apparatus, related devices, and storage medium |
| WO2024153013A1 (en) * | 2023-01-16 | 2024-07-25 | 维沃移动通信有限公司 | Information transmission method and apparatus and communication device |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103888279A (en) * | 2012-12-20 | 2014-06-25 | 阿里巴巴集团控股有限公司 | Resource pool dynamic management method and system based on feedback control cycle |
| CN104702666A (en) * | 2015-01-30 | 2015-06-10 | 北京邮电大学 | User experience quality confirmation method and system |
| CN104765955A (en) * | 2015-03-18 | 2015-07-08 | 上海交通大学 | Online soft measurement method |
| CN106341842A (en) * | 2016-08-23 | 2017-01-18 | 北京邮电大学 | Method and device for transmitting data of wireless sensor network |
| US20180262924A1 (en) * | 2017-03-10 | 2018-09-13 | Huawei Technologies Co., Ltd. | System and Method of Network Policy Optimization |
| WO2019032968A1 (en) * | 2017-08-11 | 2019-02-14 | Convida Wireless, Llc | Network data analytics in a communications network |
| CN109361526A (en) * | 2018-10-26 | 2019-02-19 | 中国联合网络通信集团有限公司 | Method for routing, PCRF/PCF and the DRA of policy control |
| CN109754105A (en) * | 2017-11-07 | 2019-05-14 | 华为技术有限公司 | A kind of prediction technique and terminal, server |
| CN109803226A (en) * | 2017-11-17 | 2019-05-24 | 华为技术有限公司 | A kind of communication means and device |
-
2019
- 2019-06-03 CN CN201910477700.2A patent/CN112039934A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103888279A (en) * | 2012-12-20 | 2014-06-25 | 阿里巴巴集团控股有限公司 | Resource pool dynamic management method and system based on feedback control cycle |
| CN104702666A (en) * | 2015-01-30 | 2015-06-10 | 北京邮电大学 | User experience quality confirmation method and system |
| CN104765955A (en) * | 2015-03-18 | 2015-07-08 | 上海交通大学 | Online soft measurement method |
| CN106341842A (en) * | 2016-08-23 | 2017-01-18 | 北京邮电大学 | Method and device for transmitting data of wireless sensor network |
| US20180262924A1 (en) * | 2017-03-10 | 2018-09-13 | Huawei Technologies Co., Ltd. | System and Method of Network Policy Optimization |
| WO2019032968A1 (en) * | 2017-08-11 | 2019-02-14 | Convida Wireless, Llc | Network data analytics in a communications network |
| CN109754105A (en) * | 2017-11-07 | 2019-05-14 | 华为技术有限公司 | A kind of prediction technique and terminal, server |
| CN109803226A (en) * | 2017-11-17 | 2019-05-24 | 华为技术有限公司 | A kind of communication means and device |
| CN109361526A (en) * | 2018-10-26 | 2019-02-19 | 中国联合网络通信集团有限公司 | Method for routing, PCRF/PCF and the DRA of policy control |
Non-Patent Citations (3)
| Title |
|---|
| CHINA MOBILE等: ""S2-1903097 Enablers for Network Automation for 5G - phase 2"", 《3GPP TSG_SA\WG2_ARCH》 * |
| HUAWEI ET AL: ""Input for PCC decision from NWDAF"", 《3GPP TSG-SA WG2 MEETING #132 S2-1903915》 * |
| HUAWEI ET AL: ""S2-181250_was_1230_was_0861_was_0212_Discussion on big data and 5G-r1"", 《3GPP TSG_SA\WG2_ARCH》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023179604A1 (en) * | 2022-03-25 | 2023-09-28 | 中国移动通信有限公司研究院 | Information processing method and apparatus, related devices, and storage medium |
| CN115202712A (en) * | 2022-06-30 | 2022-10-18 | 北京亚控科技发展有限公司 | Application management method, application subscription method and related equipment |
| CN115202712B (en) * | 2022-06-30 | 2023-12-29 | 北京亚控科技发展有限公司 | Application management method, application subscription method and related equipment |
| CN115470936A (en) * | 2022-09-23 | 2022-12-13 | 广州爱浦路网络技术有限公司 | NWDAF-based machine learning model updating method and device |
| CN115470936B (en) * | 2022-09-23 | 2023-06-06 | 广州爱浦路网络技术有限公司 | NWDAF-based machine learning model updating method and device |
| WO2024153013A1 (en) * | 2023-01-16 | 2024-07-25 | 维沃移动通信有限公司 | Information transmission method and apparatus and communication device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112039934A (en) | Information feedback method, feedback information processing method and device | |
| CN115599640B (en) | Abnormal supply end warning method, electronic device and medium | |
| CN114169536B (en) | Data management and control method and related device | |
| CN110035496B (en) | Cloud platform switching method and system and electronic equipment | |
| US20160283566A1 (en) | Analyzing sorted mobile application operational state sequences based on sequence metrics | |
| CN111125586B (en) | Page updating method and device | |
| CN113010238A (en) | Permission determination method, device and system for micro application call interface | |
| WO2024066374A1 (en) | Service degradation method and apparatus, device, computer-readable medium and program product | |
| JP2021010164A (en) | Method and apparatus for processing notification using notification preset | |
| US20160232446A1 (en) | Generating state predictive metrics based on markov chain model from application operational state sequences | |
| CN111836221A (en) | Charging management method, device and system | |
| CN112559233B (en) | Method, device, equipment and computer readable medium for identifying fault type | |
| CN113378041B (en) | Prompt message pushing method, device, electronic equipment and computer readable medium | |
| CN106507268B (en) | Method and device for dynamic verification in mobile phone carriers | |
| CN112257039B (en) | Identity attribute adding method and device and electronic equipment | |
| CN114553676A (en) | Message processing method, platform, electronic equipment and storage medium | |
| CN109951301B (en) | Policy and charging control method and device | |
| KR102005932B1 (en) | Server for managing social network friends and method for managing social network friends using the same | |
| CN112788101A (en) | Control method, device, terminal and storage medium of server cluster | |
| CN111277435A (en) | Method and device for upgrading network equipment, storage medium and electronic equipment | |
| CN118158082B (en) | Method, device, equipment and medium for updating communication resource message of intelligent household equipment | |
| CN111176679A (en) | Application program updating method and device | |
| CN113852686B (en) | Block chain network communication method, device, equipment and readable storage medium | |
| EP3518513A1 (en) | Streaming data acquisition method, device, and system | |
| CN110609701A (en) | Method, apparatus and storage medium for providing service |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201204 |
|
| RJ01 | Rejection of invention patent application after publication |