CN106790560B - Risk control method and device for electronic notice information - Google Patents
Risk control method and device for electronic notice information Download PDFInfo
- Publication number
- CN106790560B CN106790560B CN201611218211.8A CN201611218211A CN106790560B CN 106790560 B CN106790560 B CN 106790560B CN 201611218211 A CN201611218211 A CN 201611218211A CN 106790560 B CN106790560 B CN 106790560B
- Authority
- CN
- China
- Prior art keywords
- electronic bulletin
- information
- risk
- storm
- computing system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/51—Discovery or management thereof, e.g. service location protocol [SLP] or web services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
- Alarm Systems (AREA)
Abstract
The invention provides a risk control method and a risk control device for electronic notice information, wherein the method comprises the following steps: matching and judging electronic bulletin information acquired in real time and preset electronic bulletin risk information through a logic processing bolt module in a Storm-type computing system to obtain a risk judgment result of the electronic bulletin information; and executing risk control operation corresponding to the risk judgment result of the electronic bulletin information on the electronic bulletin information acquired in real time through an updating bolt module in the Storm-type computing system. The risk control method and the risk control device for the electronic notice information can carry out real-time batch risk control processing on the electronic notice information with large data volume; the electronic notice information with large data volume is processed without time delay; the risk control of the electronic notice information is carried out through the Storm streaming computing framework, and the electronic notice information can be horizontally expanded into a server.
Description
Technical Field
The invention relates to the technical field of internet, in particular to a risk control method and device for electronic notice information.
Background
Currently, with the rapid development of Bulletin Board Systems (BBS) and classified information websites, it is a life habit of people to exchange and publish information by publishing electronic Bulletin information on the BBS and the classified information websites. However, currently, risk control of electronic notice information is performed on received electronic notice information according to a customized risk control rule by using a Java application program. The method cannot carry out current limiting or batch processing on the input of the electronic notice information; when the number of the electronic notice information is too large (for example, the number of the electronic notice information is more than millions), processing delay occurs, and the user experience is seriously influenced; the electronic notice information entering the server has poor horizontal expansibility and cannot adapt to the high-speed development of the system.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a risk control method and device for electronic notice information, and overcome the defect that the real-time batch risk control processing cannot be performed on electronic notice information with large data volume in the prior art.
The technical scheme adopted by the invention is that the risk control method of the electronic bulletin information comprises the following steps:
matching and judging electronic bulletin information acquired in real time and preset electronic bulletin risk information through a logic processing bolt module in a Storm-type computing system to obtain a risk judgment result of the electronic bulletin information;
and executing risk control operation corresponding to the risk judgment result of the electronic bulletin information on the electronic bulletin information acquired in real time through an updating bolt module in the Storm-type computing system.
Further, before the matching judgment of the electronic bulletin information acquired in real time and the preset electronic bulletin risk information is performed through a logic processing bolt module in the streaming Storm formula computing system, the method further includes:
and performing queue operation of entering the electronic bulletin information acquired in real time into a fine framework at the entrance of the Storm type computing system.
Further, after the Storm-type computing system entry performs a queue operation of entering the electronic bulletin information acquired in real time into a fine framework, the method further includes:
and controlling the electronic bulletin information in the queue with a set flow rate and a set throughput through an Spout module in the Storm formula computing system, and sending the electronic bulletin information in the queue after being controlled with the set flow rate and the set throughput to a logic processing bolt module in the Storm formula computing system.
Further, the step of determining, by a logic processing bolt module in the Storm-type computing system, that the electronic bulletin information acquired in real time matches with preset electronic bulletin risk information includes:
matching and judging the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time and the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information through a logic processing bolt module in the Storm formula computing system;
if the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time are matched with the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information, judging that the electronic bulletin information is electronic bulletin risk information;
otherwise, the electronic bulletin information is judged to be normal electronic bulletin information.
Further, the executing, by the update bolt module in the Storm-type computing system, a risk control operation corresponding to a risk determination result of the electronic bulletin information on the electronic bulletin information acquired in real time includes:
executing deletion operation on the electronic bulletin information judged as electronic bulletin risk information through an update bolt module in the Storm-type computing system;
and executing issuing operation on the electronic bulletin information judged as normal information of the electronic bulletin through an updating bolt module in the Storm-type computing system.
The present invention also provides a risk control device for electronic bulletin information, comprising:
the judgment module is used for matching and judging the electronic bulletin information acquired in real time and preset electronic bulletin risk information through a logic processing bolt module in the Storm-type computing system to obtain a risk judgment result of the electronic bulletin information;
and the execution module is used for executing risk control operation corresponding to the risk judgment result of the electronic bulletin information on the electronic bulletin information acquired in real time through the update bolt module in the Storm-type computing system.
Further, the apparatus further comprises:
and the queue module is used for performing queue operation of entering the electronic bulletin information acquired in real time into a fine frame at the entrance of the Storm-type computing system before the judgment module performs matching judgment on the electronic bulletin information acquired in real time and preset electronic bulletin risk information.
Further, the apparatus further comprises:
and the current limiting module is used for controlling the electronic bulletin information in the queue with set flow rate and set throughput through a Spout module in the Storm formula computing system after the queue module carries out queue operation of entering a fine frame on the electronic bulletin information acquired in real time, and sending the electronic bulletin information which is controlled with the set flow rate and the set throughput in the queue to a logic processing bolt module in the Storm formula computing system.
Further, the determining module is specifically configured to:
matching and judging the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time and the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information through a logic processing bolt module in the Storm formula computing system;
if the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time are matched with the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information, judging that the electronic bulletin information is electronic bulletin risk information;
otherwise, the electronic bulletin information is judged to be normal electronic bulletin information.
Further, the execution module is specifically configured to:
executing deletion operation on the electronic bulletin information judged as electronic bulletin risk information through an update bolt module in the Storm-type computing system;
and executing issuing operation on the electronic bulletin information judged as normal information of the electronic bulletin through an updating bolt module in the Storm-type computing system.
By adopting the technical scheme, the invention at least has the following advantages:
the risk control method and the risk control device for the electronic notice information can carry out real-time batch risk control processing on the electronic notice information with large data volume; the electronic notice information with large data volume is processed without time delay; the risk control of the electronic notice information is carried out through the Storm streaming computing framework, and the electronic notice information can be horizontally expanded into a server.
Drawings
Fig. 1 is a flowchart of a risk control method for electronic bulletin information according to a first embodiment of the present invention;
FIG. 2 is a flowchart of a risk control method for electronic bulletin information according to a second embodiment of the present invention;
FIG. 3 is a schematic diagram illustrating a risk control device for electronic bulletin information according to a fourth embodiment of the present invention;
fig. 4 is a schematic structural diagram of a risk control device for electronic bulletin information according to a fifth embodiment of the present invention.
Detailed Description
To further explain the technical means and effects of the present invention adopted to achieve the intended purpose, the present invention will be described in detail with reference to the accompanying drawings and preferred embodiments.
A first embodiment of the present invention provides a risk control method for electronic bulletin information, as shown in fig. 1, including the following specific steps:
and S101, matching and judging the electronic bulletin information acquired in real time and preset electronic bulletin risk information through a logic processing bolt module in the Storm-type computing system to obtain a risk judgment result of the electronic bulletin information.
Specifically, step S101 includes:
matching and judging the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time and the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information through a logic processing bolt module in the Storm formula computing system;
if the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time are matched with the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information, judging that the electronic bulletin information is electronic bulletin risk information;
and if the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time are not matched with the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information, judging that the electronic bulletin information is normal electronic bulletin information.
Wherein, the logic processing bolt module includes: the method comprises the steps of presetting data attributes in the electronic bulletin risk information, presetting functions corresponding to the data attributes in the electronic bulletin risk information, and presetting function characteristics corresponding to the data attributes in the electronic bulletin risk information.
The data attribute is the attribute of the data in the electronic bulletin information;
the function corresponding to the data attribute is description information of the data attribute;
the function characteristic corresponding to the data attribute is the description information characteristic of the data attribute.
For example: the data attribute is the mobile phone number of the electronic bulletin information publisher;
the function corresponding to the data attribute is the first three digits of the mobile phone number of the electronic bulletin information publisher;
the function characteristic corresponding to the data attribute is that the first three digits of the mobile phone number of the electronic bulletin information publisher are 177.
For example: the function characteristic corresponding to the data attribute in the acquired electronic bulletin information is 177 as the first three-digit characteristic of the mobile phone number of the publisher of the electronic bulletin information;
the function characteristic corresponding to the data attribute in the preset electronic bulletin risk information is that the first three digital characteristics of the mobile phone number of the electronic bulletin information publisher are 177;
matching and judging the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time and the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information through a logic processing bolt module in the Storm formula computing system;
and matching the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time with the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information, and judging that the electronic bulletin information is electronic bulletin risk information.
For another example: the function characteristic corresponding to the data attribute in the acquired electronic bulletin information is that the first three-digit characteristic of the mobile phone number of the publisher of the electronic bulletin information is 186;
the function characteristic corresponding to the data attribute in the preset electronic bulletin risk information is that the first three digital characteristics of the mobile phone number of the electronic bulletin information publisher are 177;
matching and judging the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time and the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information through a logic processing bolt module in the Storm formula computing system;
and if the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time are not matched with the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information, judging that the electronic bulletin information is normal electronic bulletin information.
And step S102, executing risk control operation corresponding to the risk judgment result of the electronic bulletin information on the electronic bulletin information acquired in real time through an update bolt module in the Storm-type computing system.
Specifically, step S102 includes:
executing deletion operation on the electronic bulletin information judged as electronic bulletin risk information through an update bolt module in the Storm-type computing system;
issuing the electronic bulletin information determined as the normal electronic bulletin information through an update bolt module in the Storm-style computing system.
The risk judgment is carried out on the electronic bulletin information acquired in real time through the Storm type computing system, and the real-time batch risk control processing can be carried out on the electronic bulletin information with large data volume; the electronic notice information with large data volume is processed without time delay.
A second embodiment of the present invention, a risk control method for electronic bulletin information, as shown in fig. 2, includes the following specific steps:
step S201, the electronic bulletin information acquired in real time is processed into queue operation of a fine frame at the entrance of the Storm type computing system.
The electronic bulletin information obtained in real time is subjected to queue operation of a fine framework at the entrance of the Storm type computing system, so that the electronic bulletin information is horizontally expanded to the server.
And S202, controlling the electronic announcement information in the queue to set the flow rate and set the throughput through an Spout module in the Storm-type computing system.
Specifically, step S202 includes:
and controlling the electronic announcement information in the queue with the set flow rate and the set throughput through an Spout module in the Storm-type computing system, and sending the electronic announcement information in the queue after being controlled with the set flow rate and the set throughput to a logic processing bolt module in the Storm-type computing system.
The flow rate and the throughput of the electronic bulletin information in the queue are controlled by the Spout module in the Storm type computing system according to the set flow rate and the set throughput, and the flow rate and the throughput can be dynamically controlled in real time when the number of electronic bulletin information issuing requests is too large.
Step S203, the logic processing bolt module in the Storm formula computing system is used for matching and judging the electronic bulletin information acquired in real time and the preset electronic bulletin risk information to obtain the risk judgment result of the electronic bulletin information.
Specifically, step S203 includes:
matching and judging the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time and the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information through a logic processing bolt module in the Storm formula computing system;
if the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time are matched with the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information, judging that the electronic bulletin information is electronic bulletin risk information;
and if the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time are not matched with the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information, judging that the electronic bulletin information is normal electronic bulletin information.
Wherein, the logic processing bolt module includes: the method comprises the steps of presetting data attributes in the electronic bulletin risk information, presetting functions corresponding to the data attributes in the electronic bulletin risk information, and presetting function characteristics corresponding to the data attributes in the electronic bulletin risk information.
The data attribute is the attribute of the data in the electronic bulletin information;
the function corresponding to the data attribute is description information of the data attribute;
the function characteristic corresponding to the data attribute is the description information characteristic of the data attribute.
For example: the data attribute is the mobile phone number of the electronic bulletin information publisher;
the function corresponding to the data attribute is the first three digits of the mobile phone number of the electronic bulletin information publisher;
the function characteristic corresponding to the data attribute is that the first three digits of the mobile phone number of the electronic bulletin information publisher are 177.
For example: the function characteristic corresponding to the data attribute in the acquired electronic bulletin information is 177 as the first three-digit characteristic of the mobile phone number of the publisher of the electronic bulletin information;
the function characteristic corresponding to the data attribute in the preset electronic bulletin risk information is that the first three digital characteristics of the mobile phone number of the electronic bulletin information publisher are 177;
matching and judging the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time and the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information through a logic processing bolt module in the Storm formula computing system;
and matching the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time with the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information, and judging that the electronic bulletin information is electronic bulletin risk information.
For another example: the function characteristic corresponding to the data attribute in the acquired electronic bulletin information is that the first three-digit characteristic of the mobile phone number of the publisher of the electronic bulletin information is 186;
the function characteristic corresponding to the data attribute in the preset electronic bulletin risk information is that the first three digital characteristics of the mobile phone number of the electronic bulletin information publisher are 177;
matching and judging the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time and the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information through a logic processing bolt module in the Storm formula computing system;
and mismatching the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time with the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information, and judging that the electronic bulletin information is normal electronic bulletin information.
And step S204, executing risk control operation corresponding to the risk judgment result of the electronic bulletin information on the electronic bulletin information acquired in real time through an update bolt module in the Storm-type computing system.
Specifically, step S204 includes:
executing deletion operation on the electronic bulletin information judged as electronic bulletin risk information through an update bolt module in the Storm-type computing system;
issuing the electronic bulletin information determined as the normal electronic bulletin information through an update bolt module in the Storm-style computing system.
The risk judgment is carried out on the electronic bulletin information acquired in real time through the Storm type computing system, and the real-time batch risk control processing can be carried out on the electronic bulletin information with large data volume; the electronic notice information with large data volume is processed without time delay.
In a third embodiment of the present invention, a method for controlling a risk of an electronic bulletin message includes the following steps:
step S301, performing queue operation of entering the electronic bulletin information acquired in real time into a fine frame at the entrance of the Storm type computing system.
The electronic bulletin information obtained in real time is subjected to queue operation of a fine framework at the entrance of the Storm type computing system, so that the electronic bulletin information is horizontally expanded to the server.
And step S302, controlling the electronic announcement information in the queue to set the flow rate and set the throughput through an Spout module in the Storm-type computing system.
Specifically, step S302 includes:
and controlling the electronic announcement information in the queue with the set flow rate and the set throughput through an Spout module in the Storm-type computing system, and sending the electronic announcement information in the queue after being controlled with the set flow rate and the set throughput to a logic processing bolt module in the Storm-type computing system.
The flow rate and the throughput of the electronic bulletin information in the queue are controlled by the Spout module in the Storm type computing system according to the set flow rate and the set throughput, and the flow rate and the throughput can be dynamically controlled in real time when the number of electronic bulletin information issuing requests is too large.
Step S303, the logic processing bolt module in the Storm formula computing system is used for matching and judging the electronic bulletin information acquired in real time and the preset electronic bulletin risk information to obtain the risk judgment result of the electronic bulletin information.
Wherein, the logic processing bolt module includes: a built-in strategy bolt module and a rule engine bolt module;
the built-in strategy bolt module comprises: the data attribute in the preset electronic bulletin risk information, the function corresponding to the data attribute in the preset electronic bulletin risk information and the function characteristic corresponding to the data attribute in the preset electronic bulletin risk information.
The rule engine bolt module comprises: the data attribute in the preset electronic bulletin risk information, the function corresponding to the data attribute in the preset electronic bulletin risk information and the function characteristic corresponding to the data attribute in the preset electronic bulletin risk information.
The built-in strategy bolt module can not be configured; the rule engine bolt module may be configurable.
The data attribute is the attribute of the data in the electronic bulletin information;
the function corresponding to the data attribute is description information of the data attribute;
the function characteristic corresponding to the data attribute is the description information characteristic of the data attribute.
For example: the data attribute is the mobile phone number of the electronic bulletin information publisher;
the function corresponding to the data attribute is the first three digits of the mobile phone number of the electronic bulletin information publisher;
the function characteristic corresponding to the data attribute is that the first three digits of the mobile phone number of the electronic bulletin information publisher are 177.
Specifically, step S303 includes:
through a built-in strategy bolt module in the Storm formula computing system, matching and judging the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time and the function characteristics corresponding to the data attributes in the electronic bulletin risk information preset in the built-in strategy bolt module;
if the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time are matched with the function characteristics corresponding to the data attributes in the electronic bulletin risk information preset by the built-in strategy bolt module, judging that the electronic bulletin information is electronic bulletin risk information;
if the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time are not matched with the function characteristics corresponding to the data attributes in the electronic bulletin risk information preset by a built-in strategy bolt module, matching and judging the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time and the function characteristics corresponding to the data attributes in the electronic bulletin risk information preset in a rule engine bolt module through a rule engine bolt module in a Storm formula computing system;
if the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time are matched with the function characteristics corresponding to the data attributes in the electronic bulletin risk information preset by the rule engine bolt module, judging that the electronic bulletin information is electronic bulletin risk information;
and if the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time are not matched with the function characteristics corresponding to the data attributes in the electronic bulletin risk information preset by the rule engine bolt module, judging that the electronic bulletin information is normal electronic bulletin information.
Step S304, executing risk control operation corresponding to the risk judgment result of the electronic bulletin information to the electronic bulletin information acquired in real time through an update bolt module in the Storm formula computing system.
Specifically, step S204 includes:
executing deletion operation on the electronic bulletin information judged as electronic bulletin risk information through an update bolt module in the Storm-type computing system;
issuing the electronic bulletin information determined as the normal electronic bulletin information through an update bolt module in the Storm-style computing system.
The risk judgment is carried out on the electronic bulletin information acquired in real time through the Storm type computing system, and the real-time batch risk control processing can be carried out on the electronic bulletin information with large data volume; the electronic notice information with large data volume is processed without time delay.
A fourth embodiment of the present invention, a risk control device for electronic bulletin information, as shown in fig. 3, includes the following components:
the judging module 300 is configured to perform matching judgment on the electronic bulletin information acquired in real time and preset electronic bulletin risk information through a logic processing bolt module in the Storm formula computing system to obtain a risk judgment result of the electronic bulletin information.
Specifically, the determining module 300 is configured to:
matching and judging the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time and the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information through a logic processing bolt module in the Storm formula computing system;
if the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time are matched with the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information, judging that the electronic bulletin information is electronic bulletin risk information;
and if the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time are not matched with the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information, judging that the electronic bulletin information is normal electronic bulletin information.
Wherein, the logic processing bolt module includes: a built-in strategy bolt module and a rule engine bolt module;
the built-in strategy bolt module comprises: the data attribute in the preset electronic bulletin risk information, the function corresponding to the data attribute in the preset electronic bulletin risk information and the function characteristic corresponding to the data attribute in the preset electronic bulletin risk information.
The rule engine bolt module comprises: the data attribute in the preset electronic bulletin risk information, the function corresponding to the data attribute in the preset electronic bulletin risk information and the function characteristic corresponding to the data attribute in the preset electronic bulletin risk information.
The built-in strategy bolt module can not be configured; the rule engine bolt module may be configurable.
The data attribute is the attribute of the data in the electronic bulletin information;
the function corresponding to the data attribute is description information of the data attribute;
the function characteristic corresponding to the data attribute is the description information characteristic of the data attribute.
For example: the data attribute is the mobile phone number of the electronic bulletin information publisher;
the function corresponding to the data attribute is the first three digits of the mobile phone number of the electronic bulletin information publisher;
the function characteristic corresponding to the data attribute is that the first three digits of the mobile phone number of the electronic bulletin information publisher are 177.
The executing module 400 is configured to execute, by using an update bolt module in the Storm-type computing system, a risk control operation corresponding to a risk determination result of the electronic bulletin information on the electronic bulletin information acquired in real time.
Specifically, the execution module 400 is configured to:
executing deletion operation on the electronic bulletin information judged as electronic bulletin risk information through an update bolt module in the Storm-type computing system;
issuing the electronic bulletin information determined as the normal electronic bulletin information through an update bolt module in the Storm-style computing system.
The risk judgment is carried out on the electronic bulletin information acquired in real time through the Storm type computing system, and the real-time batch risk control processing can be carried out on the electronic bulletin information with large data volume; the electronic notice information with large data volume is processed without time delay.
A fifth embodiment of the present invention, a risk control device for electronic bulletin information, as shown in fig. 4, includes the following components:
the queue module 100 is used for performing queue operation of entering the electronic bulletin information acquired in real time into a fine framework at the entrance of the Storm type computing system.
The electronic bulletin information obtained in real time is subjected to queue operation of a fine framework at the entrance of the Storm type computing system, so that the electronic bulletin information is horizontally expanded to the server.
And the current limiting module 200 is used for controlling the electronic announcement information in the queue through a Spout module in the Storm-type computing system so as to set the flow rate and set the throughput.
Specifically, the current limiting module 200 is configured to:
and controlling the electronic announcement information in the queue with the set flow rate and the set throughput through an Spout module in the Storm-type computing system, and sending the electronic announcement information in the queue after being controlled with the set flow rate and the set throughput to a logic processing bolt module in the Storm-type computing system.
The flow rate and the throughput of the electronic bulletin information in the queue are controlled by the Spout module in the Storm type computing system according to the set flow rate and the set throughput, and the flow rate and the throughput can be dynamically controlled in real time when the number of electronic bulletin information issuing requests is too large.
The judging module 300 is configured to perform matching judgment on the electronic bulletin information acquired in real time and preset electronic bulletin risk information through a logic processing bolt module in the Storm formula computing system to obtain a risk judgment result of the electronic bulletin information.
Specifically, the determining module 300 is configured to:
matching and judging the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time and the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information through a logic processing bolt module in the Storm formula computing system;
if the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time are matched with the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information, judging that the electronic bulletin information is electronic bulletin risk information;
and if the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time are not matched with the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information, judging that the electronic bulletin information is normal electronic bulletin information.
Wherein, the logic processing bolt module includes: the method comprises the steps of presetting data attributes in the electronic bulletin risk information, presetting functions corresponding to the data attributes in the electronic bulletin risk information, and presetting function characteristics corresponding to the data attributes in the electronic bulletin risk information.
The data attribute is the attribute of the data in the electronic bulletin information;
the function corresponding to the data attribute is description information of the data attribute;
the function characteristic corresponding to the data attribute is the description information characteristic of the data attribute.
For example: the data attribute is the mobile phone number of the electronic bulletin information publisher;
the function corresponding to the data attribute is the first three digits of the mobile phone number of the electronic bulletin information publisher;
the function characteristic corresponding to the data attribute is that the first three digits of the mobile phone number of the electronic bulletin information publisher are 177.
For example: the function characteristic corresponding to the data attribute in the acquired electronic bulletin information is 177 as the first three-digit characteristic of the mobile phone number of the publisher of the electronic bulletin information;
the function characteristic corresponding to the data attribute in the preset electronic bulletin risk information is that the first three digital characteristics of the mobile phone number of the electronic bulletin information publisher are 177;
the judging module 300 is configured to perform matching judgment on a function feature corresponding to a data attribute in the electronic bulletin information acquired in real time and a function feature corresponding to a data attribute in the preset electronic bulletin risk information through a logic processing bolt module in the Storm formula computing system;
and matching the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time with the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information, and judging that the electronic bulletin information is electronic bulletin risk information.
For another example: the function characteristic corresponding to the data attribute in the acquired electronic bulletin information is that the first three-digit characteristic of the mobile phone number of the publisher of the electronic bulletin information is 186;
the function characteristic corresponding to the data attribute in the preset electronic bulletin risk information is that the first three digital characteristics of the mobile phone number of the electronic bulletin information publisher are 177;
the judging module 300 is configured to perform matching judgment on a function feature corresponding to a data attribute in the electronic bulletin information acquired in real time and a function feature corresponding to a data attribute in the preset electronic bulletin risk information through a logic processing bolt module in the Storm formula computing system;
and mismatching the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time with the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information, and judging that the electronic bulletin information is normal electronic bulletin information.
The executing module 400 is configured to execute, by using an update bolt module in the Storm-type computing system, a risk control operation corresponding to a risk determination result of the electronic bulletin information on the electronic bulletin information acquired in real time.
Specifically, the execution module 400 is configured to:
executing deletion operation on the electronic bulletin information judged as electronic bulletin risk information through an update bolt module in the Storm-type computing system;
issuing the electronic bulletin information determined as the normal electronic bulletin information through an update bolt module in the Storm-style computing system.
The risk judgment is carried out on the electronic bulletin information acquired in real time through the Storm type computing system, and the real-time batch risk control processing can be carried out on the electronic bulletin information with large data volume; the electronic notice information with large data volume is processed without time delay.
In a sixth embodiment of the present invention, a risk control device for electronic bulletin information includes the following components:
the queue module 100 is used for performing queue operation of entering the electronic bulletin information acquired in real time into a fine framework at the entrance of the Storm type computing system.
The electronic bulletin information obtained in real time is subjected to queue operation of a fine framework at the entrance of the Storm type computing system, so that the electronic bulletin information is horizontally expanded to the server.
And the current limiting module 200 is used for controlling the electronic announcement information in the queue through a Spout module in the Storm-type computing system so as to set the flow rate and set the throughput.
Specifically, the current limiting module 200 is configured to:
and controlling the electronic announcement information in the queue with the set flow rate and the set throughput through an Spout module in the Storm-type computing system, and sending the electronic announcement information in the queue after being controlled with the set flow rate and the set throughput to a logic processing bolt module in the Storm-type computing system.
The flow rate and the throughput of the electronic bulletin information in the queue are controlled by the Spout module in the Storm type computing system according to the set flow rate and the set throughput, and the flow rate and the throughput can be dynamically controlled in real time when the number of electronic bulletin information issuing requests is too large.
The judging module 300 is configured to perform matching judgment on the electronic bulletin information acquired in real time and preset electronic bulletin risk information through a logic processing bolt module in the Storm formula computing system to obtain a risk judgment result of the electronic bulletin information.
Wherein, the logic processing bolt module includes: a built-in strategy bolt module and a rule engine bolt module;
the built-in strategy bolt module comprises: the data attribute in the preset electronic bulletin risk information, the function corresponding to the data attribute in the preset electronic bulletin risk information and the function characteristic corresponding to the data attribute in the preset electronic bulletin risk information.
The rule engine bolt module comprises: the data attribute in the preset electronic bulletin risk information, the function corresponding to the data attribute in the preset electronic bulletin risk information and the function characteristic corresponding to the data attribute in the preset electronic bulletin risk information.
The built-in strategy bolt module can not be configured; the rule engine bolt module may be configurable.
The data attribute is the attribute of the data in the electronic bulletin information;
the function corresponding to the data attribute is description information of the data attribute;
the function characteristic corresponding to the data attribute is the description information characteristic of the data attribute.
For example: the data attribute is the mobile phone number of the electronic bulletin information publisher;
the function corresponding to the data attribute is the first three digits of the mobile phone number of the electronic bulletin information publisher;
the function characteristic corresponding to the data attribute is that the first three digits of the mobile phone number of the electronic bulletin information publisher are 177.
Specifically, the determining module 300 is configured to:
through a built-in strategy bolt module in the Storm formula computing system, matching and judging the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time and the function characteristics corresponding to the data attributes in the electronic bulletin risk information preset in the built-in strategy bolt module;
if the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time are matched with the function characteristics corresponding to the data attributes in the electronic bulletin risk information preset by the built-in strategy bolt module, judging that the electronic bulletin information is electronic bulletin risk information;
if the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time are not matched with the function characteristics corresponding to the data attributes in the electronic bulletin risk information preset by a built-in strategy bolt module, matching and judging the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time and the function characteristics corresponding to the data attributes in the electronic bulletin risk information preset in a rule engine bolt module through a rule engine bolt module in a Storm formula computing system;
if the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time are matched with the function characteristics corresponding to the data attributes in the electronic bulletin risk information preset by the rule engine bolt module, judging that the electronic bulletin information is electronic bulletin risk information;
and if the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time are not matched with the function characteristics corresponding to the data attributes in the electronic bulletin risk information preset by the rule engine bolt module, judging that the electronic bulletin information is normal electronic bulletin information.
The executing module 400 is configured to execute, by using an update bolt module in the Storm-type computing system, a risk control operation corresponding to a risk determination result of the electronic bulletin information on the electronic bulletin information acquired in real time.
Specifically, the execution module 400 is configured to:
executing deletion operation on the electronic bulletin information judged as electronic bulletin risk information through an update bolt module in the Storm-type computing system;
issuing the electronic bulletin information determined as the normal electronic bulletin information through an update bolt module in the Storm-style computing system.
The risk judgment is carried out on the electronic bulletin information acquired in real time through the Storm type computing system, and the real-time batch risk control processing can be carried out on the electronic bulletin information with large data volume; the electronic notice information with large data volume is processed without time delay.
While the invention has been described in connection with specific embodiments thereof, it is to be understood that it is intended by the appended drawings and description that the invention may be embodied in other specific forms without departing from the spirit or scope of the invention.
Claims (6)
1. A risk control method for electronic bulletin information is characterized by comprising the following steps:
matching and judging electronic bulletin information acquired in real time and preset electronic bulletin risk information through a logic processing bolt module in a Storm-type computing system to obtain a risk judgment result of the electronic bulletin information;
executing risk control operation corresponding to a risk judgment result of the electronic bulletin information on the electronic bulletin information acquired in real time through an updating bolt module in the Storm-type computing system;
before the matching judgment of the electronic bulletin information acquired in real time and the preset electronic bulletin risk information is performed through a logic processing bolt module in the Storm formula computing system, the method further comprises the following steps:
performing queue operation of entering the electronic bulletin information acquired in real time into a fine framework at the entrance of the Storm type computing system;
the step of matching and judging the electronic bulletin information acquired in real time and the preset electronic bulletin risk information through a logic processing bolt module in the Storm formula computing system comprises the following steps:
matching and judging the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time and the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information through a logic processing bolt module in the Storm formula computing system;
if the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time are matched with the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information, judging that the electronic bulletin information is electronic bulletin risk information;
otherwise, judging the electronic bulletin information to be electronic bulletin normal information;
the data attribute is the attribute of data in the electronic bulletin information, and the data attribute comprises the mobile phone number of an electronic bulletin information publisher;
the function features corresponding to the data attributes are description information features of the data attributes, and the function features corresponding to the data attributes comprise multi-digit digital features of the mobile phone number of the electronic bulletin information publisher.
2. The method of claim 1, wherein after the Storm-like computing system portal performs a queue operation of entering the real-time obtained electronic bulletin information into a fine framework, the method further comprises:
and controlling the electronic bulletin information in the queue with a set flow rate and a set throughput through an Spout module in the Storm formula computing system, and sending the electronic bulletin information in the queue after being controlled with the set flow rate and the set throughput to a logic processing bolt module in the Storm formula computing system.
3. The method according to claim 1, wherein the performing, by an update bolt module in the Storm-type computing system, a risk control operation corresponding to a risk judgment result of the electronic bulletin information on the electronic bulletin information acquired in real time comprises:
executing deletion operation on the electronic bulletin information judged as electronic bulletin risk information through an update bolt module in the Storm-type computing system;
and executing issuing operation on the electronic bulletin information judged as normal information of the electronic bulletin through an updating bolt module in the Storm-type computing system.
4. A risk control device for electronically advertising information, comprising:
the judgment module is used for matching and judging the electronic bulletin information acquired in real time and preset electronic bulletin risk information through a logic processing bolt module in the Storm-type computing system to obtain a risk judgment result of the electronic bulletin information;
the execution module is used for executing risk control operation corresponding to a risk judgment result of the electronic bulletin information on the electronic bulletin information acquired in real time through an update bolt module in the Storm-type computing system;
the queue module is used for performing queue operation of entering the electronic bulletin information acquired in real time into a fine frame at an entrance of the Storm-type computing system before the judgment module performs matching judgment on the electronic bulletin information acquired in real time and preset electronic bulletin risk information;
the judgment module is specifically configured to:
matching and judging the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time and the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information through a logic processing bolt module in the Storm formula computing system;
if the function characteristics corresponding to the data attributes in the electronic bulletin information acquired in real time are matched with the function characteristics corresponding to the data attributes in the preset electronic bulletin risk information, judging that the electronic bulletin information is electronic bulletin risk information;
otherwise, judging the electronic bulletin information to be electronic bulletin normal information;
the data attribute is the attribute of data in the electronic bulletin information, and the data attribute comprises the mobile phone number of an electronic bulletin information publisher;
the function features corresponding to the data attributes are description information features of the data attributes, and the function features corresponding to the data attributes comprise multi-digit digital features of the mobile phone number of the electronic bulletin information publisher.
5. The apparatus of claim 4, further comprising:
and the current limiting module is used for controlling the electronic bulletin information in the queue with set flow rate and set throughput through a Spout module in the Storm formula computing system after the queue module carries out queue operation of entering a fine frame on the electronic bulletin information acquired in real time, and sending the electronic bulletin information which is controlled with the set flow rate and the set throughput in the queue to a logic processing bolt module in the Storm formula computing system.
6. The apparatus of claim 4, wherein the execution module is specifically configured to:
executing deletion operation on the electronic bulletin information judged as electronic bulletin risk information through an update bolt module in the Storm-type computing system;
and executing issuing operation on the electronic bulletin information judged as normal information of the electronic bulletin through an updating bolt module in the Storm-type computing system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611218211.8A CN106790560B (en) | 2016-12-26 | 2016-12-26 | Risk control method and device for electronic notice information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611218211.8A CN106790560B (en) | 2016-12-26 | 2016-12-26 | Risk control method and device for electronic notice information |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106790560A CN106790560A (en) | 2017-05-31 |
| CN106790560B true CN106790560B (en) | 2020-12-15 |
Family
ID=58926136
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611218211.8A Active CN106790560B (en) | 2016-12-26 | 2016-12-26 | Risk control method and device for electronic notice information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106790560B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1349176A (en) * | 2001-12-03 | 2002-05-15 | 上海交通大学 | Content safety monitoring system for outer bolletion board system |
| CN1349190A (en) * | 2001-12-03 | 2002-05-15 | 上海交通大学 | Central network medium safety monitoring system |
| CN1350241A (en) * | 2001-12-03 | 2002-05-22 | 上海交通大学 | Network chatting room content safety monitoring system |
| US6778982B1 (en) * | 1999-05-11 | 2004-08-17 | Maquis Techtrix, Llc | Online content provider system and method |
| CN104615777A (en) * | 2015-02-27 | 2015-05-13 | 浪潮集团有限公司 | Method and device for real-time data processing based on stream-oriented calculation engine |
| CN105630994A (en) * | 2015-12-25 | 2016-06-01 | 浪潮电子信息产业股份有限公司 | Data processing method, device and system based on storm |
| CN105844475A (en) * | 2016-03-17 | 2016-08-10 | 流量海科技成都有限公司 | Risk control method and risk control apparatus |
-
2016
- 2016-12-26 CN CN201611218211.8A patent/CN106790560B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6778982B1 (en) * | 1999-05-11 | 2004-08-17 | Maquis Techtrix, Llc | Online content provider system and method |
| CN1349176A (en) * | 2001-12-03 | 2002-05-15 | 上海交通大学 | Content safety monitoring system for outer bolletion board system |
| CN1349190A (en) * | 2001-12-03 | 2002-05-15 | 上海交通大学 | Central network medium safety monitoring system |
| CN1350241A (en) * | 2001-12-03 | 2002-05-22 | 上海交通大学 | Network chatting room content safety monitoring system |
| CN104615777A (en) * | 2015-02-27 | 2015-05-13 | 浪潮集团有限公司 | Method and device for real-time data processing based on stream-oriented calculation engine |
| CN105630994A (en) * | 2015-12-25 | 2016-06-01 | 浪潮电子信息产业股份有限公司 | Data processing method, device and system based on storm |
| CN105844475A (en) * | 2016-03-17 | 2016-08-10 | 流量海科技成都有限公司 | Risk control method and risk control apparatus |
Non-Patent Citations (1)
| Title |
|---|
| "基于Twitter Storm的云平台监控系统研究与实现";李浩;《中国优秀硕士学位论文全文数据库信息科技辑》;20150414;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106790560A (en) | 2017-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106202086B (en) | Picture processing and obtaining method, device and system | |
| CN104219653A (en) | Method and device for controlling double-card Internet access | |
| US20160342650A1 (en) | Intelligent caching for enterprise resource planning reporting | |
| WO2015158304A1 (en) | Data processing method and apparatus | |
| CN104702782A (en) | Short message management method and mobile terminal thereof | |
| CN112083988A (en) | Screen refresh rate control method, mobile terminal and computer readable storage medium | |
| CN113435989A (en) | Financial data processing method and device | |
| US10025641B2 (en) | Workload differentiation for processor frequency scaling | |
| CN113938551B (en) | Caching method and device, electronic equipment and storage medium | |
| CN106790560B (en) | Risk control method and device for electronic notice information | |
| CN111163078A (en) | Network link interception method, device, equipment and medium | |
| CN117040799A (en) | Page interception rule generation and page access control method and device and electronic equipment | |
| CN104599218B (en) | Method and device for determining order reception range | |
| CN107729136B (en) | Processing priority configuration method and device based on FPGA | |
| CN113364915A (en) | Information display method and device and electronic equipment | |
| CN106790428B (en) | Data transmission method and device | |
| CN111598137A (en) | Method and device for providing reasoning service and electronic equipment | |
| CN113392238A (en) | Media file processing method and device, computer readable medium and electronic equipment | |
| CN115840604B (en) | Data processing method, device, electronic equipment and computer readable storage medium | |
| CN113473179B (en) | Video processing method, device, electronic equipment and medium | |
| CN104158810A (en) | Multimedia communication method based on mobile Internet | |
| CN113162982B (en) | Buried point information reporting method and device and electronic equipment | |
| US10791456B2 (en) | Method and apparatus for managing communications with multiple identification profiles | |
| CN117056152B (en) | Equipment detection method and related device | |
| CN116340930B (en) | Method, device, equipment and medium for confirming system change |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |