CN111985545A - Target data detection method, device, equipment and medium based on artificial intelligence - Google Patents
Target data detection method, device, equipment and medium based on artificial intelligence Download PDFInfo
- Publication number
- CN111985545A CN111985545A CN202010797375.0A CN202010797375A CN111985545A CN 111985545 A CN111985545 A CN 111985545A CN 202010797375 A CN202010797375 A CN 202010797375A CN 111985545 A CN111985545 A CN 111985545A
- Authority
- CN
- China
- Prior art keywords
- data
- target
- sub
- detected
- detection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 184
- 238000013473 artificial intelligence Methods 0.000 title claims abstract description 47
- 238000012706 support-vector machine Methods 0.000 claims abstract description 52
- 238000010845 search algorithm Methods 0.000 claims abstract description 31
- 238000012549 training Methods 0.000 claims description 41
- 238000000034 method Methods 0.000 claims description 22
- 230000006870 function Effects 0.000 claims description 15
- 238000012795 verification Methods 0.000 claims description 15
- 239000003016 pheromone Substances 0.000 claims description 12
- 238000012545 processing Methods 0.000 claims description 11
- 238000004364 calculation method Methods 0.000 claims description 6
- 238000010276 construction Methods 0.000 claims description 5
- 230000010354 integration Effects 0.000 claims description 5
- 230000004044 response Effects 0.000 claims description 5
- 238000005457 optimization Methods 0.000 claims description 4
- 238000012216 screening Methods 0.000 abstract description 11
- 238000005516 engineering process Methods 0.000 abstract description 2
- 238000004590 computer program Methods 0.000 description 11
- 230000000694 effects Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 5
- 238000007726 management method Methods 0.000 description 5
- 238000007689 inspection Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000001960 triggered effect Effects 0.000 description 4
- 239000003795 chemical substances by application Substances 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000008685 targeting Effects 0.000 description 1
- 238000010200 validation analysis Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
- G06F18/2411—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on the proximity to a decision surface, e.g. support vector machines
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/018—Certifying business or products
- G06Q30/0185—Product, service or business identity fraud
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/08—Insurance
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
- Y02T10/00—Road transport of goods or passengers
- Y02T10/10—Internal combustion engine [ICE] based vehicles
- Y02T10/40—Engine management systems
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- Finance (AREA)
- Accounting & Taxation (AREA)
- Bioinformatics & Computational Biology (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Evolutionary Biology (AREA)
- Development Economics (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Business, Economics & Management (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Economics (AREA)
- Evolutionary Computation (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- Entrepreneurship & Innovation (AREA)
- Technology Law (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to artificial intelligence, and provides a target data detection method, a device, equipment and a medium based on artificial intelligence, which can select data from to-be-detected data according to a target label to construct a target data set, select data corresponding to sub-labels from the to-be-detected data to construct a sub-data set, calculate the intersection of the target data set and the sub-data set to obtain a sub-intersection, train a single-class support vector machine model by the sub-intersection in combination with a global search algorithm to obtain a detection model, input the to-be-detected data to the detection model, output a detection result, integrate the data with the detection result as a target as the target data, and further can automatically detect and screen the target data in an artificial intelligence manner, so that the problems of low screening efficiency, high error rate and poor reliability are solved. The invention also relates to a block chain technology, and the detection model and the target data can be stored in the block chain.
Description
Technical Field
The invention relates to the technical field of artificial intelligence, in particular to a target data detection method, a target data detection device, target data detection equipment and a target data detection medium based on artificial intelligence.
Background
At present, with the rapid development of the insurance industry, the team of agents is getting stronger, and some agents have the situation of making or refreshing data instead (for example, making questions by using equipment of others) so as to generate a large amount of false data, which can cause larger data noise, reduce data quality, and further influence the usability of data due to lower authenticity, so that how to quickly and accurately detect target data becomes an urgent problem to be solved.
In view of the above, a commonly adopted solution in the industry is to perform data screening according to preset rules, such as: and manually setting a screening principle, retaining data conforming to the principle, and deleting data not conforming to the principle. The method only depends on artificially defined rules to carry out data statistics, so that the screening efficiency is low, errors are easy to occur, and the reliability of the final detection result is poor.
When a machine is used for automatically screening target data, due to the fact that training samples are difficult to obtain and the parameters of a traditional support vector machine model are difficult to determine, the performance of the model is poor, and the globality and the robustness of the model are both to be improved.
Disclosure of Invention
In view of the above, it is desirable to provide a method, an apparatus, a device and a medium for detecting target data based on artificial intelligence, which can automatically detect and screen target data in an artificial intelligence manner, and solve the problems of low screening efficiency, high error rate and poor reliability.
An artificial intelligence based target data detection method, comprising:
determining a target tag in response to the received target data detection instruction;
acquiring data to be detected corresponding to a user to be detected;
selecting data from the data to be detected according to the target label to construct a target data set;
acquiring at least one predefined sub-tag, and selecting data corresponding to each sub-tag from the data to be detected to construct at least one sub-data set corresponding to each sub-tag;
calculating the intersection of the target data set and the at least one subdata set to obtain at least one sub-intersection;
combining a global search algorithm, training a single-class support vector machine model by the at least one sub-intersection to obtain a detection model;
inputting the data to be detected into the detection model, and outputting a detection result, wherein the detection result comprises a target and a non-target;
and integrating the data with the detection result as the target data.
According to a preferred embodiment of the present invention, the determining the target label includes one or more of the following ways:
analyzing the method body of the target data detection instruction to obtain data carried by the target data detection instruction, acquiring a preset label, matching the preset label in the data carried by the target data detection instruction, and determining the matched data as the target label; or
Acquiring historical target data, identifying keywords of the historical target data as first keywords, calculating the occurrence frequency of the first keywords, and acquiring the first keywords with the highest occurrence frequency as the target tags.
According to a preferred embodiment of the present invention, the selecting data from the data to be detected according to the target tag to construct a target data set includes:
identifying a keyword of each data in the data to be detected as a second keyword;
dividing the data with the same second keywords in the data to be detected into a class, and naming each class by the same second keywords;
configuring the weight of each category in the corresponding data;
determining the category with the weight greater than or equal to the configuration weight as a target category of the corresponding data;
defining a label of corresponding data by the target category;
and matching the target label in the defined labels, and acquiring data corresponding to the label matched with the target label to construct the target data set.
According to a preferred embodiment of the present invention, the training of the single-class support vector machine model with the at least one sub-intersection in combination with the global search algorithm to obtain the detection model includes:
integrating data in the at least one sub-intersection to obtain a training sample;
determining a kernel function of a single-type support vector machine model, and determining initial parameters of the kernel function;
optimizing the initial parameters by adopting the global search algorithm to obtain an optimized single-type support vector machine model;
and training the optimized single-type support vector machine model by using the training sample to obtain the detection model.
According to the preferred embodiment of the present invention, the optimizing the initial parameters by using the global search algorithm to obtain the optimized single-class support vector machine model includes:
determining the highest iteration times and the search step length of the global search algorithm;
taking the initial parameter as an initial position, performing iterative search on the pheromone by the search step length until the maximum iteration times is reached, and stopping the search to obtain the current pheromone;
and replacing the initial parameters with the optimized parameters at the positions corresponding to the current pheromones to obtain the optimized single-type support vector machine model.
According to the preferred embodiment of the present invention, the target data detection method based on artificial intelligence further comprises:
randomly acquiring data from the target data set to construct a verification set;
inputting the data in the verification set into the detection model, and outputting a first detection result;
acquiring data with the first detection result as a target, and calculating the proportion of the acquired data in the verification set;
when the proportion is larger than or equal to the configuration proportion, determining that the detection model passes verification, and storing the detection model to a block chain; or
And when the proportion is smaller than the configuration proportion, determining that the detection model is not verified, updating the at least one sub tag, updating the at least one sub data set according to the updated at least one sub tag, and performing optimization training on the detection model by using the updated at least one sub data set.
According to a preferred embodiment of the present invention, after integrating the data of which the detection result is the target as the target data, the target data detection method based on artificial intelligence further includes:
calculating the proportion of the target data in the data to be detected;
when the ratio is lower than a configuration ratio, generating warning information according to the ratio;
determining the associated user of the user to be detected;
and sending the warning information to the terminal equipment of the user to be detected and the terminal equipment of the associated user.
An artificial intelligence based target data detection apparatus, the artificial intelligence based target data detection apparatus comprising:
the determining unit is used for responding to the received target data detection instruction and determining a target label;
the device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring data to be detected corresponding to a user to be detected;
the construction unit is used for selecting data from the data to be detected according to the target label to construct a target data set;
the constructing unit is further configured to obtain at least one predefined sub-tag, and select data corresponding to each sub-tag from the data to be detected to construct at least one sub-data set corresponding to each sub-tag;
a calculation unit, configured to calculate an intersection between the target data set and the at least one sub data set to obtain at least one sub intersection;
the training unit is used for training the single-class support vector machine model by combining a global search algorithm through the at least one sub-intersection to obtain a detection model;
the input unit is used for inputting the data to be detected into the detection model and outputting a detection result, wherein the detection result comprises a target and a non-target;
and the integration unit is used for integrating the data of which the detection result is the target as the target data.
An electronic device, the electronic device comprising:
a memory storing at least one instruction; and
a processor executing instructions stored in the memory to implement the artificial intelligence based target data detection method.
A computer-readable storage medium having stored therein at least one instruction for execution by a processor in an electronic device to implement the artificial intelligence based target data detection method.
According to the technical scheme, the method can respond to a received target data detection instruction, determine a target tag, acquire to-be-detected data corresponding to a to-be-detected user, select data from the to-be-detected data according to the target tag to construct a target data set, acquire at least one predefined sub tag, select data corresponding to each sub tag from the to-be-detected data to construct at least one sub data set corresponding to each sub tag, calculate an intersection of the target data set and the at least one sub data set to obtain at least one sub intersection, train a single-class support vector machine model by combining a global search algorithm with the at least one sub intersection to obtain a detection model, input the to-be-detected data into the detection model, and output a detection result, wherein the detection result comprises a target and a non-target, the data with the detection result as the target is integrated to serve as the target data, so that the target data can be automatically detected and screened in an artificial intelligent mode, and the problems of low screening efficiency, high error rate and poor reliability are solved.
Drawings
FIG. 1 is a flow chart of a preferred embodiment of the target data detection method based on artificial intelligence of the present invention.
FIG. 2 is a functional block diagram of a preferred embodiment of the target data detection apparatus based on artificial intelligence according to the present invention.
Fig. 3 is a schematic structural diagram of an electronic device according to a preferred embodiment of the present invention for implementing an artificial intelligence-based target data detection method.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in detail with reference to the accompanying drawings and specific embodiments.
FIG. 1 is a flow chart of a preferred embodiment of the target data detection method based on artificial intelligence according to the present invention. The order of the steps in the flow chart may be changed and some steps may be omitted according to different needs.
The target data detection method based on artificial intelligence is applied to one or more electronic devices, which are devices capable of automatically performing numerical calculation and/or information processing according to preset or stored instructions, and the hardware of the electronic devices includes, but is not limited to, a microprocessor, an Application Specific Integrated Circuit (ASIC), a Programmable Gate Array (FPGA), a Digital Signal Processor (DSP), an embedded device, and the like.
The electronic device may be any electronic product capable of performing human-computer interaction with a user, for example, a Personal computer, a tablet computer, a smart phone, a Personal Digital Assistant (PDA), a game machine, an interactive Internet Protocol Television (IPTV), an intelligent wearable device, and the like.
The electronic device may also include a network device and/or a user device. The network device includes, but is not limited to, a single network server, a server group consisting of a plurality of network servers, or a Cloud Computing (Cloud Computing) based Cloud consisting of a large number of hosts or network servers.
The Network where the electronic device is located includes, but is not limited to, the internet, a wide area Network, a metropolitan area Network, a local area Network, a Virtual Private Network (VPN), and the like.
S10, determining a target tag in response to the received target data detection instruction.
In at least one embodiment of the invention, the target data detection instruction may be triggered by a designated person to be executed according to actual needs.
Of course, the target data detection instruction may also be configured to be triggered periodically, so as to filter the target data periodically, and avoid that when other related service scenarios execute a task by using data, the execution effect of the task is affected due to noise generated by non-target data.
In this embodiment, when a piece of data carries the target tag, the piece of data can be determined as target data. For example: the target tag may be: and executing the operation of importing the address book and the like.
In at least one embodiment of the present invention, the determining the target label includes, but is not limited to, one or more of the following combinations:
analyzing the method body of the target data detection instruction to obtain data carried by the target data detection instruction, acquiring a preset label, matching the preset label in the data carried by the target data detection instruction, and determining the matched data as the target label; or
Through the embodiment, when the target data detection instruction carries the target label, the target label can be directly extracted by using a preset label, so that the data processing time is saved, and the accuracy of the target label is ensured.
Acquiring historical target data, identifying keywords of the historical target data as first keywords, calculating the occurrence frequency of the first keywords, and acquiring the first keywords with the highest occurrence frequency as the target tags.
Through the implementation manner, when the target data detection instruction does not carry the target tag, the target tag can be determined through historical target data.
Of course, in other embodiments, the target tag may be determined in other manners, and the present invention is not limited thereto.
For example: and receiving the label uploaded by the user as the target label.
And S11, acquiring the data to be detected corresponding to the user to be detected.
In this embodiment, the account of the user to be detected is acquired, all data corresponding to the account is acquired, and the acquired data is determined as the data to be detected.
It can be understood that the data corresponding to the account is not necessarily data generated by the user to be detected, and if there is another person logging in the account of the user to be detected to perform an operation, the generated data is not actual data of the user to be detected, and may be regarded as data to be refreshed or replaced, that is, non-target data, and the actual data of the user to be detected is target data.
And S12, selecting data from the data to be detected according to the target label to construct a target data set.
In this embodiment, since all the data in the target data set have the target tag, all the data in the target data set are target data.
In at least one embodiment of the present invention, the selecting data from the data to be detected according to the target tag to construct a target data set includes:
identifying a keyword of each data in the data to be detected as a second keyword;
dividing the data with the same second keywords in the data to be detected into a class, and naming each class by the same second keywords;
configuring the weight of each category in the corresponding data;
determining the category with the weight greater than or equal to the configuration weight as a target category of the corresponding data;
defining a label of corresponding data by the target category;
and matching the target label in the defined labels, and acquiring data corresponding to the label matched with the target label to construct the target data set.
The configuration weight can be configured by self-definition according to actual requirements, and the invention is not limited.
After naming each category by the same keyword, each category needs to be given a certain weight to distinguish the importance degrees of different categories, and specifically, various data indexes can be considered comprehensively when determining the weight, such as: number of interviews, number of interview attractions, etc.
S13, obtaining at least one predefined sub-label, and selecting the data corresponding to each sub-label from the data to be detected to construct at least one sub-data set corresponding to each sub-label.
Wherein the at least one sub-tag belongs to an extension to the target tag.
For example: the at least one sub-tag may include, but is not limited to: an AI interview is performed and attendance records are recorded.
It should be noted that the manner of constructing at least one sub data set corresponding to each sub tag is similar to the manner of constructing the target data set, and is not described herein again.
S14, calculating the intersection of the target data set and the at least one sub data set to obtain at least one sub intersection.
It should be noted that the data with the at least one sub-tag and the target tag may be determined as the target data.
Further, the data in the at least one sub-intersection obtained after performing intersection processing belongs to target data, and other data may be labeled and extracted with the data in the at least one sub-intersection to detect the target data.
Through the embodiment, the data expansion can be further performed on the basis of the target data set, so that sufficient data can be acquired to train the model, and the effect of model training is improved.
And S15, combining a global search algorithm, and training a single-Class Support Vector Machine (One-Class SVM) model by using the at least One sub-intersection to obtain a detection model.
It should be noted that in an actual application scenario, only positive examples, but not negative examples, can be defined many times. For example: when it is predicted whether the user has children or not through the search records of the user, it cannot be said that the user does not search words such as "baby" and "early education", and it is not absolute that the user does not have children. A single type of support vector machine model can be adapted to the scene.
In at least one embodiment of the present invention, the training, in combination with the global search algorithm, the single-class support vector machine model with the at least one sub-intersection to obtain the detection model includes:
integrating data in the at least one sub-intersection to obtain a training sample;
determining a kernel function of a single-type support vector machine model, and determining initial parameters of the kernel function;
optimizing the initial parameters by adopting the global search algorithm to obtain an optimized single-type support vector machine model;
and training the optimized single-type support vector machine model by using the training sample to obtain the detection model.
Through the implementation mode, the training sample can be constructed based on the pre-labeled sub-intersection, and the single-type support vector machine model is further trained by the training sample, so that the target of the data to be detected can be intelligently detected by using the detection model obtained through training in the following process.
In addition, under the general condition, the parameters of the single-type support vector machine model are difficult to determine, and the parameters of the single-type support vector machine model are optimized and determined by adopting a global search algorithm, so that the global property and the robustness of the single-type support vector machine model are improved.
Specifically, the optimizing the initial parameter by using a global search algorithm to obtain an optimized single-class support vector machine model includes:
determining the highest iteration times and the search step length of the global search algorithm;
taking the initial parameter as an initial position, performing iterative search on the pheromone by the search step length until the maximum iteration times is reached, and stopping the search to obtain the current pheromone;
and replacing the initial parameters with the optimized parameters at the positions corresponding to the current pheromones to obtain the optimized single-type support vector machine model.
Through the implementation mode, the parameters of the single-type support vector machine model can be automatically determined through a global search algorithm, so that the performance of the single-type support vector machine model is improved, and the problem that the parameters of the single-type support vector machine model are difficult to determine is solved.
In at least one embodiment of the present invention, the artificial intelligence based target data detection method further comprises:
randomly acquiring data from the target data set to construct a verification set;
inputting the data in the verification set into the detection model, and outputting a first detection result;
acquiring data with the first detection result as a target, and calculating the proportion of the acquired data in the verification set;
when the proportion is larger than or equal to the configuration proportion, determining that the detection model passes verification, and storing the detection model to a block chain; or
The configuration proportion can be self-defined according to actual requirements, and the invention is not limited.
With the above embodiment, the inspection model can be verified with a small amount of target data to ensure the usability of the inspection model.
Meanwhile, the detection model is stored in a block chain, so that the safety of the detection model is further ensured.
And when the proportion is smaller than the configuration proportion, determining that the detection model is not verified, updating the at least one sub tag, updating the at least one sub data set according to the updated at least one sub tag, and performing optimization training on the detection model by using the updated at least one sub data set.
Through the embodiment, when the detection model fails to be verified, the corresponding label is adjusted in time to optimize and train the detection model so as to enhance the adaptability of the detection model and improve the flexibility of the detection model.
And S16, inputting the data to be detected into the detection model, and outputting a detection result, wherein the detection result comprises a target and a non-target.
Specifically, when the detection result is a first identifier (such as 1 or Y), determining that the detection result is a target; or when the detection result is a second identifier (such as 0 or N), determining that the detection result is a non-target.
Through the embodiment, the target data can be automatically detected and screened in an artificial intelligent mode, and the problems of low screening efficiency, high error rate and poor reliability caused by data statistics depending on artificially defined rules in the prior art are solved.
And S17, integrating the data of which the detection result is the target as the target data.
Through above-mentioned embodiment, can combine the artificial intelligence means automatic follow wait to detect and select out all target data in the data, compare in traditional mode more high-efficient, and be difficult for makeing mistakes, the practicality is stronger.
Note that, in order to prevent data from being tampered, the target data may also be saved to the blockchain.
In at least one embodiment of the present invention, after integrating the data of which the detection result is the target as the target data, the target data detection method based on artificial intelligence further includes:
calculating the proportion of the target data in the data to be detected;
when the ratio is lower than a configuration ratio, generating warning information according to the ratio;
determining the associated user of the user to be detected;
and sending the warning information to the terminal equipment of the user to be detected and the terminal equipment of the associated user.
The warning information is used for warning that the non-target data currently generated by the user to be detected is excessive.
The configuration ratio can be self-defined according to actual requirements, and the invention is not limited.
Wherein the associated user may include, but is not limited to: and the superior leader and attendance manager of the user to be detected.
Through the embodiment, the warning information is sent to the terminal equipment of the user to be detected, the warning effect of the user to be detected can be played, the phenomenon of violation can be avoided appearing again, meanwhile, the warning information is sent to the terminal equipment of the associated user, attention of related personnel can be aroused, the problem is timely handled when the problem occurs, the problem is prevented from being enlarged, and the effect of timely stopping damage is played.
According to the technical scheme, the method can respond to a received target data detection instruction, determine a target tag, acquire to-be-detected data corresponding to a to-be-detected user, select data from the to-be-detected data according to the target tag to construct a target data set, acquire at least one predefined sub tag, select data corresponding to each sub tag from the to-be-detected data to construct at least one sub data set corresponding to each sub tag, calculate an intersection of the target data set and the at least one sub data set to obtain at least one sub intersection, train a single-class support vector machine model by combining a global search algorithm with the at least one sub intersection to obtain a detection model, input the to-be-detected data into the detection model, and output a detection result, wherein the detection result comprises a target and a non-target, the data with the detection result as the target is integrated to serve as the target data, so that the target data can be automatically detected and screened in an artificial intelligent mode, and the problems of low screening efficiency, high error rate and poor reliability are solved.
FIG. 2 is a functional block diagram of a preferred embodiment of the target data detection apparatus based on artificial intelligence according to the present invention. The artificial intelligence-based target data detection device 11 comprises a determination unit 110, an acquisition unit 111, a construction unit 112, a calculation unit 113, a training unit 114, an input unit 115 and an integration unit 116. The module/unit referred to in the present invention refers to a series of computer program segments that can be executed by the processor 13 and that can perform a fixed function, and that are stored in the memory 12. In the present embodiment, the functions of the modules/units will be described in detail in the following embodiments.
The determination unit 110 determines a target tag in response to the received target data detection instruction.
In at least one embodiment of the invention, the target data detection instruction may be triggered by a designated person to be executed according to actual needs.
Of course, the target data detection instruction may also be configured to be triggered periodically, so as to filter the target data periodically, and avoid that when other related service scenarios execute a task by using data, the execution effect of the task is affected due to noise generated by non-target data.
In this embodiment, when a piece of data carries the target tag, the piece of data can be determined as target data. For example: the target tag may be: and executing the operation of importing the address book and the like.
In at least one embodiment of the present invention, the determining unit 110 determines the target tag includes, but is not limited to, one or more of the following combinations:
analyzing the method body of the target data detection instruction, obtaining data carried by the target data detection instruction, obtaining a preset label, matching the preset label in the data carried by the target data detection instruction, and determining the matched data as the target label.
Through the embodiment, when the target data detection instruction carries the target label, the target label can be directly extracted by using a preset label, so that the data processing time is saved, and the accuracy of the target label is ensured.
Or acquiring historical target data, identifying keywords of the historical target data as first keywords, calculating the occurrence frequency of the first keywords, and acquiring the first keywords with the highest occurrence frequency as the target tags.
Through the implementation manner, when the target data detection instruction does not carry the target tag, the target tag can be determined through historical target data.
Of course, in other embodiments, the target tag may be determined in other manners, and the present invention is not limited thereto.
For example: and receiving the label uploaded by the user as the target label.
The acquisition unit 111 acquires data to be detected corresponding to a user to be detected.
In this embodiment, the account of the user to be detected is acquired, all data corresponding to the account is acquired, and the acquired data is determined as the data to be detected.
It can be understood that the data corresponding to the account is not necessarily data generated by the user to be detected, and if there is another person logging in the account of the user to be detected to perform an operation, the generated data is not actual data of the user to be detected, and may be regarded as data to be refreshed or replaced, that is, non-target data, and the actual data of the user to be detected is target data.
The construction unit 112 selects data from the data to be detected according to the target label to construct a target data set.
In this embodiment, since all the data in the target data set have the target tag, all the data in the target data set are target data.
In at least one embodiment of the present invention, the constructing unit 112 selecting data from the data to be detected according to the object tag to construct an object data set includes:
identifying a keyword of each data in the data to be detected as a second keyword;
dividing the data with the same second keywords in the data to be detected into a class, and naming each class by the same second keywords;
configuring the weight of each category in the corresponding data;
determining the category with the weight greater than or equal to the configuration weight as a target category of the corresponding data;
defining a label of corresponding data by the target category;
and matching the target label in the defined labels, and acquiring data corresponding to the label matched with the target label to construct the target data set.
The configuration weight can be configured by self-definition according to actual requirements, and the invention is not limited.
After naming each category by the same keyword, each category needs to be given a certain weight to distinguish the importance degrees of different categories, and specifically, various data indexes can be considered comprehensively when determining the weight, such as: number of interviews, number of interview attractions, etc.
The constructing unit 112 obtains at least one predefined sub-tag, and selects data corresponding to each sub-tag from the data to be detected to construct at least one sub-data set corresponding to each sub-tag.
Wherein the at least one sub-tag belongs to an extension to the target tag.
For example: the at least one sub-tag may include, but is not limited to: an AI interview is performed and attendance records are recorded.
It should be noted that the manner of constructing at least one sub data set corresponding to each sub tag is similar to the manner of constructing the target data set, and is not described herein again.
The calculation unit 113 calculates an intersection of the target data set and the at least one sub data set to obtain at least one sub intersection.
It should be noted that the data with the at least one sub-tag and the target tag may be determined as the target data.
Further, the data in the at least one sub-intersection obtained after performing intersection processing belongs to target data, and other data may be labeled and extracted with the data in the at least one sub-intersection to detect the target data.
Through the embodiment, the data expansion can be further performed on the basis of the target data set, so that sufficient data can be acquired to train the model, and the effect of model training is improved.
The training unit 114 trains a single-Class Support Vector Machine (One-Class SVM) model by the at least One sub-intersection in combination with a global search algorithm to obtain a detection model.
It should be noted that in an actual application scenario, only positive examples, but not negative examples, can be defined many times. For example: when it is predicted whether the user has children or not through the search records of the user, it cannot be said that the user does not search words such as "baby" and "early education", and it is not absolute that the user does not have children. A single type of support vector machine model can be adapted to the scene.
In at least one embodiment of the present invention, the training unit 114, in combination with a global search algorithm, trains the single-class support vector machine model with the at least one sub-intersection, and obtaining the detection model includes:
integrating data in the at least one sub-intersection to obtain a training sample;
determining a kernel function of a single-type support vector machine model, and determining initial parameters of the kernel function;
optimizing the initial parameters by adopting the global search algorithm to obtain an optimized single-type support vector machine model;
and training the optimized single-type support vector machine model by using the training sample to obtain the detection model.
Through the implementation mode, the training sample can be constructed based on the pre-labeled sub-intersection, and the single-type support vector machine model is further trained by the training sample, so that the target of the data to be detected can be intelligently detected by using the detection model obtained through training in the following process.
In addition, under the general condition, the parameters of the single-type support vector machine model are difficult to determine, and the parameters of the single-type support vector machine model are optimized and determined by adopting a global search algorithm, so that the global property and the robustness of the single-type support vector machine model are improved.
Specifically, the training unit 114 optimizes the initial parameters by using a global search algorithm to obtain an optimized single-class support vector machine model, including:
determining the highest iteration times and the search step length of the global search algorithm;
taking the initial parameter as an initial position, performing iterative search on the pheromone by the search step length until the maximum iteration times is reached, and stopping the search to obtain the current pheromone;
and replacing the initial parameters with the optimized parameters at the positions corresponding to the current pheromones to obtain the optimized single-type support vector machine model.
Through the implementation mode, the parameters of the single-type support vector machine model can be automatically determined through a global search algorithm, so that the performance of the single-type support vector machine model is improved, and the problem that the parameters of the single-type support vector machine model are difficult to determine is solved.
In at least one embodiment of the invention, a validation set is constructed by randomly obtaining data from the target data set;
inputting the data in the verification set into the detection model, and outputting a first detection result;
acquiring data with the first detection result as a target, and calculating the proportion of the acquired data in the verification set;
further, when the ratio is larger than or equal to the configuration ratio, the detection model is determined to pass the verification, and the detection model is saved to the block chain.
The configuration proportion can be self-defined according to actual requirements, and the invention is not limited.
With the above embodiment, the inspection model can be verified with a small amount of target data to ensure the usability of the inspection model.
Meanwhile, the detection model is stored in a block chain, so that the safety of the detection model is further ensured.
Or when the proportion is smaller than the configuration proportion, determining that the detection model is not verified, updating the at least one sub tag, and updating the at least one sub data set according to the updated at least one sub tag, so as to perform optimization training on the detection model by using the updated at least one sub data set.
Through the embodiment, when the detection model fails to be verified, the corresponding label is adjusted in time to optimize and train the detection model so as to enhance the adaptability of the detection model and improve the flexibility of the detection model.
The input unit 115 inputs the data to be detected to the detection model, and outputs a detection result, where the detection result includes a target and a non-target.
Specifically, when the detection result is a first identifier (such as 1 or Y), determining that the detection result is a target; or when the detection result is a second identifier (such as 0 or N), determining that the detection result is a non-target.
Through the embodiment, the target data can be automatically detected and screened in an artificial intelligent mode, and the problems of low screening efficiency, high error rate and poor reliability caused by data statistics depending on artificially defined rules in the prior art are solved.
The integration unit 116 integrates data targeted by the detection result as the target data.
Through above-mentioned embodiment, can combine the artificial intelligence means automatic follow wait to detect and select out all target data in the data, compare in traditional mode more high-efficient, and be difficult for makeing mistakes, the practicality is stronger.
Note that, in order to prevent data from being tampered, the target data may also be saved to the blockchain.
In at least one embodiment of the present invention, after integrating the data of which the detection result is a target as the target data, calculating a ratio of the target data in the data to be detected;
when the ratio is lower than a configuration ratio, generating warning information according to the ratio;
determining the associated user of the user to be detected;
and sending the warning information to the terminal equipment of the user to be detected and the terminal equipment of the associated user.
The warning information is used for warning that the non-target data currently generated by the user to be detected is excessive.
The configuration ratio can be self-defined according to actual requirements, and the invention is not limited.
Wherein the associated user may include, but is not limited to: and the superior leader and attendance manager of the user to be detected.
Through the embodiment, the warning information is sent to the terminal equipment of the user to be detected, the warning effect of the user to be detected can be played, the phenomenon of violation can be avoided appearing again, meanwhile, the warning information is sent to the terminal equipment of the associated user, attention of related personnel can be aroused, the problem is timely handled when the problem occurs, the problem is prevented from being enlarged, and the effect of timely stopping damage is played.
According to the technical scheme, the method can respond to a received target data detection instruction, determine a target tag, acquire to-be-detected data corresponding to a to-be-detected user, select data from the to-be-detected data according to the target tag to construct a target data set, acquire at least one predefined sub tag, select data corresponding to each sub tag from the to-be-detected data to construct at least one sub data set corresponding to each sub tag, calculate an intersection of the target data set and the at least one sub data set to obtain at least one sub intersection, train a single-class support vector machine model by combining a global search algorithm with the at least one sub intersection to obtain a detection model, input the to-be-detected data into the detection model, and output a detection result, wherein the detection result comprises a target and a non-target, the data with the detection result as the target is integrated to serve as the target data, so that the target data can be automatically detected and screened in an artificial intelligent mode, and the problems of low screening efficiency, high error rate and poor reliability are solved.
Fig. 3 is a schematic structural diagram of an electronic device according to a preferred embodiment of the present invention, which implements a target data detection method based on artificial intelligence.
The electronic device 1 may comprise a memory 12, a processor 13 and a bus, and may further comprise a computer program, such as an artificial intelligence based object data detection program, stored in the memory 12 and executable on the processor 13.
It will be understood by those skilled in the art that the schematic diagram is merely an example of the electronic device 1, and does not constitute a limitation to the electronic device 1, the electronic device 1 may have a bus-type structure or a star-type structure, the electronic device 1 may further include more or less hardware or software than those shown in the figures, or different component arrangements, for example, the electronic device 1 may further include an input and output device, a network access device, and the like.
It should be noted that the electronic device 1 is only an example, and other existing or future electronic products, such as those that can be adapted to the present invention, should also be included in the scope of the present invention, and are included herein by reference.
The memory 12 includes at least one type of readable storage medium, which includes flash memory, removable hard disks, multimedia cards, card-type memory (e.g., SD or DX memory, etc.), magnetic memory, magnetic disks, optical disks, etc. The memory 12 may in some embodiments be an internal storage unit of the electronic device 1, for example a removable hard disk of the electronic device 1. The memory 12 may also be an external storage device of the electronic device 1 in other embodiments, such as a plug-in mobile hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like provided on the electronic device 1. Further, the memory 12 may also include both an internal storage unit and an external storage device of the electronic device 1. The memory 12 may be used not only to store application software installed in the electronic device 1 and various types of data, such as codes of an object data detection program based on artificial intelligence, etc., but also to temporarily store data that has been output or is to be output.
The processor 13 may be composed of an integrated circuit in some embodiments, for example, a single packaged integrated circuit, or may be composed of a plurality of integrated circuits packaged with the same or different functions, including one or more Central Processing Units (CPUs), microprocessors, digital Processing chips, graphics processors, and combinations of various control chips. The processor 13 is a Control Unit (Control Unit) of the electronic device 1, connects various components of the electronic device 1 by using various interfaces and lines, and executes various functions and processes data of the electronic device 1 by running or executing programs or modules (for example, executing an artificial intelligence-based target data detection program and the like) stored in the memory 12 and calling data stored in the memory 12.
The processor 13 executes an operating system of the electronic device 1 and various installed application programs. The processor 13 executes the application program to implement the steps in each of the artificial intelligence based target data detection method embodiments described above, such as the steps shown in fig. 1.
Illustratively, the computer program may be divided into one or more modules/units, which are stored in the memory 12 and executed by the processor 13 to accomplish the present invention. The one or more modules/units may be a series of computer program instruction segments capable of performing specific functions, which are used to describe the execution process of the computer program in the electronic device 1. For example, the computer program may be divided into a determination unit 110, an acquisition unit 111, a construction unit 112, a calculation unit 113, a training unit 114, an input unit 115, an integration unit 116.
The integrated unit implemented in the form of a software functional module may be stored in a computer-readable storage medium. The software functional module is stored in a storage medium and includes several instructions to enable a computer device (which may be a personal computer, a computer device, or a network device) or a processor (processor) to execute the portions of the artificial intelligence based target data detection method according to the embodiments of the present invention.
The integrated modules/units of the electronic device 1 may be stored in a computer-readable storage medium if they are implemented in the form of software functional units and sold or used as separate products. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented.
Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying said computer program code, recording medium, U-disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM).
Further, the computer-usable storage medium may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function, and the like; the storage data area may store data created according to the use of the blockchain node, and the like.
The block chain is a novel application mode of computer technologies such as distributed data storage, point-to-point transmission, a consensus mechanism, an encryption algorithm and the like. A block chain (Blockchain), which is essentially a decentralized database, is a series of data blocks associated by using a cryptographic method, and each data block contains information of a batch of network transactions, and is used for verifying the information's targeting (anti-counterfeiting) and generating a next block. The blockchain may include a blockchain underlying platform, a platform product service layer, an application service layer, and the like.
The bus may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one arrow is shown in FIG. 3, but this does not indicate only one bus or one type of bus. The bus is arranged to enable connection communication between the memory 12 and at least one processor 13 or the like.
Although not shown, the electronic device 1 may further include a power supply (such as a battery) for supplying power to each component, and preferably, the power supply may be logically connected to the at least one processor 13 through a power management device, so as to implement functions of charge management, discharge management, power consumption management, and the like through the power management device. The power supply may also include any component of one or more dc or ac power sources, recharging devices, power failure detection circuitry, power converters or inverters, power status indicators, and the like. The electronic device 1 may further include various sensors, a bluetooth module, a Wi-Fi module, and the like, which are not described herein again.
Further, the electronic device 1 may further include a network interface, and optionally, the network interface may include a wired interface and/or a wireless interface (such as a WI-FI interface, a bluetooth interface, etc.), which are generally used for establishing a communication connection between the electronic device 1 and other electronic devices.
Optionally, the electronic device 1 may further comprise a user interface, which may be a Display (Display), an input unit (such as a Keyboard), and optionally a standard wired interface, a wireless interface. Alternatively, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch device, or the like. The display, which may also be referred to as a display screen or display unit, is suitable for displaying information processed in the electronic device 1 and for displaying a visualized user interface, among other things.
It is to be understood that the described embodiments are for purposes of illustration only and that the scope of the appended claims is not limited to such structures.
Fig. 3 only shows the electronic device 1 with components 12-13, and it will be understood by a person skilled in the art that the structure shown in fig. 3 does not constitute a limitation of the electronic device 1, and may comprise fewer or more components than shown, or a combination of certain components, or a different arrangement of components.
With reference to fig. 1, the memory 12 of the electronic device 1 stores a plurality of instructions to implement an artificial intelligence based target data detection method, and the processor 13 can execute the plurality of instructions to implement:
determining a target tag in response to the received target data detection instruction;
acquiring data to be detected corresponding to a user to be detected;
selecting data from the data to be detected according to the target label to construct a target data set;
acquiring at least one predefined sub-tag, and selecting data corresponding to each sub-tag from the data to be detected to construct at least one sub-data set corresponding to each sub-tag;
calculating the intersection of the target data set and the at least one subdata set to obtain at least one sub-intersection;
combining a global search algorithm, training a single-class support vector machine model by the at least one sub-intersection to obtain a detection model;
inputting the data to be detected into the detection model, and outputting a detection result, wherein the detection result comprises a target and a non-target;
and integrating the data with the detection result as the target data.
Specifically, the processor 13 may refer to the description of the relevant steps in the embodiment corresponding to fig. 1 for a specific implementation method of the instruction, which is not described herein again.
In the embodiments provided in the present invention, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is only one logical functional division, and other divisions may be realized in practice.
The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.
In addition, functional modules in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional module.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof.
The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference signs in the claims shall not be construed as limiting the claim concerned.
Furthermore, it is obvious that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. A plurality of units or means recited in the system claims may also be implemented by one unit or means in software or hardware. The terms second, etc. are used to denote names, but not any particular order.
Finally, it should be noted that the above embodiments are only for illustrating the technical solutions of the present invention and not for limiting, and although the present invention is described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications or equivalent substitutions may be made on the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention.
Claims (10)
1. An artificial intelligence based target data detection method, characterized in that the artificial intelligence based target data detection method comprises:
determining a target tag in response to the received target data detection instruction;
acquiring data to be detected corresponding to a user to be detected;
selecting data from the data to be detected according to the target label to construct a target data set;
acquiring at least one predefined sub-tag, and selecting data corresponding to each sub-tag from the data to be detected to construct at least one sub-data set corresponding to each sub-tag;
calculating the intersection of the target data set and the at least one subdata set to obtain at least one sub-intersection;
combining a global search algorithm, training a single-class support vector machine model by the at least one sub-intersection to obtain a detection model;
inputting the data to be detected into the detection model, and outputting a detection result, wherein the detection result comprises a target and a non-target;
and integrating the data with the detection result as the target data.
2. The artificial intelligence based object data detection method of claim 1, wherein the determining the object label comprises one or more of the following combinations:
analyzing the method body of the target data detection instruction to obtain data carried by the target data detection instruction, acquiring a preset label, matching the preset label in the data carried by the target data detection instruction, and determining the matched data as the target label; or
Acquiring historical target data, identifying keywords of the historical target data as first keywords, calculating the occurrence frequency of the first keywords, and acquiring the first keywords with the highest occurrence frequency as the target tags.
3. The artificial intelligence based target data detection method of claim 1, wherein the selecting data from the data to be detected according to the target tag to construct a target data set comprises:
identifying a keyword of each data in the data to be detected as a second keyword;
dividing the data with the same second keywords in the data to be detected into a class, and naming each class by the same second keywords;
configuring the weight of each category in the corresponding data;
determining the category with the weight greater than or equal to the configuration weight as a target category of the corresponding data;
defining a label of corresponding data by the target category;
and matching the target label in the defined labels, and acquiring data corresponding to the label matched with the target label to construct the target data set.
4. The artificial intelligence based target data detection method of claim 1, wherein the training of the single-class support vector machine model with the at least one sub-intersection in combination with the global search algorithm to obtain the detection model comprises:
integrating data in the at least one sub-intersection to obtain a training sample;
determining a kernel function of a single-type support vector machine model, and determining initial parameters of the kernel function;
optimizing the initial parameters by adopting the global search algorithm to obtain an optimized single-type support vector machine model;
and training the optimized single-type support vector machine model by using the training sample to obtain the detection model.
5. The artificial intelligence based target data detection method of claim 4, wherein the optimizing the initial parameters by using a global search algorithm to obtain an optimized one-class support vector machine model comprises:
determining the highest iteration times and the search step length of the global search algorithm;
taking the initial parameter as an initial position, performing iterative search on the pheromone by the search step length until the maximum iteration times is reached, and stopping the search to obtain the current pheromone;
and replacing the initial parameters with the optimized parameters at the positions corresponding to the current pheromones to obtain the optimized single-type support vector machine model.
6. The artificial intelligence based object data detecting method according to claim 1, wherein said artificial intelligence based object data detecting method further comprises:
randomly acquiring data from the target data set to construct a verification set;
inputting the data in the verification set into the detection model, and outputting a first detection result;
acquiring data with the first detection result as a target, and calculating the proportion of the acquired data in the verification set;
when the proportion is larger than or equal to the configuration proportion, determining that the detection model passes verification, and storing the detection model to a block chain; or
And when the proportion is smaller than the configuration proportion, determining that the detection model is not verified, updating the at least one sub tag, updating the at least one sub data set according to the updated at least one sub tag, and performing optimization training on the detection model by using the updated at least one sub data set.
7. The artificial intelligence based object data detecting method according to claim 1, wherein after integrating the data whose detection result is an object as the object data, the artificial intelligence based object data detecting method further comprises:
calculating the proportion of the target data in the data to be detected;
when the ratio is lower than a configuration ratio, generating warning information according to the ratio;
determining the associated user of the user to be detected;
and sending the warning information to the terminal equipment of the user to be detected and the terminal equipment of the associated user.
8. An artificial intelligence based object data detecting apparatus, comprising:
the determining unit is used for responding to the received target data detection instruction and determining a target label;
the device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring data to be detected corresponding to a user to be detected;
the construction unit is used for selecting data from the data to be detected according to the target label to construct a target data set;
the constructing unit is further configured to obtain at least one predefined sub-tag, and select data corresponding to each sub-tag from the data to be detected to construct at least one sub-data set corresponding to each sub-tag;
a calculation unit, configured to calculate an intersection between the target data set and the at least one sub data set to obtain at least one sub intersection;
the training unit is used for training the single-class support vector machine model by combining a global search algorithm through the at least one sub-intersection to obtain a detection model;
the input unit is used for inputting the data to be detected into the detection model and outputting a detection result, wherein the detection result comprises a target and a non-target;
and the integration unit is used for integrating the data of which the detection result is the target as the target data.
9. An electronic device, characterized in that the electronic device comprises:
a memory storing at least one instruction; and
a processor executing instructions stored in the memory to implement the artificial intelligence based target data detection method of any one of claims 1 to 7.
10. A computer-readable storage medium characterized by: the computer-readable storage medium has stored therein at least one instruction that is executable by a processor in an electronic device to implement the artificial intelligence based target data detection method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010797375.0A CN111985545B (en) | 2020-08-10 | 2020-08-10 | Target data detection method, device, equipment and medium based on artificial intelligence |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010797375.0A CN111985545B (en) | 2020-08-10 | 2020-08-10 | Target data detection method, device, equipment and medium based on artificial intelligence |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111985545A true CN111985545A (en) | 2020-11-24 |
| CN111985545B CN111985545B (en) | 2024-05-17 |
Family
ID=73445448
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010797375.0A Active CN111985545B (en) | 2020-08-10 | 2020-08-10 | Target data detection method, device, equipment and medium based on artificial intelligence |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111985545B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112925958A (en) * | 2021-02-05 | 2021-06-08 | 深圳力维智联技术有限公司 | Multi-source heterogeneous data adaptation method, device, equipment and readable storage medium |
| CN114004443A (en) * | 2021-09-13 | 2022-02-01 | 广东省国土资源测绘院 | Detection method and device for illegal building data |
| CN114580562A (en) * | 2022-03-16 | 2022-06-03 | 北京珞安科技有限责任公司 | Abnormal data detection method and device based on process flow |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106709506A (en) * | 2016-11-28 | 2017-05-24 | 广东工业大学 | Method for identifying and classifying species and different origins of Chinese herbal medicine |
| WO2019119515A1 (en) * | 2017-12-22 | 2019-06-27 | 深圳云天励飞技术有限公司 | Face analysis and filtering method, device, embedded apparatus, dielectric and integrated circuit |
| CN110059734A (en) * | 2019-04-02 | 2019-07-26 | 唯思科技（北京）有限公司 | A kind of training method, object identification method, device, robot and the medium of target identification disaggregated model |
| CN110348490A (en) * | 2019-06-20 | 2019-10-18 | 宜通世纪科技股份有限公司 | A kind of soil quality prediction technique and device based on algorithm of support vector machine |
| CN110516251A (en) * | 2019-08-29 | 2019-11-29 | 秒针信息技术有限公司 | A kind of construction method, construction device, equipment and the medium of electric business entity recognition model |
| CN111476324A (en) * | 2020-06-28 | 2020-07-31 | 平安国际智慧城市科技股份有限公司 | Traffic data labeling method, device, equipment and medium based on artificial intelligence |
-
2020
- 2020-08-10 CN CN202010797375.0A patent/CN111985545B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106709506A (en) * | 2016-11-28 | 2017-05-24 | 广东工业大学 | Method for identifying and classifying species and different origins of Chinese herbal medicine |
| WO2019119515A1 (en) * | 2017-12-22 | 2019-06-27 | 深圳云天励飞技术有限公司 | Face analysis and filtering method, device, embedded apparatus, dielectric and integrated circuit |
| CN110059734A (en) * | 2019-04-02 | 2019-07-26 | 唯思科技（北京）有限公司 | A kind of training method, object identification method, device, robot and the medium of target identification disaggregated model |
| CN110348490A (en) * | 2019-06-20 | 2019-10-18 | 宜通世纪科技股份有限公司 | A kind of soil quality prediction technique and device based on algorithm of support vector machine |
| CN110516251A (en) * | 2019-08-29 | 2019-11-29 | 秒针信息技术有限公司 | A kind of construction method, construction device, equipment and the medium of electric business entity recognition model |
| CN111476324A (en) * | 2020-06-28 | 2020-07-31 | 平安国际智慧城市科技股份有限公司 | Traffic data labeling method, device, equipment and medium based on artificial intelligence |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112925958A (en) * | 2021-02-05 | 2021-06-08 | 深圳力维智联技术有限公司 | Multi-source heterogeneous data adaptation method, device, equipment and readable storage medium |
| CN114004443A (en) * | 2021-09-13 | 2022-02-01 | 广东省国土资源测绘院 | Detection method and device for illegal building data |
| CN114580562A (en) * | 2022-03-16 | 2022-06-03 | 北京珞安科技有限责任公司 | Abnormal data detection method and device based on process flow |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111985545B (en) | 2024-05-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111950621A (en) | Target data detection method, device, equipment and medium based on artificial intelligence | |
| CN112801718B (en) | User behavior prediction method, device, equipment and medium | |
| CN111985545B (en) | Target data detection method, device, equipment and medium based on artificial intelligence | |
| CN112231586A (en) | Course recommendation method, device, equipment and medium based on transfer learning | |
| CN111949708B (en) | Multi-task prediction method, device, equipment and medium based on time sequence feature extraction | |
| CN112396547B (en) | Course recommendation method, device, equipment and medium based on unsupervised learning | |
| CN113806434B (en) | Big data processing method, device, equipment and medium | |
| CN111882873B (en) | Track anomaly detection method, device, equipment and medium | |
| CN113139743A (en) | Sewage discharge index analysis method and device, electronic equipment and storage medium | |
| CN112380454A (en) | Training course recommendation method, device, equipment and medium | |
| CN114511038A (en) | False news detection method and device, electronic equipment and readable storage medium | |
| CN115081538A (en) | Customer relationship identification method, device, equipment and medium based on machine learning | |
| CN114612194A (en) | Product recommendation method and device, electronic equipment and storage medium | |
| CN114187489B (en) | Method and device for detecting abnormal driving risk of vehicle, electronic equipment and storage medium | |
| CN114185776A (en) | Big data point burying method, device, equipment and medium for application program | |
| CN114862140A (en) | Behavior analysis-based potential evaluation method, device, equipment and storage medium | |
| CN111950707B (en) | Behavior prediction method, device, equipment and medium based on behavior co-occurrence network | |
| CN112651782B (en) | Behavior prediction method, device, equipment and medium based on dot product attention scaling | |
| CN113434542A (en) | Data relation identification method and device, electronic equipment and storage medium | |
| CN112860851A (en) | Course recommendation method, device, equipment and medium based on root cause analysis | |
| CN112115890A (en) | Drunk driving identification method, device, equipment and medium based on artificial intelligence | |
| CN116823437A (en) | Access method, device, equipment and medium based on configured wind control strategy | |
| CN112330080B (en) | Factor screening method, device, equipment and medium based on connectivity graph | |
| CN115913763A (en) | Flow abnormity detection method, device, equipment and medium | |
| CN114201482A (en) | Dynamic population distribution statistical method and device, electronic equipment and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |