CN110489657B - Information filtering method and device, terminal equipment and storage medium - Google Patents

Information filtering method and device, terminal equipment and storage medium Download PDF

Info

Publication number
CN110489657B
CN110489657B CN201910605240.7A CN201910605240A CN110489657B CN 110489657 B CN110489657 B CN 110489657B CN 201910605240 A CN201910605240 A CN 201910605240A CN 110489657 B CN110489657 B CN 110489657B
Authority
CN
China
Prior art keywords
target
filtering
library
information
list
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910605240.7A
Other languages
Chinese (zh)
Other versions
CN110489657A (en
Inventor
张忠飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuba Co Ltd
Original Assignee
Wuba Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuba Co Ltd filed Critical Wuba Co Ltd
Priority to CN201910605240.7A priority Critical patent/CN110489657B/en
Publication of CN110489657A publication Critical patent/CN110489657A/en
Application granted granted Critical
Publication of CN110489657B publication Critical patent/CN110489657B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9536Search customisation based on social or collaborative filtering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/958Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking

Abstract

The invention provides an information filtering method, an information filtering device, terminal equipment and a storage medium, and relates to the technical field of computers. The method comprises the following steps: acquiring a target list library meeting the filtering requirement according to the filtering requirement of a target scene and preset filtering parameters of each list library; configuring the target business form library according to the configuration information of the target scene aiming at the business form library; and filtering the information under the target scene according to the configured target name list library. The technical problem that the filtering cost is high due to the fact that the existing information filtering scheme adopts a customized mode is solved. The method and the device have the advantages that the flexibility of the information filtering strategy is improved, and the information filtering cost is reduced.

Description

Information filtering method and device, terminal equipment and storage medium
Technical Field
The present invention relates to the field of computer technologies, and in particular, to an information filtering method and apparatus, a terminal device, and a storage medium.
Background
With the continuous development of economy and information technology in China, the Internet is integrated into the life of people, more and more people select required information from the Internet, and the vigorous development of the Internet is greatly promoted. However, due to the rapid growth of network information, part of the content in the network information may be harmful to different application scenarios or different users. For example, for some websites, a large number of posts are published every day, some posts are normal, and some posts contain illegal contents related to yellow or storm, so in order to maintain the website environment, it is necessary to intercept the illegal contents at the first time.
However, the current information filtering scheme generally adopts a customized development mode, one filtering scheme needs to be customized for each filtering scene, a new scene cannot be flexibly accessed, and the filtering scheme needs to be customized again for each scene, so that the development cost is increased, and the cost of information filtering is high.
Disclosure of Invention
The embodiment of the invention provides an information filtering method, an information filtering device, terminal equipment and a storage medium, and aims to solve the problem that the existing information filtering cost is too high.
In order to solve the technical problem, the invention is realized as follows:
in a first aspect, an embodiment of the present invention provides an information filtering method, including:
acquiring a target list library meeting the filtering requirement according to the filtering requirement of a target scene and preset filtering parameters of each list library;
configuring the target business form library according to the configuration information of the target scene aiming at the business form library;
filtering the information under the target scene according to the configured target name list library;
the filtering parameters comprise preset detection fields, service scenes which the detection fields are applicable to, and filtering attributes of the detection fields under the service scenes; the filter attribute includes at least one of a blacklist attribute, a whitelist attribute, and a gray list attribute.
Optionally, the step of obtaining the target list library meeting the filtering requirements according to the filtering requirements of the target scene and preset filtering parameters of each list library includes:
and acquiring the list content data of the target list library meeting the filtering requirement according to the filtering requirement of the target scene and the filtering parameters of each list library in the target distributed cache.
Optionally, the step of configuring the target business form library according to the configuration information of the target scene for the business form library includes:
acquiring configuration information of the target scene for a business form library from a local cache corresponding to the target scene;
and configuring the list content data according to the configuration information to obtain a target name list library after the target scene is configured.
Optionally, the step of filtering the information in the target scene according to the configured target name list library includes:
aiming at each target name list library, detecting target information matched with the detection field in the service scene according to the service scene applicable to the detection field contained in the target name list library;
and performing data filtering on the target information according to the filtering attribute of the detection field.
In a second aspect, an embodiment of the present invention provides an information filtering apparatus, including:
the target list library acquisition module is used for acquiring a target list library meeting the filtering requirements according to the filtering requirements of the target scene and preset filtering parameters of each list library;
the target business form library configuration module is used for configuring the target business form library according to the configuration information of the target scene aiming at the business form library;
the information filtering module is used for filtering the information under the target scene according to the configured target name list library;
the filtering parameters comprise preset detection fields, service scenes which the detection fields are applicable to, and filtering attributes of the detection fields under the service scenes; the filter attribute includes at least one of a blacklist attribute, a whitelist attribute, and a graylist attribute.
Optionally, the target roster obtaining module includes:
and the target list library obtaining submodule is used for obtaining the list content data of the target list library meeting the filtering requirement according to the filtering requirement of the target scene and the filtering parameters of each list library in the target distributed cache.
Optionally, the target roster configuration module includes:
the configuration information acquisition submodule is used for acquiring the configuration information of the target scene aiming at the namelist library from the local cache corresponding to the target scene;
and the target name list library configuration submodule is used for configuring the list content data according to the configuration information to obtain the target name list library after the target scene is configured.
Optionally, the target name list library includes a preset detection field, a service scenario to which the detection field is applicable, and a filtering attribute of the detection field; the filter attribute includes at least one of a blacklist attribute, a whitelist attribute, and a gray list attribute.
Optionally, the information filtering module includes:
the target information detection submodule is used for detecting target information matched with the detection field in the service scene according to the service scene applicable to the detection field contained in the target name list library aiming at each target name list library;
and the information filtering submodule is used for carrying out data filtering on the target information according to the filtering attribute of the detection field.
In a third aspect, an embodiment of the present invention additionally provides a terminal device, including: a memory, a processor and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the information filtering method as described above.
In a fourth aspect, the embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements the steps of the information filtering method as described above.
In the embodiment of the invention, a target list library meeting the filtering requirement is obtained according to the filtering requirement of a target scene and the preset filtering parameters of each list library; configuring the target business form library according to the configuration information of the target scene aiming at the business form library; filtering the information under the target scene according to the configured target name list library; the filtering parameters comprise preset detection fields, service scenes to which the detection fields are applicable, and filtering attributes of the detection fields under the service scenes; the filter attribute includes at least one of a blacklist attribute, a whitelist attribute, and a gray list attribute. The technical problem that the filtering cost is high due to the fact that the existing information filtering scheme adopts a customized mode is solved. The method and the device have the advantages that the flexibility of the information filtering strategy is improved, and the information filtering cost is reduced.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without inventive labor.
FIG. 1 is a flow chart of the steps of a method of filtering information in an embodiment of the present invention;
FIG. 2 is a flow chart of steps of another method of filtering information in an embodiment of the present invention;
FIG. 3 is a schematic structural diagram of an information filtering apparatus according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of another information filtering apparatus according to an embodiment of the present invention;
fig. 5 is a schematic diagram of a hardware structure of a terminal device in the embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a flow chart illustrating steps of an information filtering method according to an embodiment of the present invention is shown.
And step 110, acquiring a target list library meeting the filtering requirements according to the filtering requirements of the target scene and preset filtering parameters of each list library.
As mentioned above, in practical applications, fields to be detected or filtered for different services in different scenarios may not be completely consistent, but some fields to be filtered in different scenarios may be the same, for example, when different websites perform yellow-related or storm-related detection, yellow-related or storm-related fields to be detected are generally the same.
Therefore, in the embodiment of the invention, a plurality of list libraries for field detection can be preset, a set of certain types of data is stored in the list libraries, and each list library has own filtering parameters so as to meet the requirements of different scenes. In addition, in order to avoid application confusion of the list libraries, the list libraries can be set to be different from each other, isolated from each other and not interfered with each other. At this time, for a target scene which needs field detection or information filtering currently, at least one target namelist library meeting the filtering requirement can be obtained from each preset namelist library directly according to the filtering requirement of the target scene.
The filtering requirements of different scenes can be preset according to the requirements, and the embodiment of the invention is not limited. For example, some scenes need to be filtered for exposure to storm, some scenes need to be filtered for exposure to yellow and exposure to storm simultaneously, some scenes may have some special sensitive word filtering for part of services, and the like.
The filtering parameter may include, but is not limited to, a preset detection field, a service scenario to which different detection fields are applicable, a filtering attribute of different detection fields in the service scenario to which the different detection fields are applicable, and the like, and the filtering attribute may include, but is not limited to, at least one of a blacklist attribute, a whitelist attribute, and a gray list attribute. Of course, in the embodiment of the present invention, the filtering parameter may only include the preset detection field and the filtering attribute of each detection field, which is not limited to this embodiment of the present invention.
And step 120, configuring the target business form library according to the configuration information of the target scene aiming at the business form library.
After the target list library is obtained, because parameters such as a data obtaining path of an unused data scene, a filtered data storage path, field detection precision, data filtering strength and the like are not completely consistent, after the target list library meeting the target scene is obtained, in order to ensure that the target list library can be completely adapted to the target scene, the target list library also needs to be configured further according to configuration information of the target scene for the list library.
The content specifically included in the configuration information may also be preset according to the requirement, and the embodiment of the present invention is not limited thereto. For example, data acquisition paths, filtered data storage paths, field detection accuracy, data filtering strength, and the like, as described above, may be included, but are not limited to.
And step 130, filtering the information in the target scene according to the configured target name list library.
After the target list library corresponding to the target scene is configured according to the configuration information of the target scene for the list library, the information in the target scene may be filtered according to the configured target list library.
Specifically, target information matched with the target field can be detected from the information of the target scene according to the target field contained in the target name list library, and then filtering is performed on the target information. The filtering method may include filtering the target information matched with the target field from the information of the target scene, and/or filtering the target information matched with the target field for additional storage, or retaining the target information matched with the target field and filtering other information in the target scene, and so on.
As can be seen from the above description, in the embodiment of the present invention, one or more target name list libraries may be obtained by matching for a target scene, and if a plurality of target name list libraries are obtained by matching for a target scene, because the target name list libraries are different from each other, are isolated from each other, and do not interfere with each other, information in the same target scene may be detected and filtered simultaneously according to filtering parameters included in the plurality of target name list libraries, so that efficiency of information filtering may be effectively improved. In addition, for different target scenes, only the target name list library needs to be configured relatively based on the different target scenes, a new name list library does not need to be completely re-developed for each scene, and development cost can be effectively reduced.
In the embodiment of the invention, a target list library meeting the filtering requirement is obtained according to the filtering requirement of a target scene and the preset filtering parameters of each list library; configuring the target business form library according to the configuration information of the target scene aiming at the business form library; filtering information under the target scene according to a configured target name list library, wherein the filtering parameters comprise preset detection fields, service scenes to which the detection fields are applicable and filtering attributes of the detection fields under the service scenes; the filter attribute includes at least one of a blacklist attribute, a whitelist attribute, and a gray list attribute. The method has the advantages of improving the flexibility of the information filtering strategy and reducing the information filtering cost.
Referring to fig. 2, in the embodiment of the present invention, the step 110 may further include:
and a substep 111, obtaining the list content data of the target list library meeting the filtering requirement according to the filtering requirement of the target scene and the filtering parameters of each list library in the target distributed cache.
In the embodiment of the present invention, in order to increase the application range of the roster library, a preset roster library may be stored in the distributed cache. The distributed cache is managed and controlled by one server side, and a plurality of client nodes store data, so that the data reading speed can be further improved. The distributed cache can read data with high performance, can dynamically expand cache nodes, can automatically discover and switch failure nodes, can automatically balance data partitions, can provide a graphical management interface for a user, and is very convenient to deploy and maintain. At this time, different target scenes may obtain, according to the filtering requirements of the target scenes, the list content data of the target business form library satisfying the filtering requirements from the target distributed cache for storing the business form library.
The target distributed cache in the embodiment of the present invention may be any one of distributed caches, and the embodiment of the present invention is not limited thereto. For example, memcached, redis, and the like.
Referring to fig. 2, in the embodiment of the present invention, the step 120 further includes:
and a substep 121, obtaining the configuration information of the target scene for the business form library from the local cache corresponding to the target scene.
And a substep 122, configuring the list content data according to the configuration information to obtain a target list library after the target scene is configured.
In the embodiment of the present invention, since the configuration information of different scenes for the business form library is not completely consistent, operations such as setting and adjusting the configuration information are convenient while avoiding confusion of the configuration information of different scenes, and the configuration information may be stored in the local cache corresponding to the corresponding scene, so that in order to complete the configuration of the business form library corresponding to the target scene, the configuration information of the target scene for the business form library may be obtained from the local cache corresponding to the target scene. The storage format of the configuration information in the local cache may be preset according to a requirement, which is not limited in this embodiment of the present invention.
Moreover, in the embodiment of the present invention, if the same target scene corresponds to multiple roster libraries, the configuration information of the target scene for different roster libraries is the same, and certainly may not be the same, and may be preset according to a requirement, which is not limited in the embodiment of the present invention.
For example, for a certain target scenario a, the corresponding list library includes a business list library 1 and a list library 2, where an applicable service of the detection field set in the business list library 1 includes a service a1 under the target scenario a, and an applicable service of the detection field set in the business list library 2 includes a service a2 under the target scenario a, and if data acquisition paths of the service a1 and the service a2 under the target scenario a are not completely consistent, then there is a difference in configuration information of the target scenario a for the business list library 1 and the list library 2 at this time.
After obtaining the configuration information of the target scene for the business form library, the name form library configured by the target scene may be obtained by configuring the list content data corresponding to the target scene according to the configuration information.
Optionally, in the embodiment of the present invention, the target name list library includes a preset detection field, a service scenario to which the detection field is applicable, and a filtering attribute of the detection field; the filter attribute includes at least one of a blacklist attribute, a whitelist attribute, and a gray list attribute.
As described above, in the embodiment of the present invention, the list library includes the preset detection fields, and the detection fields in different list libraries may be preset according to the requirement, which is not limited in the embodiment of the present invention. The detection fields contained in different lists can have overlapped parts, but in order to meet the requirements that the lists are different from each other and not interfered with each other, the detection effects of the detection fields in the two lists can be set to be different aiming at the same detection fields in the two lists.
For example, if the detection field "IP address 119.57.117.178" exists in both the roster library a and the roster library B, it is necessary to ensure that the detection effect of the detection field "IP address 119.57.117.178" corresponding to the roster library a is different from that of the roster library B in order to avoid overlapping portions between the roster library a and the roster library B. For example, the setting detection field "IP address 119.57.117.178" is set in the roster library to apply to service 1, and is set in the roster library to apply to service 2; and/or, the filtering attribute of the detection field "IP address 119.57.117.178" in the roster library is a blacklist attribute, and the filtering attribute in the roster library is a whitelist attribute or a graylist attribute, etc.
In addition, in practical application, data filtering or data detection requirements of different services in the same scene may also differ, so in the embodiment of the present invention, in order to improve the applicability of the business form library, a business scene to which the detection field is applicable and/or a business scene to which the detection field is not applicable may also be set in the business form library.
Further, in practical applications, the requirements in terms of data detection or data filtering are different according to different scenes or different services, for example, some scenes or services need to filter out contents including some fields, and some scenes or services need to filter out other contents except contents including some fields, and so on. Therefore, in the embodiment of the present invention, in order to meet the above requirement, filter attributes for respectively setting the detection fields may be set, and the selectable filter attributes may include, but are not limited to, at least one of a blacklist attribute, a whitelist attribute, and a graylist attribute.
After the blacklist detection field is enabled, the content corresponding to the blacklist detection field, such as an IP address, an IP packet, a mail, a content related to a yellow storm, a virus and the like, can be detected and filtered. The concept of white list corresponds to "black list", if white list is established, the content corresponding to the white list detection field can pass preferentially, and will not be rejected or filtered as spam, etc. The grey list is between the black list and the white list, and is dynamically created by using an interpretation type background program and an SMTP (Simple Mail Transfer Protocol) status mark, and the grey list can intelligently intercept most junk mails. Its main function is based on the SMTP error-code (error-code).
Obviously, the target business form library is also a business form library, so the target business form library comprises preset detection fields, the business scenes to which the detection fields are applicable, and the filtering attributes of the detection fields under the business scenes to which the detection fields are applicable; the filter attribute includes at least one of a blacklist attribute, a whitelist attribute, and a gray list attribute.
Referring to fig. 2, in the embodiment of the present invention, the step 130 may further include:
and a substep 131, for each target name list library, detecting target information matched with the detection field in the service scene according to the service scene applicable to the detection field contained in the target name list library.
A substep 132 of performing data filtering on the target information according to the filtering attribute of the detection field.
As described above, in the embodiment of the present invention, in order to improve the application range and the detection accuracy of each roster library, a service scenario to which each detection field in the roster library is applied, a filter attribute of each detection field, and the like may be set. Then, after configuring the target name list library of the target scene, for each target name list library, according to the service scene applicable to the detection field included in the target name list library, the target information matched with the detection field in the service scene is detected, and further, according to the filtering attribute of the detection field, the data filtering is performed on the target information.
For example, for a target scene, the configured target business list library includes a business list library a including a detection field 1 and a detection field 2, and assuming that a business scene S1 applicable to the detection field 1 has a filtering attribute of a blacklist; and detecting the service scene S2 for which the field 2 is applicable, and filtering the attribute into a white list attribute.
Then, at this time, the target information matched with the detection field in the service scene may be detected according to the service scene to which the detection field is applicable. Assume that the destination information matched with the check field 1 under the service scenario S1 is information M1, and the destination information matched with the check field 2 under the service scenario S2 is information M2.
And then, data filtering can be carried out on corresponding target information according to the filtering attribute of the detection field. At this time, since the filtering attribute of the detection field 1 is the blacklist attribute, the information M1 may be intercepted in the service scenario S1, and/or the information M1 may be directly filtered out in the service scenario S1, and/or the information M1 may be transferred to a preset blacklist storage area in the service scenario S1, and the like for filtering; and the filtering attribute of the detection field 2 is a white list attribute, when data filtering is performed on the information M2 under the service scenario S1, the information M2 may be preferentially passed, and/or the information M2 may be extracted to a preset white list data storage area, and so on. The specific filtering strategy may be preset according to the requirement, and the embodiment of the present invention is not limited.
In the embodiment of the present invention, the list content data of the target roster library meeting the filtering requirement may be obtained according to the filtering requirement of the target scene and the filtering parameter of each roster library in the target distributed cache. Acquiring configuration information of the target scene for a business form library from a local cache corresponding to the target scene; and configuring the list content data according to the configuration information to obtain a target name list library after the target scene is configured. The convenience for acquiring the business form library is improved while the configuration information confusion of different scenes is avoided, and the information filtering cost is further reduced.
Moreover, in the embodiment of the present invention, the target name list library includes a preset detection field, a service scenario to which the detection field is applicable, and a filtering attribute of the detection field; the filter attribute includes at least one of a blacklist attribute, a whitelist attribute, and a gray list attribute. Moreover, for each target name list library, target information matched with the detection field in the service scene can be detected according to the service scene applicable to the detection field contained in the target name list library; and performing data filtering on the target information according to the filtering attribute of the detection field. Therefore, the accuracy of information filtering and the application range of the business form library can be improved, and the information filtering cost is further reduced.
Referring to fig. 3, a schematic structural diagram of an information filtering apparatus according to an embodiment of the present invention is shown.
The information filtering apparatus of the embodiment of the present invention includes: a target rostrum obtaining module 310, a target rostrum configuration module 320, and an information filtering module 330.
The functions of the modules and the interaction relationship between the modules are described in detail below.
A target list library obtaining module 310, configured to obtain a target list library meeting a filtering requirement according to the filtering requirement of a target scene and preset filtering parameters of each list library; the filtering parameters comprise preset detection fields, service scenes which the detection fields are applicable to, and filtering attributes of the detection fields under the service scenes; the filter attribute includes at least one of a blacklist attribute, a whitelist attribute, and a graylist attribute.
And a target business form library configuration module 320, configured to configure the target business form library according to the configuration information of the target scene for the business form library.
And the information filtering module 330 is configured to filter the information in the target scene according to the configured target name list library.
Referring to fig. 4, in the embodiment of the present invention, the target roster obtaining module 310 further includes:
and the target list library obtaining submodule 311 is configured to obtain the list content data of the target list library meeting the filtering requirement according to the filtering requirement of the target scene and the filtering parameter of each list library in the target distributed cache.
In the embodiment of the invention, a target list library meeting the filtering requirement is obtained according to the filtering requirement of a target scene and the preset filtering parameters of each list library; configuring the target business form library according to the configuration information of the target scene aiming at the business form library; and filtering the information under the target scene according to the configured target name list library. The method and the device have the advantages that the flexibility of the information filtering strategy is improved, and the information filtering cost is reduced.
Referring to fig. 4, in the embodiment of the present invention, the target namespace library configuration module 320 may further include:
a configuration information obtaining submodule 321, configured to obtain configuration information of the target scene for the business form library from a local cache corresponding to the target scene;
and a target name list library configuration submodule 322, configured to configure the list content data according to the configuration information, so as to obtain a target name list library after the target scene is configured.
Optionally, in the embodiment of the present invention, the target name list library includes a preset detection field, a service scenario to which the detection field is applicable, and a filtering attribute of the detection field; the filter attribute includes at least one of a blacklist attribute, a whitelist attribute, and a gray list attribute.
Referring to fig. 4, in the embodiment of the present invention, the information filtering module 330 may further include:
the target information detection submodule 331 is configured to detect, for each target name list library, target information matched with a detection field in the service scene according to the service scene to which the detection field included in the target name list library is applicable;
and the information filtering submodule 332 is configured to perform data filtering on the target information according to the filtering attribute of the detection field.
The information filtering device provided in the embodiment of the present invention can implement each process implemented by the mobile terminal in the method embodiments of fig. 1 to fig. 2, and is not described herein again to avoid repetition.
In the embodiment of the present invention, the list content data of the target list library meeting the filtering requirement may be obtained according to the filtering requirement of the target scene and the filtering parameter of each list library in the target distributed cache. Acquiring configuration information of the target scene for a business form library from a local cache corresponding to the target scene; and configuring the list content data according to the configuration information to obtain a target name list library after the target scene is configured. The convenience for acquiring the business form library is improved while the configuration information confusion of different scenes is avoided, and the information filtering cost is further reduced.
Moreover, in the embodiment of the present invention, the target name list library includes a preset detection field, a service scenario to which the detection field is applicable, and a filtering attribute of the detection field; the filter attribute includes at least one of a blacklist attribute, a whitelist attribute, and a gray list attribute. Moreover, for each target name list library, target information matched with the detection field in the service scene can be detected according to the service scene applicable to the detection field contained in the target name list library; and performing data filtering on the target information according to the filtering attribute of the detection field. Therefore, the accuracy of information filtering and the application range of the business form library can be improved, and the information filtering cost is further reduced.
Fig. 5 is a schematic diagram of a hardware structure of a terminal device for implementing various embodiments of the present invention.
The terminal device 500 includes but is not limited to: a radio frequency unit 501, a network module 502, an audio output unit 503, an input unit 504, a sensor 505, a display unit 506, a user input unit 507, an interface unit 508, a memory 509, a processor 510, and a power supply 511. Those skilled in the art will appreciate that the terminal device configuration shown in fig. 5 does not constitute a limitation of the terminal device, and that the terminal device may include more or fewer components than shown, or combine certain components, or a different arrangement of components. In the embodiment of the present invention, the terminal device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 501 may be used for receiving and sending signals during a message sending and receiving process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 510; in addition, uplink data is transmitted to the base station. In general, radio frequency unit 501 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 501 can also communicate with a network and other devices through a wireless communication system.
The terminal device provides the user with wireless broadband internet access through the network module 502, such as helping the user send and receive e-mails, browse web pages, access streaming media, and the like.
The audio output unit 503 may convert audio data received by the radio frequency unit 501 or the network module 502 or stored in the memory 509 into an audio signal and output as sound. Also, the audio output unit 503 may also provide audio output related to a specific function performed by the terminal apparatus 500 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 503 includes a speaker, a buzzer, a receiver, and the like.
The input unit 504 is used to receive an audio or video signal. The input Unit 504 may include a Graphics Processing Unit (GPU) 5041 and a microphone 5042, and the Graphics processor 5041 processes image data of a still picture or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 506. The image frames processed by the graphic processor 5041 may be stored in the memory 509 (or other storage medium) or transmitted via the radio frequency unit 501 or the network module 502. The microphone 5042 may receive sounds and may be capable of processing such sounds into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 501 in case of the phone call mode.
The terminal device 500 further comprises at least one sensor 505, such as light sensors, motion sensors and other sensors. Specifically, the light sensor includes an ambient light sensor that adjusts the brightness of the display panel 5061 according to the brightness of ambient light, and a proximity sensor that turns off the display panel 5061 and/or a backlight when the terminal device 500 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the terminal device posture (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration identification related functions (such as pedometer, tapping), and the like; the sensors 505 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.
The display unit 506 is used to display information input by the user or information provided to the user. The Display unit 506 may include a Display panel 5061, and the Display panel 5061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 507 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the terminal device. Specifically, the user input unit 507 includes a touch panel 5071 and other input devices 5072. Touch panel 5071, also referred to as a touch screen, may collect touch operations by a user on or near it (e.g., operations by a user on or near touch panel 5071 using a finger, stylus, or any suitable object or attachment). The touch panel 5071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 510, and receives and executes commands sent by the processor 510. In addition, the touch panel 5071 may be implemented in various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 5071, the user input unit 507 may include other input devices 5072. In particular, other input devices 5072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.
Further, the touch panel 5071 may be overlaid on the display panel 5061, and when the touch panel 5071 detects a touch operation thereon or nearby, the touch operation is transmitted to the processor 510 to determine the type of the touch event, and then the processor 510 provides a corresponding visual output on the display panel 5061 according to the type of the touch event. Although in fig. 5, the touch panel 5071 and the display 5061 are two independent components to implement the input and output functions of the terminal device, in some embodiments, the touch panel 5071 and the display 5061 may be integrated to implement the input and output functions of the terminal device, and is not limited herein.
The interface unit 508 is an interface for connecting an external device to the terminal apparatus 500. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 508 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the terminal apparatus 500 or may be used to transmit data between the terminal apparatus 500 and the external device.
The memory 509 may be used to store software programs as well as various data. The memory 509 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, etc. Further, the memory 509 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.
The processor 510 is a control center of the terminal device, connects various parts of the entire terminal device by using various interfaces and lines, and performs various functions of the terminal device and processes data by running or executing software programs and/or modules stored in the memory 509 and calling data stored in the memory 509, thereby performing overall monitoring of the terminal device. Processor 510 may include one or more processing units; preferably, the processor 510 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 510.
The terminal device 500 may further include a power supply 511 (e.g., a battery) for supplying power to various components, and preferably, the power supply 511 may be logically connected to the processor 510 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.
In addition, the terminal device 500 includes some functional modules that are not shown, and are not described in detail here.
Preferably, an embodiment of the present invention further provides a terminal device, including: the processor 510, the memory 509, and a computer program stored in the memory 509 and capable of running on the processor 510, where the computer program, when executed by the processor 510, implements each process of any one of the above embodiments of the information filtering method, and can achieve the same technical effect, and are not described herein again to avoid repetition.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when being executed by a processor, the computer program implements each process of any one of the above embodiments of the information filtering method, and can achieve the same technical effect, and in order to avoid repetition, the details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
It can be clearly understood by those skilled in the art that, for convenience and simplicity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk or an optical disk, and various media capable of storing program codes.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (10)

1. An information filtering method, comprising:
acquiring at least one target list library meeting the filtering requirements according to the filtering requirements of the target scene and preset filtering parameters of each list library; the name list libraries are different from one another, are isolated from one another and are not interfered with one another;
configuring the target business form library according to the configuration information of the target scene aiming at the business form library;
filtering the information under the target scene according to the configured target name list library;
the filtering parameters comprise preset detection fields, service scenes which the detection fields are applicable to, and filtering attributes of the detection fields under the service scenes; the filtering attribute comprises at least one of a blacklist attribute, a white list attribute and a grey list attribute; and the same detection field has different filtering attributes under different service scenes.
2. The method according to claim 1, wherein the step of obtaining the target roster that meets the filtering requirement according to the filtering requirement of the target scene and preset filtering parameters of each roster comprises:
and acquiring the list content data of the target list library meeting the filtering requirement according to the filtering requirement of the target scene and the filtering parameters of each list library in the target distributed cache.
3. The method according to claim 1, wherein the step of configuring the target roster according to the configuration information of the target scene for the roster comprises:
acquiring configuration information of the target scene for a business form library from a local cache corresponding to the target scene;
and configuring the list content data according to the configuration information to obtain a target name list library after the target scene is configured.
4. The method according to any one of claims 1-3, wherein the step of filtering the information in the target scene according to the configured target name list library comprises:
aiming at each target name list library, detecting target information matched with the detection field in the service scene according to the service scene applicable to the detection field contained in the target name list library;
and performing data filtering on the target information according to the filtering attribute of the detection field.
5. An information filtering device, comprising:
the target list library acquisition module is used for acquiring at least one target list library meeting the filtering requirements according to the filtering requirements of the target scene and preset filtering parameters of each list library; the name list libraries are different from one another, are isolated from one another and do not interfere with one another;
the target business form library configuration module is used for configuring the target business form library according to the configuration information of the target scene aiming at the business form library;
the information filtering module is used for filtering the information under the target scene according to the configured target name list library;
the filtering parameters comprise preset detection fields, service scenes which the detection fields are applicable to, and filtering attributes of the detection fields under the service scenes; the filtering attribute comprises at least one of a blacklist attribute, a white list attribute and a grey list attribute; and the same detection field has different filtering attributes under different service scenes.
6. The apparatus of claim 5, wherein the target roster obtaining module comprises:
and the target list library obtaining submodule is used for obtaining the list content data of the target list library meeting the filtering requirement according to the filtering requirement of the target scene and the filtering parameters of each list library in the target distributed cache.
7. The apparatus of claim 5, wherein the target roster configuration module comprises:
the configuration information acquisition submodule is used for acquiring the configuration information of the target scene aiming at the namelist library from the local cache corresponding to the target scene;
and the target name list library configuration submodule is used for configuring the list content data according to the configuration information to obtain the target name list library after the target scene is configured.
8. The apparatus according to any one of claims 5-7, wherein the information filtering module comprises:
the target information detection submodule is used for detecting target information matched with the detection field in the service scene according to the service scene applicable to the detection field contained in the target name list library aiming at each target name list library;
and the information filtering submodule is used for carrying out data filtering on the target information according to the filtering attribute of the detection field.
9. A terminal device, comprising: memory, processor and computer program stored on the memory and executable on the processor, which computer program, when being executed by the processor, carries out the steps of the information filtering method as set forth in any one of claims 1 to 4.
10. A computer-readable storage medium, characterized in that a computer program is stored thereon, which computer program, when being executed by a processor, carries out the steps of the information filtering method as claimed in any one of claims 1 to 4.
CN201910605240.7A 2019-07-05 2019-07-05 Information filtering method and device, terminal equipment and storage medium Active CN110489657B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910605240.7A CN110489657B (en) 2019-07-05 2019-07-05 Information filtering method and device, terminal equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910605240.7A CN110489657B (en) 2019-07-05 2019-07-05 Information filtering method and device, terminal equipment and storage medium

Publications (2)

Publication Number Publication Date
CN110489657A CN110489657A (en) 2019-11-22
CN110489657B true CN110489657B (en) 2022-08-26

Family

ID=68546586

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910605240.7A Active CN110489657B (en) 2019-07-05 2019-07-05 Information filtering method and device, terminal equipment and storage medium

Country Status (1)

Country Link
CN (1) CN110489657B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114079574A (en) * 2020-08-14 2022-02-22 中移动信息技术有限公司 Data filtering method, device, equipment and storage medium
CN113792180B (en) * 2021-08-30 2024-02-23 北京百度网讯科技有限公司 Method and device for removing duplicate in recommended scene, electronic equipment and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104216912A (en) * 2013-06-04 2014-12-17 广州中国科学院软件应用技术研究所 Method and device for achieving non-intrusive service form workflow
WO2015168043A1 (en) * 2014-05-01 2015-11-05 Microsoft Technology Licensing, Llc Pose tracking an augmented reality device
CN105279220A (en) * 2015-07-07 2016-01-27 北京挺软科技有限公司 Filter condition setting inspiration method
CN105335483A (en) * 2015-10-14 2016-02-17 广州市畅运信息科技有限公司 Text sensitive word filter system and method
CN105608565A (en) * 2015-12-20 2016-05-25 北京民航信息科技有限公司 Electronic commerce payment management system in field of civil aviation
CN106033439A (en) * 2015-03-13 2016-10-19 阿里巴巴集团控股有限公司 Method and system for processing distributed transaction
CN109739474A (en) * 2018-12-17 2019-05-10 广州华多网络科技有限公司 A kind of processing method of service request, device, equipment and medium

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101447984B (en) * 2008-11-28 2011-11-09 电子科技大学 self-feedback junk information filtering method
CN102208992B (en) * 2010-06-13 2015-09-02 天津海量信息技术有限公司 The malicious information filtering system of Internet and method thereof
CN104021172B (en) * 2014-05-30 2017-07-28 北京搜狗科技发展有限公司 Advertisement filter method and advertisement filter device
CN108984625A (en) * 2018-06-19 2018-12-11 平安科技(深圳)有限公司 Information filtering method, device, computer equipment and storage medium
CN109684370A (en) * 2018-09-07 2019-04-26 平安普惠企业管理有限公司 Daily record data processing method, system, equipment and storage medium
CN109325161A (en) * 2018-09-11 2019-02-12 五八有限公司 Public sentiment data grasping means, device, equipment and storage medium
CN109885749A (en) * 2019-02-28 2019-06-14 安徽腾策网络科技有限公司 A kind of anti-grasping system of webpage information data

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104216912A (en) * 2013-06-04 2014-12-17 广州中国科学院软件应用技术研究所 Method and device for achieving non-intrusive service form workflow
WO2015168043A1 (en) * 2014-05-01 2015-11-05 Microsoft Technology Licensing, Llc Pose tracking an augmented reality device
CN106033439A (en) * 2015-03-13 2016-10-19 阿里巴巴集团控股有限公司 Method and system for processing distributed transaction
CN105279220A (en) * 2015-07-07 2016-01-27 北京挺软科技有限公司 Filter condition setting inspiration method
CN105335483A (en) * 2015-10-14 2016-02-17 广州市畅运信息科技有限公司 Text sensitive word filter system and method
CN105608565A (en) * 2015-12-20 2016-05-25 北京民航信息科技有限公司 Electronic commerce payment management system in field of civil aviation
CN109739474A (en) * 2018-12-17 2019-05-10 广州华多网络科技有限公司 A kind of processing method of service request, device, equipment and medium

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
互联网海量数据中用户关键信息准确识别仿真;杜静 等;《计算机仿真》;20180515;第35卷(第5期);258-261 *
人工智能在通信网络故障溯源的应用研究;黄兵明 等;《邮电设计技术》;20181231(第12期);35-40 *

Also Published As

Publication number Publication date
CN110489657A (en) 2019-11-22

Similar Documents

Publication Publication Date Title
CN111835488B (en) Method for determining mapping of antenna port and terminal
CN109471690B (en) Message display method and terminal equipment
CN110166439B (en) Equipment sharing method, terminal, router and server
CN110035503B (en) Resource state configuration method, activation or deactivation method, base station and terminal
AU2020250543B2 (en) SSB transmission indication method and apparatus, terminal, device, and medium
CN109995862B (en) Resource scheduling method and terminal
CN110888705B (en) Method for processing unread message corner marks and electronic equipment
US20210105651A1 (en) Measurement gap processing method, terminal, and network node
CN108984066B (en) Application icon display method and mobile terminal
JP6862564B2 (en) Methods, devices and non-volatile computer-readable media for image composition
CN111444237A (en) Server system, data transmission method and electronic equipment
CN111124569B (en) Application sharing method, electronic device and computer readable storage medium
CN110489657B (en) Information filtering method and device, terminal equipment and storage medium
CN111615198B (en) Resource determining method, resource indicating method, terminal and network side equipment
CN109151741B (en) Multimedia message receiving method and terminal
CN111131607A (en) Information sharing method, electronic equipment and computer readable storage medium
CN110929273A (en) Permission setting method and electronic equipment
CN111836307B (en) Mapping type determining method and terminal
CN109739406B (en) File sending method and terminal
CN109547330B (en) Information sharing method and device
CN111159738A (en) Permission configuration method, application login method and device
CN110149185B (en) Method for determining CSI resource type, terminal and network side equipment
CN111356096B (en) Information sending method and electronic equipment
KR102596801B1 (en) PC5 link establishment methods, equipment and systems
CN110365842B (en) Terminal control method and terminal equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant