CN116701813A - Data retrieval method, system, terminal and storage medium - Google Patents
Data retrieval method, system, terminal and storage medium Download PDFInfo
- Publication number
- CN116701813A CN116701813A CN202310974098.XA CN202310974098A CN116701813A CN 116701813 A CN116701813 A CN 116701813A CN 202310974098 A CN202310974098 A CN 202310974098A CN 116701813 A CN116701813 A CN 116701813A
- Authority
- CN
- China
- Prior art keywords
- information
- list
- keyword
- file
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 238000004590 computer program Methods 0.000 claims description 5
- 238000001914 filtration Methods 0.000 claims description 3
- 238000012216 screening Methods 0.000 description 9
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 238000001514 detection method Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
- G06F16/9035—Filtering based on additional data, e.g. user or group profiles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
- G06F16/986—Document structures and storage, e.g. HTML extensions
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The application relates to a data retrieval method, a system, a terminal and a storage medium, which belong to the field of data retrieval; the data retrieval method comprises the steps of obtaining a website list; traversing the website list to obtain target file information; establishing a preset keyword list; and retrieving target keyword information from the target file information according to a preset keyword list, and storing the target keyword information. The application improves the retrieval efficiency of the keywords in the file.
Description
Technical Field
The present application relates to the field of data retrieval, and in particular, to a data retrieval method, system, terminal, and storage medium.
Background
At present, if people want to search whether certain keywords are involved in a certain type of file, the related database type website is usually utilized to search the file, the file is downloaded, and the downloaded file is subjected to manual keyword searching; however, this method has a certain disadvantage that, firstly, when searching files, because there are more files in the database, searching is time-consuming, and when searching files, searching for keywords from many searched files is a time-consuming and labor-consuming act.
Disclosure of Invention
The application provides a data retrieval method, a system, a terminal and a storage medium, which have the characteristic of improving the retrieval efficiency of keywords in a file.
The application aims at providing a data retrieval method.
The first object of the present application is achieved by the following technical solutions:
a data retrieval method comprising: acquiring a website list; traversing the website list to obtain target file information; establishing a preset keyword list;
and retrieving target keyword information from the target file information according to a preset keyword list, and storing the target keyword information.
The present application may be further configured in a preferred example, wherein the acquiring the website list includes:
determining a file name keyword list according to preset file name information;
traversing the file name keyword list and a search engine to obtain website link information;
converting the website link information to obtain original website link information;
and obtaining a website list according to the original website link information.
The present application may be further configured in a preferred embodiment to, before obtaining the website list according to the original website link information, further include deduplicating and filtering the original website link information.
In a preferred embodiment, the method may further be configured, where traversing the website list to obtain the target file information includes:
identifying the website list to obtain webpage content type information;
and obtaining target file information according to preset webpage processing rules and the webpage content type information.
The present application may be further configured in a preferred example, wherein the preset web page processing rule includes:
if the web page format is an HTML format and the web page has doc/docx/pdf file downloading links, downloading the doc/docx/pdf file to a first preset path;
if the web page format is an HTML format and the web page does not have doc/docx/pdf file downloading links, acquiring web page text information, and storing the web page text information to a second preset path;
if the web page format is PDF/WORD format, downloading the web page file to a third preset path;
if the web page format is other than HTML, PDF, WORD, the web address is exported, and the web page content of the web address is stored in a fourth preset path.
The present application may be further configured in a preferred example to: the preset keyword list comprises a primary keyword list and a secondary keyword list.
In a preferred embodiment, the method may further include retrieving target keyword information from the target file information according to a preset keyword list, and storing the target keyword information includes:
extracting text information and punctuation information from the target file information;
traversing the text information according to the main keyword list to obtain the position information of the main keywords;
determining sentences of the main keywords according to the text information, the position information and the punctuation information;
judging whether the sentences containing the main keywords contain the secondary keywords or not according to the secondary keyword list;
if yes, storing the sentences of the main keywords into a table file;
otherwise, the sentence of the main keyword is not stored.
The application also provides a data retrieval system.
The second object of the present application is achieved by the following technical solutions:
a data retrieval system, comprising:
the acquisition module is used for acquiring the website list;
the traversing module is used for traversing the website list to obtain target file information;
the establishing module is used for establishing a preset keyword list;
and the retrieval module is used for retrieving the target keyword information from the target file information according to a preset keyword list and storing the target keyword information.
The application aims at providing a terminal.
The third object of the present application is achieved by the following technical solutions:
a terminal comprising a memory and a processor, the memory having stored thereon computer program instructions of the above data retrieval method capable of being loaded and executed by the processor.
A fourth object of the present application is to provide a computer medium capable of storing a corresponding program.
The fourth object of the present application is achieved by the following technical solutions:
a computer readable storage medium storing a computer program capable of being loaded by a processor and executing any one of the data retrieval methods described above.
In summary, the present application includes at least one of the following beneficial technical effects:
traversing the website list to obtain target file information, and then retrieving target keywords from the target file information according to a preset keyword list; the traversing operation of the website list ensures that enough target files are acquired, and the condition that the target files are missed does not occur; then, the target file is screened for the first time according to the main keywords, and the target file is screened for the second time according to the secondary keywords, so that the extracted keywords are ensured to meet the requirements, and the possibility of keyword retrieval errors is reduced; by the method, quick, convenient and efficient retrieval of the data is realized, the possibility of missed detection and false detection is reduced, and the retrieval efficiency of keywords in the file is improved.
Drawings
Fig. 1 is a flow chart of a data retrieval method in an embodiment of the application.
Fig. 2 is a schematic diagram of a data retrieval system according to an embodiment of the present application.
Reference numerals illustrate: 1. an acquisition module; 2. traversing the module; 3. establishing a module; 4. and a retrieval module.
Detailed Description
The present embodiment is only for explanation of the present application and is not to be construed as limiting the present application, and modifications to the present embodiment, which may not creatively contribute to the present application as required, are within the scope of the claims of the present application as far as they are protected by patent law.
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
Embodiments of the application are described in further detail below with reference to the drawings.
The application provides a data retrieval method, and the main flow of the method is described as follows.
As shown in fig. 1:
step S101: and acquiring a website list.
Specifically, a file name keyword list is determined according to preset file name information; traversing the file name keyword list to obtain file name keyword information; acquiring website link information according to the file name keyword information and a search engine; converting the website link information to obtain original website link information; and obtaining a website list according to the original website link information.
In the embodiment of the application, a file name keyword list is determined according to preset file name information, namely, keywords are selected according to preset file names, and the keywords are arranged into the keyword list; finding out related website links through a search engine by file name keyword information; the original website link information is obtained through the conversion processing of the website link; and finally, the original website link information is arranged to obtain a website list.
It should be noted that in the above process, after the original website link information is obtained, the duplicate removal and screening operations are required to be performed on the original website link information; for example, when processing a website link, defining the file source as a website, only the gov website link should be reserved for ensuring the validity of the information source; when screening the website links, judging whether the link source range is limited, if so, screening the website according to the keyword information of the website with the given source range, and if not, carrying out screening operation.
In the embodiment of the application, the specific process of finding the associated website links by using the search engine and the file name keyword list is as follows; determining file name keyword information according to the file name keyword list; then splicing the file name keywords with the URL of the search engine, and obtaining search page contents by using a Request library; extracting all website links in the page content; judging whether the link is jumped or not, if yes, continuing to acquire the jumped link; by the method, the comprehensiveness of the acquired website links can be ensured, and the possibility of omission of the website links is reduced.
Step S102: traversing the website list to obtain target file information.
Specifically, identifying the website list to obtain webpage content type information; and obtaining target file information according to preset webpage processing rules and the webpage content type information.
In the embodiment of the application, the webpage processing rule comprises that if the webpage format is an HTML format and a doc/docx/pdf type file downloading link exists in the webpage, the doc/docx/pdf type file is downloaded to a first preset path; if the web page format is an HTML format and the web page does not have doc/docx/pdf file downloading links, acquiring web page text information, and storing the web page text information to a second preset path; if the web page format is PDF/WORD format, downloading the web page file to a third preset path; if the web page format is other than HTML, PDF, WORD, the web address is exported, and the web page content of the web address is stored in a fourth preset path.
The downloading of the files and the texts in the web pages is completed through the analysis of the web page formats and the web page contents, and the files and the texts corresponding to the web pages of different types are stored in different paths, so that the access and the management are convenient, and the subsequent operation and treatment are also convenient; it can be appreciated that in the above process, if the web page format is other than HTML, PDF, WORD, after the web address is exported, the web page content of the web address may be stored to the fourth preset path by means of manual processing.
Step S103: and establishing a preset keyword list.
In the embodiment of the application, the preset keyword list comprises a main keyword list and a secondary keyword list; then establishing the preset keyword list means respectively establishing a primary keyword list and a secondary keyword list; the primary keyword list is used for primarily screening sentences where keywords are located, and the secondary keyword list is used for secondarily screening sentences where the primary keywords are located; for example, taking the example of whether the file contains a reclaimed water related policy, the main keyword in the target file should be "reclaimed water"; however, in the process of retrieving the main keyword "reclaimed water", it is necessary to avoid an interference sentence containing "reclaimed water" but lacking effective information; the common regenerated water policy related sentences comprise fields such as 'industry', 'greening', 'rate', 'percent', and the like, so that the fields are put into a secondary keyword list, secondary screening is performed through the secondary keywords, and the keyword screening efficiency is improved.
Step S104: and retrieving target keyword information from the target file information according to a preset keyword list, and storing the target keyword information.
Specifically, text information and punctuation information are extracted from the target file information; traversing the text information according to the main keyword list to obtain the position information of the main keywords; determining sentences of the main keywords according to the text information, the position information and the punctuation information; judging whether the sentences containing the main keywords contain the secondary keywords or not according to the secondary keyword list; if yes, storing the sentences of the main keywords into a table file; otherwise, the sentence of the main keyword is not stored.
It should be noted that, when searching the primary keywords in the sentences, it can be considered that all sentences containing the primary keywords and secondary keywords in a single target file are stored separately by using a storage space in a preset format, where the storage space can be regarded as a list; and combining all the storage spaces into a table file, wherein the table file is the table file, and the table file contains the retrieval results of the main keywords in all the files.
In the embodiment of the application, after the preset keyword list and the target file information are obtained, traversing searching is carried out on each main keyword in the preset keyword list in the corresponding target file; then extracting sentences in which the main keywords are located, and storing the sentences in a new file; specifically, firstly converting a format of a target file into a docx format, then reading the file, extracting text information and punctuation information in the file, and splicing the text information and the punctuation information to form a character string, wherein the text information refers to non-space text; and then searching the text information, detecting the position information of the main keywords in the text information, and storing the position information of the main keywords in a keyword position list.
After the position of the main keyword is determined, the positions of periods on the left side and the right side of the position of the main keyword can be determined according to the extracted text information and punctuation information, and then sentences in which the main keyword is positioned are extracted according to the positions of the periods; it should be noted that, here, the positions of the periods on the left and right sides of the position where the main keyword is located need to be screened, but not the positions of punctuation marks, so after the punctuation marks are detected, whether the punctuation marks are periods needs to be judged, if yes, the punctuation marks are marked, otherwise, the next punctuation marks are searched.
Judging whether the sentences in which the main keywords are located contain the secondary keywords according to the secondary keyword list; if so, storing the sentence of the main keyword in a table file in a preset format; in the table file, the header of each column is the retrieved file name, and each row of each column is the sentence in which the main keyword is located.
It can be understood that the text information and punctuation information of the file are collected and sorted, so that sentences in which the main keywords are located in the file are extracted, then secondary screening is carried out on the sentences in which the main keywords are located by utilizing the secondary keyword list, filtering of sentences lacking effective information is achieved, accuracy and precision of keyword searching are improved, and efficiency of keyword searching is improved.
It will be appreciated that in retrieving keywords from documents, some documents are not presented in the form of keywords, but are represented in documents in the same meaning as the keywords intended to be retrieved, and thus it is necessary to retrieve similar keywords in this form.
Specifically, determining similar words according to the keywords; traversing the file to obtain the quantity information and the position information of the similar words; acquiring total word number information of a file; acquiring word number information of similar words; determining total word number information of the similar words appearing in the file according to the number information and the word number information of the similar words; determining the word number ratio of the similar words according to the total word number information of the similar words and the total word number information of the file; determining the occurrence frequency of similar words according to the word number duty ratio and a preset proportion range; determining the frequency level of the similar words according to the occurrence frequency of the similar words and the preset frequency level; the frequency levels include low, medium, and high; determining the importance level of the similar words according to the frequency level of the similar words and the preset similar level; the preset similarity level comprises low, medium and high; importance levels include low, medium, and high.
If the importance level of the similar words is high, the similar words are core words of the file; and determining the positions of periods on two sides of the similar words according to the position information of the similar words, and extracting sentences of the similar words between the two periods.
If the importance level of the similar words is medium, carrying out similarity analysis on the similar words and the keywords; judging whether the similar words and the keywords have the same words, if so, respectively analyzing word senses of the similar words and the keywords; judging whether the word senses are the same or not, if so, randomly selecting sentences containing similar words, and determining the sentence sense of each sentence; replacing similar words by using the keywords, and determining the meaning of the replaced sentences; if the sentence meaning of the front and rear sentences is the same, the sentences are marked as key sentences, and the key sentences are extracted and stored.
If the importance level of the similar word is low, the similar word is abandoned.
In the embodiment of the application, the similarity level exists between the similarity words and the keywords, and the similarity level comprises low, medium and high; if the frequency level and the similarity level of the similar words are both high, the importance level of the similar words is high; if the frequency level and the similarity level of the similar words are low, the importance level of the similar words is low; otherwise, the importance level of the similar word is medium.
For similar words with high importance level, after extracting the sentences in which the similar words are located, the sentences on two sides of the sentences need to be further analyzed.
Specifically, judging whether the beginning or the end of the sentence where the similar word is located has a conjunctive word, if so, extracting sentences on two sides of the sentence where the similar word is located and marking the sentences as special sentences; binding and storing the special sentences and sentences in which the corresponding similar words are located; carrying out semantic analysis on the special sentences to determine whether the semantics of the special sentences are explanation of sentences in which similar words are located; extracting special keywords in the special sentences, and binding and storing the special keywords and similar words; by the method, when the keywords are searched, related information bound with the keywords can be synchronously checked, and convenience of information query is improved.
The application also provides a data retrieval system, as shown in fig. 2, which comprises an acquisition module 1 for acquiring a website list; the traversing module 2 is used for traversing the website list to obtain target file information; the establishing module 3 is used for establishing a preset keyword list; and the retrieval module 4 is used for retrieving the target keyword information from the target file information according to a preset keyword list and storing the target keyword information.
In order to better execute the program of the method, the application also provides a terminal, which comprises a memory and a processor.
Wherein the memory may be used to store instructions, programs, code, sets of codes, or sets of instructions. The memory may include a storage program area and a storage data area, wherein the storage program area may store instructions for implementing an operating system, instructions for at least one function, instructions for implementing the above-described data retrieval method, and the like; the storage data area may store data and the like involved in the above-described data retrieval method.
The processor may include one or more processing cores. The processor performs the various functions of the application and processes the data by executing or executing instructions, programs, code sets, or instruction sets stored in memory, calling data stored in memory. The processor may be at least one of an application specific integrated circuit, a digital signal processor, a digital signal processing device, a programmable logic device, a field programmable gate array, a central processing unit, a controller, a microcontroller, and a microprocessor. It will be appreciated that the electronics for implementing the above-described processor functions may be other for different devices, and embodiments of the present application are not particularly limited.
The present application also provides a computer-readable storage medium, for example, comprising: a U-disk, a removable hard disk, a Read Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes. The computer readable storage medium stores a computer program that can be loaded by a processor and that performs the data retrieval method described above.
The above description is only illustrative of the preferred embodiments of the present application and the principles of the technology being employed. It will be appreciated by persons skilled in the art that the scope of the disclosure referred to in the present application is not limited to the specific combinations of technical features described above, but also covers other technical features which may be formed by any combination of the technical features described above or their equivalents without departing from the spirit of the disclosure. Such as the above-mentioned features and the technical features disclosed in the present application (but not limited to) having similar functions are replaced with each other.
Claims (10)
1. A data retrieval method, comprising:
acquiring a website list;
traversing the website list to obtain target file information;
establishing a preset keyword list;
and retrieving target keyword information from the target file information according to a preset keyword list, and storing the target keyword information.
2. The data retrieval method of claim 1, wherein the obtaining a list of web sites comprises:
determining a file name keyword list according to preset file name information;
traversing the file name keyword list and a search engine to obtain website link information;
converting the website link information to obtain original website link information;
and obtaining a website list according to the original website link information.
3. The data retrieval method according to claim 2, further comprising, before obtaining a web site list from the original web site link information, de-duplicating and filtering the original web site link information.
4. The method of claim 1, wherein traversing the website list to obtain the target file information comprises:
identifying the website list to obtain webpage content type information;
and obtaining target file information according to preset webpage processing rules and the webpage content type information.
5. The data retrieval method according to claim 4, wherein the preset web page processing rule includes:
if the web page format is an HTML format and the web page has doc/docx/pdf file downloading links, downloading the doc/docx/pdf file to a first preset path;
if the web page format is an HTML format and the web page does not have doc/docx/pdf file downloading links, acquiring web page text information, and storing the web page text information to a second preset path;
if the web page format is PDF/WORD format, downloading the web page file to a third preset path;
if the web page format is other than HTML, PDF, WORD, the web address is exported, and the web page content of the web address is stored in a fourth preset path.
6. The data retrieval method according to claim 1, wherein the preset keyword list includes a primary keyword list and a secondary keyword list.
7. The data retrieval method according to claim 6, wherein retrieving target keyword information from the target file information according to a preset keyword list, and storing the target keyword information comprises:
extracting text information and punctuation information from the target file information;
traversing the text information according to the main keyword list to obtain the position information of the main keywords;
determining sentences of the main keywords according to the text information, the position information and the punctuation information;
judging whether the sentences containing the main keywords contain the secondary keywords or not according to the secondary keyword list;
if yes, storing the sentences of the main keywords into a table file;
otherwise, the sentence of the main keyword is not stored.
8. A data retrieval system, comprising:
the acquisition module (1) is used for acquiring a website list;
the traversing module (2) is used for traversing the website list to obtain target file information;
the establishing module (3) is used for establishing a preset keyword list;
and the retrieval module (4) is used for retrieving target keyword information from the target file information according to a preset keyword list and storing the target keyword information.
9. A terminal comprising a memory and a processor, the memory having stored thereon computer program instructions capable of being loaded by the processor and performing the method according to any of claims 1-7.
10. A computer readable storage medium, characterized in that a computer program is stored which can be loaded by a processor and which performs the method according to any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310974098.XA CN116701813A (en) | 2023-08-04 | 2023-08-04 | Data retrieval method, system, terminal and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310974098.XA CN116701813A (en) | 2023-08-04 | 2023-08-04 | Data retrieval method, system, terminal and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116701813A true CN116701813A (en) | 2023-09-05 |
Family
ID=87841804
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310974098.XA Pending CN116701813A (en) | 2023-08-04 | 2023-08-04 | Data retrieval method, system, terminal and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116701813A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103221950A (en) * | 2010-05-28 | 2013-07-24 | 崔镇根 | Extended search word selection system and method for selecting extended search word |
| CN103970761A (en) * | 2013-01-28 | 2014-08-06 | 阿里巴巴集团控股有限公司 | Commodity data searching method and device |
| CN107943893A (en) * | 2017-11-16 | 2018-04-20 | 北京奇安信科技有限公司 | A kind of search processing method and device based on internet |
| CN108897861A (en) * | 2018-07-01 | 2018-11-27 | 东莞市华睿电子科技有限公司 | A kind of information search method |
| CN112100330A (en) * | 2020-09-09 | 2020-12-18 | 杭州凡闻科技有限公司 | Theme searching method and system based on artificial intelligence technology |
| CN114443928A (en) * | 2022-01-25 | 2022-05-06 | 西藏民族大学 | Web text data crawler method and system |
| WO2023284612A1 (en) * | 2021-07-14 | 2023-01-19 | 北京锐安科技有限公司 | Subject webpage data capturing method and apparatus, and device and storage medium |
-
2023
- 2023-08-04 CN CN202310974098.XA patent/CN116701813A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103221950A (en) * | 2010-05-28 | 2013-07-24 | 崔镇根 | Extended search word selection system and method for selecting extended search word |
| CN103970761A (en) * | 2013-01-28 | 2014-08-06 | 阿里巴巴集团控股有限公司 | Commodity data searching method and device |
| CN107943893A (en) * | 2017-11-16 | 2018-04-20 | 北京奇安信科技有限公司 | A kind of search processing method and device based on internet |
| CN108897861A (en) * | 2018-07-01 | 2018-11-27 | 东莞市华睿电子科技有限公司 | A kind of information search method |
| CN112100330A (en) * | 2020-09-09 | 2020-12-18 | 杭州凡闻科技有限公司 | Theme searching method and system based on artificial intelligence technology |
| WO2023284612A1 (en) * | 2021-07-14 | 2023-01-19 | 北京锐安科技有限公司 | Subject webpage data capturing method and apparatus, and device and storage medium |
| CN114443928A (en) * | 2022-01-25 | 2022-05-06 | 西藏民族大学 | Web text data crawler method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Hill et al. | Quantifying the impact of dirty OCR on historical text analysis: Eighteenth Century Collections Online as a case study | |
| CN110162750B (en) | Text similarity detection method, electronic device and computer readable storage medium | |
| US7788262B1 (en) | Method and system for creating context based summary | |
| CN107229668B (en) | Text extraction method based on keyword matching | |
| US8630972B2 (en) | Providing context for web articles | |
| CN113158653B (en) | Training method, application method, device and equipment for pre-training language model | |
| CN101620608A (en) | Information collection method and system | |
| WO2011006300A1 (en) | Acronym extraction | |
| CN110866091A (en) | Data retrieval method and device | |
| CN109165373B (en) | Data processing method and device | |
| US20150206101A1 (en) | System for determining infringement of copyright based on the text reference point and method thereof | |
| CN104462532A (en) | Method and device for extracting webpage text | |
| CN112328936A (en) | Website identification method, device and equipment and computer readable storage medium | |
| US8862586B2 (en) | Document analysis system | |
| CN113868568A (en) | Webpage keyword highlighting method, device, equipment and storage medium | |
| CN112687403B (en) | Medicine dictionary generation and medicine search method and device | |
| JP2693914B2 (en) | Search system | |
| CN111160445B (en) | Bid file similarity calculation method and device | |
| CN116701813A (en) | Data retrieval method, system, terminal and storage medium | |
| CN115796146A (en) | File comparison method and device | |
| CN115794745A (en) | File searching method, system, device and storage medium | |
| CN112230989B (en) | Webpage channel navigation bar extraction method, system, electronic equipment and storage medium | |
| CN114168534A (en) | Method, system, device and medium for accelerating ES file to carry out local full-text retrieval | |
| JP2009205499A (en) | Web page specification apparatus, web page specification method, and program for specifying web page | |
| CN114218347A (en) | Method for quickly searching index of multiple file contents |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |