CN108460109A - A kind of information on bidding analysis method based on big data - Google Patents
A kind of information on bidding analysis method based on big data Download PDFInfo
- Publication number
- CN108460109A CN108460109A CN201810127376.7A CN201810127376A CN108460109A CN 108460109 A CN108460109 A CN 108460109A CN 201810127376 A CN201810127376 A CN 201810127376A CN 108460109 A CN108460109 A CN 108460109A
- Authority
- CN
- China
- Prior art keywords
- data
- bidding
- analysis
- bid
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/3331—Query processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/176—Support for shared access to files; File sharing support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/31—Indexing; Data structures therefor; Storage structures
- G06F16/316—Indexing structures
- G06F16/325—Hash tables
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/08—Auctions
Abstract
The information on bidding analysis method based on big data that the present invention provides a kind of, including step：The bid data of multiple bidding websites are obtained in real time, and are uploaded to data processing system；Data processing system handles the bid data of upload, analysis result data is periodically extracted from data processing system, and store and arrive Database Systems.Beneficial effects of the present invention are：The information on bidding analysis method based on big data that the present invention provides a kind of, it is that preset data unit establishes more set hash indexes to choose the keyword in information on bidding, facilitates classification searching, analysis data, improves recall precision.
Description
Technical field
The present invention relates to bidding field, more particularly to a kind of information on bidding analysis method based on big data.
Background technology
Bid is a kind of commonly used in the world, organized market trading activity with bid, is engineering, cargo or clothes
The dealing of business trade.Typically purchaser offers and requires in advance, and numerous trading objects is invited to participate in competition simultaneously
Conclusion of the business person is therefrom selected according to the program of regulation.Bidding activity to break trade monopoly and barriers between the regions, increase economic efficiency,
Ensure that project quality, prevention and reduction corruption etc. have played important function, has become the weight for promoting modern market system construction
Want means.
Information-based development brings the new situation in bidding field, and originally bidder mainly obtains item by periodicals and magazines
The mode of mesh bidding information is transformed to obtains the information for being suitble to oneself to submit a tender by internet site.One kind of bidder
Way is to log in each bidding website of various regions to obtain information, and then being retrieved and being investigated one by one by artificial mode needs
The information wanted.Another more efficient way is to log in some large-scale bidding information sites, passes through full-text search
The bidding information that mode removal search needs.
However, this mode takes time and effort, while the included search of bidding website cannot guarantee that quality, this is resulted in
Mistake misses important information.And by logging in large-scale bidding information site, it is gone by way of full-text search
Search for the bidding information needed, it is matched of low quality also due to use fuzzy matching algorithm, caused by the nothing that searches out
It imitates data and is more than valid data, more frighteningly miss more valuable informations.
Invention content
To solve the above-mentioned problems, the information on bidding analysis method based on big data that the present invention provides a kind of, including step
Suddenly：
S100 the bid data of multiple bidding websites) are obtained in real time, and are uploaded to data processing system；
S200) data processing system handles the bid data of upload, by the bid number of the multiple bidding website
The form of chained list is stored in preset data unit according to this；It is looked into using more sets index of the pre-set preset data unit
The bid data are ask, information on bidding analysis is carried out according to the bid data that inquiry obtains；Wherein, more set indexes are
It is the hash index that the preset data unit is established to choose the keyword in the information on bidding；The result data is carried out
All kinds of figure displayings；After real-time analysis server startup, receive what off-line analysis server was sent according to the first analysis result
History information on bidding data；First analysis result is before real-time analysis server startup, according to first default point
The analysis result that analysis strategy is formed；Obtain the current bid data corresponding to current bidding website；According to described first default point
Analysis strategy analyzes the history bid data and the current bid data, obtains the second analysis result.
S300 analysis result data) is periodically extracted from data processing system, and is stored and arrived Database Systems.
Preferably, the bid data include project name, project number, bid the time, submit a tender the time, the place of the bid submission,
Open bid time, opening of bid place, budget amount, procurement unit, procurement unit contact person, procurement unit's contact method, procurement unit
Address, agency, agency contact person, agency's contact method, agency address, buying content, attachment documents
Preferably, first analysis result and second analysis result are including at least one bidding website
Set.
Preferably, a bidding website corresponds at least two informations on bidding.
Preferably, the first presupposition analysis of foundation strategy analyzes the history bid data and the current bid number
According to obtaining the second analysis result includes：According to the first presupposition analysis strategy and operation behavior, each described bid is determined
The corresponding assay value of website；The assay value is ranked up, is met described in I of the first preset condition according to ranking results
The corresponding bidding website of assay value forms second analysis result.
Preferably, the chained list is provided with a maximum storage quantity, according to maximum storage number of cycles storage
Information on bidding.
Preferably, further include being based on preset white list data, judgement when the data processing system starts a process
When one process is not recorded in the white list data, the first specified shared library file is loaded into the process and is corresponded to
The process space, the first shared library file is for describing a series of policer operations；According in the described first shared library file
The policer operation information of record, crawl run the bid data that a process is related to；Bid data based on acquisition, for trick
It marks website and carries out corresponding analysis.
Beneficial effects of the present invention are：The information on bidding analysis method based on big data that the present invention provides a kind of is chosen
Keyword in information on bidding is that preset data unit establishes more set hash indexes, facilitates classification searching, analysis data, improves
Recall precision.
Description of the drawings
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention without having to pay creative labor, may be used also for those of ordinary skill in the art
To obtain other attached drawings according to these attached drawings.
Fig. 1 show a kind of flow chart of information on bidding analysis method based on big data provided by the invention；
Specific implementation mode
The technique effect of the design of the present invention, concrete structure and generation is carried out below with reference to embodiment and attached drawing clear
Chu, complete description, to be completely understood by the purpose of the present invention, scheme and effect.It should be noted that the case where not conflicting
Under, the features in the embodiments and the embodiments of the present application can be combined with each other.The identical attached drawing mark used everywhere in attached drawing
Note indicates same or analogous part.
Fig. 1 show a kind of flow chart of information on bidding analysis method based on big data provided by the invention.According to this
One embodiment of invention, a kind of information on bidding analysis method based on big data, including step：
S100 the bid data of multiple bidding websites) are obtained in real time, and are uploaded to data processing system；
S200) data processing system handles the bid data of upload, by the bid number of the multiple bidding website
The form of chained list is stored in preset data unit according to this；It is looked into using more sets index of the pre-set preset data unit
The bid data are ask, information on bidding analysis is carried out according to the bid data that inquiry obtains；Wherein, more set indexes are
It is the hash index that the preset data unit is established to choose the keyword in the information on bidding；The result data is carried out
All kinds of figure displayings；After real-time analysis server startup, receive what off-line analysis server was sent according to the first analysis result
History information on bidding data；First analysis result is before real-time analysis server startup, according to first default point
The analysis result that analysis strategy is formed；Obtain the current bid data corresponding to current bidding website；According to described first default point
Analysis strategy analyzes the history bid data and the current bid data, obtains the second analysis result.
S300 analysis result data) is periodically extracted from data processing system, and is stored and arrived Database Systems.
According to one embodiment of present invention, the bid data include step painstakingly：
A. data processing system handles the bid data of upload, by the bid data of the multiple bidding website with
The form of chained list is stored in preset data unit；
B. call for bid data described in more set search indexs using the pre-set preset data unit, according to inquiring
The bid data arrived carry out information on bidding analysis；
C. the result data is subjected to all kinds of figure displayings；
D. after real-time analysis server startup, the history that off-line analysis server is sent according to the first analysis result is received
Information on bidding data；
F. first analysis result is before real-time analysis server startup, according to the first presupposition analysis strategy shape
At analysis result
G. the current bid data corresponding to current bidding website are obtained；
H. according to the first presupposition analysis strategy, the history bid data and the current bid data is analyzed, are obtained
Obtain the second analysis result.
According to one embodiment of present invention, the bid data include project name, project number, the bid time, throw
Mark time, the place of the bid submission, opening of bid time, opening of bid place, budget amount, procurement unit, procurement unit contact person, procurement unit's connection
It is mode, procurement unit address, agency, agency contact person, agency's contact method, agency address, adopts
Purchase content, attachment documents
According to one embodiment of present invention, first analysis result and second analysis result are including at least
The set of one bidding website, a bidding website correspond at least two informations on bidding；The foundation first is default
Analysis strategy analyzes the history bid data and the current bid data, obtains the second analysis result and includes：According to described in
First presupposition analysis strategy and operation behavior determine the corresponding assay value of each bidding website；To the assay value
It is ranked up, the corresponding bidding website of the described assay values of I that the first preset condition is met according to ranking results forms described the
Two analysis results.The chained list is provided with a maximum storage quantity, and the bid is stored according to the maximum storage number of cycles
Information.
According to one embodiment of present invention, when the data processing system starts a process, it is based on preset white name
The first specified shared library file is loaded by forms data when judging that a process is not recorded in the white list data
The corresponding process space of the process, the first shared library file is for describing a series of policer operations；According to described first
The policer operation information recorded in shared library file, crawl run the bid data that a process is related to；Trick based on acquisition
Data are marked, corresponding analysis is carried out for bidding website.
The present invention selects kafka to handle bid data, and kafka is a kind of distributed post system of high-throughput
System, it can handle the everything flow data in fairly large website, have the property that：
I. the persistence of data is provided by the disk data structure of 0 (1), even if this structure is for counting the data with TB
Storage can also keep prolonged stability；
Ii. high-throughput：Even very common hardware kafka can also support hundreds thousand of message per second.
Iii. it supports through kafka servers come subregion message；
Iv. the load of Hadoop parallel datas is supported.
According to one embodiment of present invention, data management selects mysq1, mysq1 to have for storing different data
The tables of data of tables of data, different data can easily store different data, and also have both small, speed and soon, totally possess
The characteristics of at low cost, open source code.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all
Any modification, equivalent replacement, improvement and so within the spirit and principles in the present invention, are all contained in protection scope of the present invention
It is interior.
It should be noted that：
Algorithm and display be not inherently related to any certain computer, virtual bench or miscellaneous equipment provided herein.
Various fexible units can also be used together with teaching based on this.As described above, it constructs required by this kind of device
Structure be obvious.In addition, the present invention is not also directed to any certain programmed language.It should be understood that can utilize various
Programming language realizes the content of invention described herein, and the description done above to language-specific is to disclose this hair
Bright preferred forms.
In the instructions provided here, numerous specific details are set forth.It is to be appreciated, however, that the implementation of the present invention
Example can be put into practice without these specific details.In some instances, well known method, structure is not been shown in detail
And technology, so as not to obscure the understanding of this description.
Similarly, it should be understood that in order to simplify the disclosure and help to understand one or more of each inventive aspect,
Above in the description of exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes
In example, figure or descriptions thereof.However, the method for the disclosure should be construed to reflect following intention：It is i.e. required to protect
Shield the present invention claims the more features of feature than being expressly recited in each claim.More precisely, as following
Claims reflect as, inventive aspect is all features less than single embodiment disclosed above.Therefore,
Thus the claims for following specific implementation mode are expressly incorporated in the specific implementation mode, wherein each claim itself
All as a separate embodiment of the present invention.
Those skilled in the art, which are appreciated that, to carry out adaptively the module in the equipment in embodiment
Change and they are arranged in the one or more equipment different from the embodiment.It can be the module or list in embodiment
Member or component be combined into a module or unit or component, and can be divided into addition multiple submodule or subelement or
Sub-component.Other than such feature and/or at least some of process or unit exclude each other, it may be used any
Combination is disclosed to all features disclosed in this specification (including adjoint claim, abstract and attached drawing) and so to appoint
Where all processes or unit of method or equipment are combined.Unless expressly stated otherwise, this specification (including adjoint power
Profit requires, abstract and attached drawing) disclosed in each feature can be by providing the alternative features of identical, equivalent or similar purpose come generation
It replaces.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments
In included certain features rather than other feature, but the combination of the feature of different embodiments means in of the invention
Within the scope of and form different embodiments.For example, in the following claims, embodiment claimed is appointed
One of meaning mode can use in any combination.
The all parts embodiment of the present invention can be with hardware realization, or to run on one or more processors
Software module realize, or realized with combination thereof.It will be understood by those of skill in the art that can use in practice
Microprocessor or digital signal processor (DSP) realize the information on bidding Analysis Service according to the ... of the embodiment of the present invention that provides
The some or all functions of some or all components in device.The present invention is also implemented as being retouched here for executing
The some or all equipment or program of device (for example, computer program and computer program product) for the method stated.
It is such to realize that the program of the present invention may be stored on the computer-readable medium, or can have one or more signal
Form.Such signal can be downloaded from internet website and be obtained, either provide on carrier signal or with it is any its
He provides form.
It should be noted that the present invention will be described rather than limits the invention for above-described embodiment, and ability
Field technique personnel can design alternative embodiment without departing from the scope of the appended claims.
In addition, with the foreseeable embodiment of inventor, present invention is described above, it is useful its purpose is to provide
Description, and those it is still unforeseen at present to the present invention unsubstantialities change can still represent the present invention equivalent modifications.
Claims (7)
1. a kind of information on bidding analysis method based on big data, which is characterized in that including step：
S100 the bid data of multiple bidding websites) are obtained in real time, and are uploaded to data processing system；
S200) data processing system handles the bid data of upload, by the bid data of the multiple bidding website with
The form of chained list is stored in preset data unit；Utilize more set search index institutes of the pre-set preset data unit
Bid data are stated, information on bidding analysis is carried out according to the bid data that inquiry obtains；Wherein, more set indexes are to choose
Keyword in the information on bidding is the hash index that the preset data unit is established；The result data is carried out all kinds of
Figure is shown；After real-time analysis server startup, the history that off-line analysis server is sent according to the first analysis result is received
Information on bidding data；First analysis result is before real-time analysis server startup, according to the first presupposition analysis plan
The analysis result slightly formed；Obtain the current bid data corresponding to current bidding website；According to the first presupposition analysis plan
Slightly, the history bid data and the current bid data are analyzed, the second analysis result is obtained.
S300 analysis result data) is periodically extracted from data processing system, and is stored and arrived Database Systems.
2. a kind of information on bidding analysis method based on big data according to claim 1, which is characterized in that the bid
Data include project name, project number, bid time, time of submitting a tender, the place of the bid submission, opening of bid time, opening of bid place, budget gold
Volume, procurement unit, procurement unit contact person, procurement unit's contact method, procurement unit address, agency, agency's connection
It is people, agency's contact method, agency address, buying content, attachment documents.
3. a kind of information on bidding analysis method based on big data according to claim 1, which is characterized in that described first
Analysis result and second analysis result are to include the set of at least one bidding website.
4. a kind of information on bidding analysis method based on big data according to claim 3, which is characterized in that described in one
Bidding website corresponds at least two informations on bidding.
5. a kind of information on bidding analysis method based on big data according to claim 1, which is characterized in that the foundation
First presupposition analysis strategy analyzes the history bid data and the current bid data, obtains the second analysis result and includes：
According to the first presupposition analysis strategy and operation behavior, the corresponding assay value of each bidding website is determined；To institute
It states assay value to be ranked up, the corresponding bidding website shape of the assay value of I according to ranking results the first preset condition of satisfaction
At second analysis result.
6. a kind of information on bidding analysis method based on big data according to claim 1, which is characterized in that the chained list
It is provided with a maximum storage quantity, the information on bidding is stored according to the maximum storage number of cycles.
7. a kind of information on bidding analysis method based on big data according to claim 1, which is characterized in that further include working as
When the data processing system starts a process, it is based on preset white list data, it is described to judge that a process is not recorded in
When in white list data, the first specified shared library file is loaded into the corresponding process space of the process, described first is total
Library file is enjoyed for describing a series of policer operations；According to the policer operation information recorded in the described first shared library file, grab
It takes and runs the bid data that a process is related to；Bid data based on acquisition carry out corresponding analysis for bidding website.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810127376.7A CN108460109A (en) | 2018-02-08 | 2018-02-08 | A kind of information on bidding analysis method based on big data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810127376.7A CN108460109A (en) | 2018-02-08 | 2018-02-08 | A kind of information on bidding analysis method based on big data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108460109A true CN108460109A (en) | 2018-08-28 |
Family
ID=63239910
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810127376.7A Pending CN108460109A (en) | 2018-02-08 | 2018-02-08 | A kind of information on bidding analysis method based on big data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108460109A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112419011A (en) * | 2020-12-14 | 2021-02-26 | 国泰新点软件股份有限公司 | Public resource transaction recommendation method and device and computer-readable storage medium |
| CN116029803B (en) * | 2023-03-31 | 2023-06-02 | 上海百通项目管理咨询有限公司 | Intelligent bidding method and system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105718580A (en) * | 2016-01-25 | 2016-06-29 | 江苏国泰新点软件有限公司 | Method and device for providing bidding information search service |
| CN107341619A (en) * | 2017-07-22 | 2017-11-10 | 江苏省鸿源招标代理股份有限公司 | A kind of bid information acquisition system and method |
| CN107451269A (en) * | 2017-07-28 | 2017-12-08 | 佛山市南方数据科学研究院 | A kind of user behavior analysis method based on big data |
-
2018
- 2018-02-08 CN CN201810127376.7A patent/CN108460109A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105718580A (en) * | 2016-01-25 | 2016-06-29 | 江苏国泰新点软件有限公司 | Method and device for providing bidding information search service |
| CN107341619A (en) * | 2017-07-22 | 2017-11-10 | 江苏省鸿源招标代理股份有限公司 | A kind of bid information acquisition system and method |
| CN107451269A (en) * | 2017-07-28 | 2017-12-08 | 佛山市南方数据科学研究院 | A kind of user behavior analysis method based on big data |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112419011A (en) * | 2020-12-14 | 2021-02-26 | 国泰新点软件股份有限公司 | Public resource transaction recommendation method and device and computer-readable storage medium |
| CN116029803B (en) * | 2023-03-31 | 2023-06-02 | 上海百通项目管理咨询有限公司 | Intelligent bidding method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107547214B (en) | Group's reading method, electronic equipment and computer storage medium based on e-book | |
| CN104077306B (en) | The result ordering method and system of a kind of search engine | |
| Müller | How to choose a free and open source integrated library system | |
| CN103778548B (en) | Merchandise news and key word matching method, merchandise news put-on method and device | |
| Hardin et al. | On using mixed-initiative control: A perspective for managing large-scale robotic teams | |
| US20070250500A1 (en) | Multi-directional and auto-adaptive relevance and search system and methods thereof | |
| CA2612895A1 (en) | Systems and methods for providing search results | |
| CN108415969A (en) | A kind of information on bidding retrieval analysis method and system | |
| CN109885452A (en) | Method for monitoring performance, device and terminal device | |
| Beck et al. | Multiple criteria decision making in supply chain management–currently available methods and possibilities for future research | |
| CN106095842A (en) | Online course searching method and device | |
| CN109241455B (en) | Recommended object display method and device | |
| CN108460109A (en) | A kind of information on bidding analysis method based on big data | |
| Cheung et al. | An agent‐oriented and knowledge‐based system for strategic e‐procurement | |
| CN109976622A (en) | Books label determines method, electronic equipment and computer storage medium | |
| CN108491426A (en) | A kind of information on bidding supplying system | |
| CN108415968A (en) | A kind of acquisition method of information on bidding | |
| Ling et al. | National research planning accelerates relevance and immediacy of climate-adaptation science | |
| KR20210007632A (en) | Computer program for registering and managing product through online market api based on product-specific schedule and operation method thereof | |
| CN106569734B (en) | The restorative procedure and device that memory overflows when data are shuffled | |
| CN100543719C (en) | The system and method that is used for externalizable inference component | |
| CN108009735B (en) | Resume evaluation method and device | |
| Nouri et al. | Meta-heuristics algorithm for two-machine no-wait flow-shop scheduling problem with the effects of learning | |
| CN113362102B (en) | Client cable distribution method, system and storage medium | |
| CN114118770A (en) | Index calculation method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180828 |