CN105282104A - Data retrieval system based on cloud computing and webpage parsing technology - Google Patents
Data retrieval system based on cloud computing and webpage parsing technology Download PDFInfo
- Publication number
- CN105282104A CN105282104A CN201410311672.4A CN201410311672A CN105282104A CN 105282104 A CN105282104 A CN 105282104A CN 201410311672 A CN201410311672 A CN 201410311672A CN 105282104 A CN105282104 A CN 105282104A
- Authority
- CN
- China
- Prior art keywords
- server
- data
- party
- cloud computing
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a data retrieval system based on cloud computing and webpage parsing technologies. The data retrieval system comprises a mobile terminal connected with servers through a network, a cloud computing server, a third-party data server and a third-party pushing server, wherein the mobile terminal is used for completing man-machine interaction with a user, the cloud computing server offers a mass html data processing function, the third-party data server is used for offering data retrieval and query services and recording user access records and data, and the third-party pushing server is used for offering a downlink informing channel from the servers to a client. The data retrieval system combines the intelligent terminal, the webpage parsing technology, the cloud computing technology and the like, achieves richer information services, allows the user to obtain information of interest clearly and accurately anytime and anywhere, can filter out advertisement for the user, and saves data traffic and internet surfing expense for the user.
Description
Technical field
The present invention relates to a kind of data retrieval system based on cloud computing and web analysis technology, relate to communication technical field, web analysis technical field, field of cloud calculation.
Background technology
Along with the continuous progress of science and technology, intelligent terminal is popularized rapidly, and good linking Internet allows user can obtain abundanter information service by intelligent terminal whenever and wherever possible, and therefore mobile Internet business becomes focus.Current webpage is all the equipment towards having large scale screen, and thus user can not arbitraryly on the equipment that screen size is less browse, and then can have a greatly reduced quality on Consumer's Experience.Meanwhile, advertising service gets more and more, and various page ad, bullet window advertisement applications have to the greatest extent, on mobile intelligent terminal during browsing page, these advertisements not only can cause user misoperation, but also can consume the data traffic of user in a large number, and then adding users expenses of surfing Internet.
In large data processing, mobile intelligent terminal is limited in one's ability, if the process of mass data be entirely placed on mobile intelligent terminal, that will certainly cause software responses slow, and then reduce Consumer's Experience sense.And in information service, cloud computing technology is also fast-developing, if carry out the process of mass data with cloud computing, that will alleviate the pressure of mobile intelligent terminal greatly, also a large amount of advertisement filter can be fallen simultaneously, the use of user data traffic can also be reduced, save user's expenses of surfing Internet.
Summary of the invention
The object of the present invention is to provide a kind of data retrieval system based on cloud computing and web analysis technology, can make user can whenever and wherever possible, clearly know interested information on services accurately, user friendly life, study and work.
The present invention adopts following technical scheme to realize:
Based on a data retrieval system for cloud computing and web analysis technology, it is characterized in that, this system comprises the mobile terminal, cloud computing server, third party's data server, the third party's push server that are connected with server by network, wherein:
Mobile terminal: mobile terminal has client logic unit, for completing the man-machine interaction with user, after described client logic unit receiving the request of user, can obtain data according to concrete request to different server units, and being shown to user;
Cloud computing server: cloud computing server is used for accepting client-requested, then according to request content to third party's data server requests data, by Data Analysis packing process after, pass to downwards initiate request client;
Third party's data server: described third party's data server is used for providing data retrieval service; User is provided to register and login feature; The data of recording user: collection and query history; Information pushing function is provided according to the data of user;
Third party's push server: described third party's push server is for providing by the descending notice passage of server to client end;
Further, described third party's data server can be database server, also can Website server; Described third party's push server is the APNS of C2DM, Apple of GoogleAndroid.
Further, described mobile terminal has Man Machine Interface, described Man Machine Interface is for receiving the operational order of user, and instruction is sent to cloud computing server or third party's data server logical block, Man Machine Interface receives the feedback result from cloud computing server or third party's data server logical block simultaneously, and gives user information displaying; Described client logic unit, for receiving the operational order transmitted from Man Machine Interface, after analyzing and processing, calls corresponding server interface and processes, and the result feedback of server process to Man Machine Interface unit.
Data retrieval system based on cloud computing and web analysis technology of the present invention can combined with intelligent terminal, the technology such as cloud computing and data mining, abundanter information retrieval and inquiry service can be realized, greatly can alleviate the calculating pressure of mobile intelligent terminal, can may cause the advertisement of misoperation for user filtering, surfing flow and expense can be saved for user.User can whenever and wherever possible, clear know oneself interested information exactly, user friendly daily life, improve Consumer's Experience sense.
Accompanying drawing explanation
Fig. 1 is system construction drawing of the present invention;
Fig. 2 is the mutual flow chart of mobile intelligent terminal and cloud computing server;
Fig. 3 is the mutual flow chart of mobile intelligent terminal and third party's data server;
Fig. 4 is the flow chart carrying out information reminding propelling movement;
Fig. 5 is mobile intelligent terminal system construction drawing.
Embodiment
To retrieve with college libraries collection information of number below; Readers ' Borrowing Books information inquiry; library's notice bulletin inquiry and propelling movement are example; by the description to embodiment; to more contribute to public understanding the present invention; but the restriction that the specific embodiment given by applicant can't be considered as technical solution of the present invention, any definition to parts or technical characteristic change and/or to overall structure do form and immaterial conversion all should be considered as the protection range that technical scheme of the present invention limits.
As shown in Figure 1, mobile terminal completes this data retrieval based on cloud computing and web analysis technology and inquiry system function jointly by network and cloud computing server interface, third party's data server interface, third party's push server interface, third party's push server interface.The following is the detailed introduction of unit in system architecture diagram:
Mobile intelligent terminal: mobile intelligent terminal completes the man-machine interaction with user, after client logic unit receives the request of user, can obtain data according to concrete request to different server units, and be shown to user;
Cloud computing server: cloud computing server is used for accepting client-requested, then according to request content to third party's data server requests data, after the webpage html formatted data returned by third party's data server resolves packing process, pass to the client of the request of initiation downwards;
Third party's data server: third party's data server, for providing data retrieval and inquiry service; User is provided to register and login feature; The data of recording user: collection and query history; Data according to user provide the push function such as information reminding;
Third party's push server: third party's push server provides the descending notice passage by server to client end, as the APNS of the C2DM of GoogleAndroid, Apple.When server needs initiatively to send information to mobile terminal, need the passage utilizing third party's push server to provide.
SMS sends server: mobile SP passage also can provide the down going channel function that third party's push server is identical.
Interface 1: the interface between mobile terminal and cloud computing server, this interface mainly comprises: the retrieval, inquiry, parsing, packing passback etc. of data;
Interface 2: mobile terminal and third party's DSU interface, comprise two class interfaces: data manipulation relevant interface; Push channel interface;
Interface 3: cloud computing server and third party's DSU interface;
After system architecture, be next that the idiographic flow of this example is implemented.
Fig. 2 is the mutual flow chart of mobile intelligent terminal and cloud computing server.The business that mobile terminal and cloud computing server mainly complete is retrieval and the inquiry of mass data:
Step 200: when using mobile terminal, user submits data retrieval or inquiry request by Man Machine Interface to TLU terminal logic unit;
Step 201: after mobile terminal logical block accepts the request of Man Machine Interface, submits data retrieval or inquiry request to cloud computing server;
Step 202: after cloud computing server accepts the request of mobile terminal, according to concrete request content, to third party's data server requests data.
Step 203: the data of a large amount of webpage html structures are returned to cloud computing server and process by third party's data server;
Step 204: the data of cloud computing server to html form are resolved, and filter out advertisement wherein and garbage, extracted valid data, and valid data are packed packaged after return to mobile terminal;
Step 205: data and are shown to user by the data after what mobile terminal accepted to return with calculation server handle well.
Fig. 3 is the mutual flow chart of mobile intelligent terminal and third party's data server.Can initiate the data retrieval relevant to oneself or inquiry request directly to third party's data server under the state that user logs in, meanwhile, the retrieval of user or query history also can carry out record at server.
Step 301: user initiates the data retrieval relevant to oneself or inquiry request by mobile terminal to third party's data server;
Step 302: third party's data server is after the request receiving mobile terminal, and according to concrete request content return data to mobile terminal, recording user accesses the record or data that produce simultaneously;
Step 303: mobile terminal shows to user the data that third party's data server returns.
These collections and query history record can be used as the value-added service to user simultaneously.
Fig. 4 is the flow process utilizing these records to carry out information reminding propelling movement:
Step 401: in system use procedure, user is interested or that be concerned about, and information may be changed or upgrade, if changed, goes to step 402;
Step 402: third party's data server, by relevant information, by third party's push server, is pushed to mobile terminal.
Fig. 5 is the system configuration of mobile terminal, mainly comprises:
1, Man Machine Interface: Man Machine Interface realizes the mutual of user and mobile terminal.Man Machine Interface receives the operational order of user, and instruction is sent to the client logic unit of mobile terminal.Meanwhile, Man Machine Interface receives the feedback result of cloud computing server or third party's data server, and gives user information displaying;
2, mobile terminal client terminal logical block: mobile terminal client terminal logical block is the brain of mobile terminal, request and the corresponding of server of all users all must through this element process.Mainly comprise, receive the operational order transmitted from Man Machine Interface, after analyzing and processing, call corresponding server interface and process, and the result feedback of server process to Man Machine Interface unit.Sometimes logical block will complete an operational order in conjunction with multiple server interface;
3, with cloud computing server interface: this interface is the main interface of cloud computing server, disclosed the detailed embodiment of this interface;
4, with third party's data server interface: when mobile terminal is directly mutual with it, may have access to and user-dependent data message, and server record user's operation information can be allowed;
5, with third party's push server interface: third party's data server with this interface to mobile terminal pushed information.
By above specific embodiment to invention has been detailed description, but these are not construed as limiting the invention.Without departing from the principles of the present invention, those skilled in the art also can make many distortion and improvement, and these also should be considered as protection scope of the present invention.
Claims (3)
1., based on a data retrieval system for cloud computing and web analysis technology, it is characterized in that, this system comprises the mobile terminal, cloud computing server, third party's data server, the third party's push server that are connected with server by network, wherein:
Mobile terminal: mobile terminal has client logic unit, for completing the man-machine interaction with user, after described client logic unit receiving the request of user, can obtain data according to concrete request to different server units, and being shown to user;
Cloud computing server: cloud computing server is used for accepting client-requested, then according to request content to third party's data server requests data, by Data Analysis packing process after, pass to downwards initiate request client;
Third party's data server: described third party's data server is used for providing data retrieval service; User is provided to register and login feature; The data of recording user: collection and query history; Information pushing function is provided according to the data of user;
Third party's push server: described third party's push server is for providing by the descending notice passage of server to client end.
2. the data retrieval system based on cloud computing and web analysis technology according to claim 1, it is characterized in that, described third party's data server can be database server, also can be Website server; Described third party's push server is the APNS of C2DM, Apple of GoogleAndroid.
3. the data retrieval system based on cloud computing and web analysis technology according to claim 1 and 2, it is characterized in that, described mobile terminal has Man Machine Interface, described Man Machine Interface is for receiving the operational order of user, and instruction is sent to cloud computing server or third party's data server logical block, Man Machine Interface receives the feedback result from cloud computing server or third party's data server logical block simultaneously, and gives user information displaying; Described client logic unit, for receiving the operational order transmitted from Man Machine Interface, after analyzing and processing, calls corresponding server interface and processes, and the result feedback of server process to Man Machine Interface unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410311672.4A CN105282104A (en) | 2014-07-01 | 2014-07-01 | Data retrieval system based on cloud computing and webpage parsing technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410311672.4A CN105282104A (en) | 2014-07-01 | 2014-07-01 | Data retrieval system based on cloud computing and webpage parsing technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105282104A true CN105282104A (en) | 2016-01-27 |
Family
ID=55150443
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410311672.4A Pending CN105282104A (en) | 2014-07-01 | 2014-07-01 | Data retrieval system based on cloud computing and webpage parsing technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105282104A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106510295A (en) * | 2016-10-27 | 2017-03-22 | 乐视控股（北京）有限公司 | Intelligent infant bed for infant nursing, server and method |
| CN108270798A (en) * | 2018-03-25 | 2018-07-10 | 上海金亥通信设备有限公司 | A kind of mobile terminal device safety management system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102024028A (en) * | 2010-11-22 | 2011-04-20 | 百度在线网络技术（北京）有限公司 | Method and equipment for distinctly displaying main contents of webpage on mobile terminal |
| CN103051684A (en) * | 2012-12-07 | 2013-04-17 | 百度在线网络技术（北京）有限公司 | Method, system and device for converting website into Web App for displaying |
| CN103237088A (en) * | 2013-05-16 | 2013-08-07 | 百度在线网络技术（北京）有限公司 | Corresponding relation library-based browsing method and system and cloud server |
| CN103530560A (en) * | 2013-09-29 | 2014-01-22 | 北京金山网络科技有限公司 | Method, device and client side for advertisement blocking |
| CN103544178A (en) * | 2012-07-13 | 2014-01-29 | 百度在线网络技术（北京）有限公司 | Method and equipment for providing reconstruction page corresponding to target page |
-
2014
- 2014-07-01 CN CN201410311672.4A patent/CN105282104A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102024028A (en) * | 2010-11-22 | 2011-04-20 | 百度在线网络技术（北京）有限公司 | Method and equipment for distinctly displaying main contents of webpage on mobile terminal |
| CN103544178A (en) * | 2012-07-13 | 2014-01-29 | 百度在线网络技术（北京）有限公司 | Method and equipment for providing reconstruction page corresponding to target page |
| CN103051684A (en) * | 2012-12-07 | 2013-04-17 | 百度在线网络技术（北京）有限公司 | Method, system and device for converting website into Web App for displaying |
| CN103237088A (en) * | 2013-05-16 | 2013-08-07 | 百度在线网络技术（北京）有限公司 | Corresponding relation library-based browsing method and system and cloud server |
| CN103530560A (en) * | 2013-09-29 | 2014-01-22 | 北京金山网络科技有限公司 | Method, device and client side for advertisement blocking |
Non-Patent Citations (1)
| Title |
|---|
| 郁晓华: "《个人学习环境中的自主学习：转变与实现》", 30 November 2013 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106510295A (en) * | 2016-10-27 | 2017-03-22 | 乐视控股（北京）有限公司 | Intelligent infant bed for infant nursing, server and method |
| CN108270798A (en) * | 2018-03-25 | 2018-07-10 | 上海金亥通信设备有限公司 | A kind of mobile terminal device safety management system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102202100B (en) | Method for processing network data by micro browser, micro browser and server thereof | |
| CN101150803A (en) | Method for micro-browser to process network data, micro-browser and its server | |
| CN104253741B (en) | A kind of method for sending information, relevant apparatus and system | |
| US10148541B2 (en) | Location-based website hosting optimization | |
| CN102208991A (en) | Blog processing method, device and system | |
| CN103064863A (en) | Method and equipment of providing recommend information | |
| CN103605739A (en) | Method and device for displaying thermodynamic diagrams | |
| CN104618488A (en) | Information processing method, client side and server | |
| CN104022940A (en) | Information processing method, device and system based on instant messaging (IM) | |
| US20150339686A1 (en) | Enhanced data collection, processing, and analysis | |
| CN104850546A (en) | Mobile media information display method and system | |
| CN102541853A (en) | Method and device which are capable of obtaining application information by utilizing browser address bar | |
| CN104426985A (en) | Method, device and system for displaying webpage | |
| CN109977296A (en) | A kind of information-pushing method, device, equipment and storage medium | |
| CN103440260A (en) | Method and equipment used for providing representation information | |
| CN104834698A (en) | Information pushing method and device | |
| CN104881774A (en) | Method and apparatus for automatically establishing schedule | |
| CN103618773A (en) | Display method, device and system for thermodynamic diagrams | |
| CN112784152A (en) | Method and device for marking user | |
| CN104901961A (en) | Data pushing method, server, terminal and system | |
| CN103354556A (en) | Message prompt method used for realizing sharing user and equipment thereof | |
| US20180324264A1 (en) | System for location-based website hosting optimization | |
| CN101354706A (en) | Method and apparatus for collecting web page information | |
| CN106557584A (en) | A kind of web site collection method and device | |
| CN102760157B (en) | A kind of for generating the method that release news, device and the equipment corresponding with mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160127 |
|
| WD01 | Invention patent application deemed withdrawn after publication |