CN105404672B - The system and method for web data storage and operation - Google Patents
The system and method for web data storage and operation Download PDFInfo
- Publication number
- CN105404672B CN105404672B CN201510801184.6A CN201510801184A CN105404672B CN 105404672 B CN105404672 B CN 105404672B CN 201510801184 A CN201510801184 A CN 201510801184A CN 105404672 B CN105404672 B CN 105404672B
- Authority
- CN
- China
- Prior art keywords
- dom
- webpage
- identification information
- information
- web data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
- G06F16/9574—Browsing optimisation, e.g. caching or content distillation of access to content, e.g. by caching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
- G06F16/986—Document structures and storage, e.g. HTML extensions
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of system and methods of web data storage and operation, the webpage is indicated with DOM tree structure, DOM tree structure includes multiple DOM nodes, each DOM node is associated with an object in the webpage, each DOM node stores the key message of the object, which includes identification information；The identification information of the object and other all information in addition to the key message are stored in buffer, there are one-to-one relationship, which includes operation code, operating method and whether be the operation shunk for the identification information and other all information；The webpage only shows the key message of every an object.The present invention is directed to mobile Internet, improves webpage loading velocity and rendering speed, improves page interaction capabilities, increase the fluency of page operation, make user in mobile terminal operating list page and the biggish page of other data volumes, experience more smooth, reduces the risk of APP Caton and collapse.
Description
Technical field
The present invention relates to web data process field, in particular to a kind of the system and method and net of web data storage
The system and method for page data operation.
Background technique
With the development of mobile internet, the convenient of mobile hand-held device allows user often to select to carry out network on mobile phone
Consumption, user also propose more the performance of the performance of mobile phone, application while acquisition handheld device bring is huge convenient
High request.
Investigation display: it takes and occurs more and more list pages in journey APP (application), when list page content and interactive operation
When more, original list will appear obvious Caton, or even directly result in the case where APP collapses.Above-mentioned reason is caused to have very much,
Other than the factor of equipment performance, Dom (DOM Document Object Model) structure organization is unreasonable, Dom quantity is excessive, Dom attribute data
Amount binding is excessive and Dom operation frequently result in very much memory consumption is excessive, CPU (central processing unit) calculation amount it is excessive so as to cause
Caton occurs for APP, directly collapses when serious.
Summary of the invention
The technical problem to be solved by the present invention is in order to overcome the page of mobile device in the prior art often due to the page
Content and interactive operation are excessive and cause the page that the defect that Caton is even collapsed occurs, and provide a kind of web data storage and operation
System and method.
The present invention is to solve above-mentioned technical problem by following technical proposals:
The present invention provides a kind of system of web data storage, which indicates that DOM tree structure includes with DOM tree structure
Multiple DOM nodes, each DOM node are associated with an object in the webpage, it is characterized in that,
Each DOM node stores the key message of the object, which includes identification information；
The identification information of the object and other all information in addition to the key message, identification letter are stored in buffer
Breath and other all information there are one-to-one relationship, other all information include operation code, operating method and whether be
The operation of contraction；
The webpage only shows the key message of every an object.
The present invention also provides a kind of systems of web data operation, it is characterized in that, it is stored based on above-mentioned web data
System realize, the web data operation system include an input module, an enquiry module and one obtain module；
The input module is used to receive the input for the operation of an object in the webpage；
The enquiry module be used for according to the identification information of the object inquire the identification information in the buffer it is corresponding other
All information；
The acquisition module is for obtaining the operating method in other corresponding all information and being held according to the operating method
Row.
The present invention also provides a kind of methods of web data operation, it is characterized in that, it is grasped using above-mentioned web data
The system of work is realized comprising following steps:
S1', the input module receive the input for the operation of an object in the webpage；
S2', the enquiry module according to the identification information of the object inquire the identification information in the buffer it is corresponding other
All information；
S3', the acquisition module obtains the operating method in other corresponding all information and held according to the operating method
Row.
The present invention also provides a kind of method of web data storage, which is indicated with DOM tree structure, DOM tree structure packet
Include multiple DOM nodes, each DOM node is associated with an object in the webpage, which is characterized in that itself the following steps are included:
S1, each DOM node store the key message of the object, which includes identification information；
S2, the identification information of the object and other all information in addition to the key message stored to a buffer
In, there are one-to-one relationships with other all information for the identification information, which includes operation code, operation side
Method and whether be shrink operation；
S3, the webpage only show the key message of every an object.
Preferably, every an object in the buffer is stored in the form of Hash table.
On the basis of common knowledge of the art, above-mentioned each optimum condition, can any combination to get each preferable reality of the present invention
Example.
The positive effect of the present invention is that:
The present invention is directed to mobile Internet, improves webpage loading velocity and rendering speed, improves page interaction capabilities,
The fluency for increasing page operation, saves performance cost, make user mobile terminal operating list page and other data volumes compared with
It when the big page, experiences more smooth, reduces the risk of APP Caton and collapse.
Detailed description of the invention
Fig. 1 is the flow chart for the method that the web data of present pre-ferred embodiments stores.
Fig. 2 is the structural block diagram for the system that the web data of present pre-ferred embodiments operates.
Fig. 3 is the flow chart for the system that the web data of present pre-ferred embodiments operates.
Specific embodiment
Provide present pre-ferred embodiments with reference to the accompanying drawing, in order to explain the technical scheme of the invention in detail, but not because
The invention is limited to the scope of the described embodiments for this.
The present embodiment provides a kind of system of web data storage, which is indicated with DOM tree structure, DOM tree structure packet
Multiple DOM nodes are included, each DOM node is associated with an object in the webpage, and each DOM node stores the key of the object
Information, the key message include identification information；
The identification information of the object and other all information in addition to the key message, identification letter are stored in buffer
Breath and other all information there are one-to-one relationship, other all information include operation code, operating method and whether be
The operation of contraction；
The webpage only shows the key message of every an object.
As shown in Figure 1, the present embodiment also provides a kind of method of web data storage, which is indicated with DOM tree structure,
DOM tree structure includes multiple DOM nodes, and each DOM node is associated with an object in the webpage comprising following steps:
Step 101, each DOM node store the key message of the object, which includes identification information；
The identification information of the object and other all information in addition to the key message are stored to one and are delayed by step 102
In storage, there are one-to-one relationships with other all information for the identification information, and every an object in the buffer is to breathe out
Whether the form of uncommon table stores other all information and includes operation code, operating method and be the operation shunk；
Step 103, the webpage only show the key message of every an object.
Refering to what is shown in Fig. 2, being stored the present embodiment provides a kind of system of web data operation based on above-mentioned web data
System realize that the system of web data operation includes that an input module 1, an enquiry module 2 and one obtain module 3.
Wherein, which is used to receive the input for the operation of an object in the webpage；
The enquiry module 2 be used for according to the identification information of the object inquire the identification information in the buffer it is corresponding other
All information；
The acquisition module 3 is for obtaining the operating method in other corresponding all information and being held according to the operating method
Row.
In the present solution, only in each DOM node storage object key content, such as order ID (identity tag
Number), and the non-critical content of object is stored into buffer, in this way when the relevant business information of reading DOM node, pass through
Order ID quick obtaining from buffer as key value, to avoid a large amount of traversals and meter to DOM node and DOM attribute
It calculates, significantly reduces the pressure of CPU and memory, and reduce the volume of DOM node, therefore can add under same appointed condition
A possibility that setting out more contents, being further reduced APP collapse.
For example, in the prior art, when the load of order card excessive (about 80-100 order cards), webpage interactive operation
The case where will appear obvious Caton or even collapsing.Using after this solution, when order card loads 1000 or more, interaction is grasped
The phenomenon that being all not in Caton phenomenon, also not collapsing, so that in user's access when big data quantity information, page
Face fluency increases, and greatly reduces the case where APP collapses.
Refering to what is shown in Fig. 3, the present embodiment also provides a kind of method of web data operation, above-mentioned web data is utilized
The system of operation is realized comprising following steps:
Step 201, the input module receive the input for the operation of an object in the webpage；
It is corresponding that step 202, the enquiry module according to the identification information of the object inquire the identification information in the buffer
Other all information；
Step 203, the acquisition module obtain the operating method in other corresponding all information and according to the operation sides
Method executes.
The present invention is directed to mobile Internet, improves webpage loading velocity and rendering speed, improves page interaction capabilities,
The fluency for increasing page operation, saves performance cost, make user mobile terminal operating list page and other data volumes compared with
It when the big page, experiences more smooth, reduces the risk of APP Caton and collapse.
Each functional module in the present invention can combine existing software programming means under existing hardware condition
It is realized, therefore its concrete methods of realizing is not repeated them here at this.
Although specific embodiments of the present invention have been described above, it will be appreciated by those of skill in the art that these
It is merely illustrative of, protection scope of the present invention is defined by the appended claims.Those skilled in the art is not carrying on the back
Under the premise of from the principle and substance of the present invention, many changes and modifications may be made, but these are changed
Protection scope of the present invention is each fallen with modification.
Claims (5)
1. a kind of system of web data storage, the webpage indicate that DOM tree structure includes multiple DOM nodes with DOM tree structure,
Each DOM node is associated with an object in the webpage, which is characterized in that
Each DOM node stores the key message of the associated object of the DOM node, which includes identification information；
The identification information of the associated object of the DOM node and other all letters in addition to the key message are stored in buffer
Breath, there are one-to-one relationships with other all information for the identification information, which includes operation code, operation side
Method and whether be the operation for shrinking the associated object of the DOM node；
The webpage only shows the key message of every an object.
2. a kind of system of web data operation, which is characterized in that be based on what web data as described in claim 1 stored
System realizes that the system of web data operation includes an input module, an enquiry module and an acquisition module；
The input module is used to receive the input for the operation of an object in the webpage；
The enquiry module, which is used to inquire corresponding other of the identification information in the buffer according to the identification information of the object, to be owned
Information；
The acquisition module is used to obtain the operating method in other corresponding all information and is executed according to the operating method.
3. a kind of method of web data operation, which is characterized in that it utilizes web data as claimed in claim 2 operation
System is realized comprising following steps:
S1', the input module receive the input for the operation of an object in the webpage；
S2', the enquiry module other corresponding all letters of the identification information in the buffer are inquired according to the identification information of the object
Breath；
S3', the acquisition module obtain the operating method in other corresponding all information and according to the operating method execute.
4. a kind of method of web data storage, the webpage indicate that DOM tree structure includes multiple DOM nodes with DOM tree structure,
Each DOM node is associated with an object in the webpage, which is characterized in that itself the following steps are included:
S1, each DOM node store the key message of the associated object of the DOM node, which includes identification letter
Breath；
S2, by the identification information of the associated object of the DOM node and other all information in addition to the key message store to
In one buffer, there are one-to-one relationship, which includes operation for the identification information and other all information
Code, operating method and whether be the operation for shrinking the associated object of the DOM node；
S3, the webpage only show the key message of every an object.
5. the method for web data storage as claimed in claim 4, which is characterized in that every an object in the buffer is to breathe out
The form storage of uncommon table.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510801184.6A CN105404672B (en) | 2015-11-19 | 2015-11-19 | The system and method for web data storage and operation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510801184.6A CN105404672B (en) | 2015-11-19 | 2015-11-19 | The system and method for web data storage and operation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105404672A CN105404672A (en) | 2016-03-16 |
| CN105404672B true CN105404672B (en) | 2019-03-26 |
Family
ID=55470161
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510801184.6A Active CN105404672B (en) | 2015-11-19 | 2015-11-19 | The system and method for web data storage and operation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105404672B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106202315A (en) * | 2016-06-30 | 2016-12-07 | 北京奇虎科技有限公司 | The method and device that data process |
| CN108595652A (en) * | 2018-04-27 | 2018-09-28 | 平安科技（深圳）有限公司 | Load method, apparatus, computer equipment and the storage medium of DOM node data |
| CN112181242B (en) * | 2019-07-02 | 2021-11-02 | 北京百度网讯科技有限公司 | Page display method and device |
| CN111460339B (en) * | 2020-04-01 | 2024-03-05 | 上海携程商务有限公司 | Method for adding free taxi resources to shopping carts and related equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102214244A (en) * | 2011-07-07 | 2011-10-12 | 深圳市万兴软件有限公司 | Analytic method and system for docx file information |
| US8713427B2 (en) * | 2010-11-12 | 2014-04-29 | Samsung Electronics Co., Ltd. | Apparatus and method for extracting cascading style sheet rules |
| CN104951445A (en) * | 2014-03-25 | 2015-09-30 | 小米科技有限责任公司 | Webpage processing method and device |
-
2015
- 2015-11-19 CN CN201510801184.6A patent/CN105404672B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8713427B2 (en) * | 2010-11-12 | 2014-04-29 | Samsung Electronics Co., Ltd. | Apparatus and method for extracting cascading style sheet rules |
| CN102214244A (en) * | 2011-07-07 | 2011-10-12 | 深圳市万兴软件有限公司 | Analytic method and system for docx file information |
| CN104951445A (en) * | 2014-03-25 | 2015-09-30 | 小米科技有限责任公司 | Webpage processing method and device |
Non-Patent Citations (2)
| Title |
|---|
| A Semantic DOM Approach for Webpage Information Extraction;Yulian Fei.etc;《MASS "09. International Conference on Management and Service Science》;20091030;第1-5页 * |
| 基于DOM和显示属性的网页信息除燥技术研究;付涛;《商丘师范学院学报》;20100930;第26卷(第9期);第90-93页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105404672A (en) | 2016-03-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103345493B (en) | Method that content of text on mobile terminal shows, Apparatus and system | |
| CN109582899B (en) | Page loading method and device, computer equipment and storage medium | |
| CN105975576B (en) | Terminal content adaptive display method and device and terminal | |
| CN105404672B (en) | The system and method for web data storage and operation | |
| JP2014534481A5 (en) | ||
| US9747385B2 (en) | Compression of cascading style sheet files | |
| CN104572084B (en) | User interface generation and data distributing method, device in card business | |
| CN106817391A (en) | Document breakpoint transmission method and apparatus | |
| CN105205174A (en) | File processing method and device for distributed system | |
| JP2019517700A5 (en) | ||
| CN106330788B (en) | Message fragment transmission method and device | |
| US20130238980A1 (en) | Method and Apparatus for Processing World Wide Web Page | |
| CN103559194B (en) | A kind of searching method, server, system | |
| CN101729590A (en) | Method, system and device for providing web page | |
| US20140095579A1 (en) | System and method for increasing web site serving performance | |
| US20120166412A1 (en) | Super-clustering for efficient information extraction | |
| CN112650905A (en) | Anti-crawler method and device based on label, computer equipment and storage medium | |
| CN113010542A (en) | Service data processing method and device, computer equipment and storage medium | |
| CN108874808A (en) | A kind of page elements interlock method, device and server | |
| CN104679824A (en) | Webpage generating method and webpage generating system of network platform | |
| CN109495553A (en) | A kind of webpage display control method, system and Reverse Proxy | |
| CN102437894A (en) | Method, device and equipment for compressing information to be sent | |
| CN107943588A (en) | Data processing method, system, computer equipment and readable storage medium storing program for executing | |
| CN109697281A (en) | The online method, apparatus and electronic equipment for merging document | |
| CN110502560A (en) | A kind of method and server of Database Connection Parameters encapsulation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |