CN110633256A - Session Session sharing method in distributed cluster system - Google Patents
Session Session sharing method in distributed cluster system Download PDFInfo
- Publication number
- CN110633256A CN110633256A CN201910959690.6A CN201910959690A CN110633256A CN 110633256 A CN110633256 A CN 110633256A CN 201910959690 A CN201910959690 A CN 201910959690A CN 110633256 A CN110633256 A CN 110633256A
- Authority
- CN
- China
- Prior art keywords
- data
- session
- index
- sharing
- cluster
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 30
- 238000012545 processing Methods 0.000 claims abstract description 9
- 230000008569 process Effects 0.000 claims abstract description 8
- 230000004044 response Effects 0.000 claims abstract description 4
- 230000003213 activating effect Effects 0.000 claims description 2
- 238000013507 mapping Methods 0.000 claims description 2
- 230000007246 mechanism Effects 0.000 claims description 2
- 238000012423 maintenance Methods 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 239000011159 matrix material Substances 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000010076 replication Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000013497 data interchange Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/172—Caching, prefetching or hoarding of files
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/176—Support for shared access to files; File sharing support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Abstract
The invention relates to the technical field of computers, in particular to a sharing method of Session sessions in a distributed cluster system, which constructs a new ordered model to realize efficient sharing of Session sessions; the method comprises the steps of caching data, establishing an index, sorting the data and writing the session data into a disk, and dividing the session data into a plurality of small data blocks, so that the speed of the data during writing and reading is increased, and the session sharing concurrency capability is improved; according to the reading and writing process of session data, a disk data index needs to be stored in the cluster, and data with high search rate is used as an index standard, so that the session sharing response capability is improved; establishing a session index, and processing an index structure to ensure that the index structure can meet retrieval requirements; and storing the inclusion relation between the key word matrixes by using key value pairs according to the established session indexes, and sharing the key word matrixes into the logic areas where different key word combinations are located by establishing the key word index matrixes.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a sharing method of Session sessions in a distributed cluster system.
Background
At present, the session security guarantee standard is continuously improved by people, in the past, the difficulty and the weight of computer programs in calculating complex problems are high, the hardware calculation time is long, and the requirement for inputting and calculating problem data by singly using one server is difficult to meet. Therefore, many internet application systems have established networks based on distributed cluster systems for this problem. The distributed cluster system has the outstanding advantages that the system integrates the calculation data of a more distributed wide area network, establishes high-speed cluster data interchange equipment and a corresponding data channel, has an internal structure of a distributed area based on physical distribution, is different from the traditional high-cohesion networking mode, and establishes a network-to-network mode, thereby greatly improving the network mobility and improving the control capability and the processing capability of the pertinence of each link point.
By adding the service node form, the cluster system improves the processing capacity. However, for the conventional method, since the HTTP network protocol is in a state without link information, it is necessary to provide user access, access history, and the like, which can maintain information of a user and an application interaction process, for which a Session is applied. The Session is established in an independent server, and when a user accesses the HTTP, the Session may be randomly assigned to different network information processors for processing, and if the Session cannot be performed with the same effect in each processor, the data processing may generate a miscalculated result in a distributed cluster environment.
Therefore, the Session sharing method needs to study load balancing and establish different Session sharing modes according to specific operating environments, so that the Session sharing method can normally operate and has more efficient performance.
The conventional sharing method comprises the following steps:
1. source IP address Session maintenance
In the conventional Session Session, some users cannot normally access a server after the server fails; if a large number of requests sent by users are sent from the same computer, the calculation amount of one application processor of the transmission load balancing server is too large, and an imbalance phenomenon occurs. To address this problem, Session of the source IP address needs to be maintained.
Session maintenance based on a source IP address refers to a request from the same source IP address, and processing results of different load balancing processors are distributed to the same server, so that the server can maintain Session in the same mode. The principle of source IP address Session maintenance is shown in fig. 1.
As shown in fig. 1, the paths of the clients a, B, and C running in the load balancing server are recorded respectively. If user information is sent at the moment, the information is transmitted to the same server, and subsequent logic calculation is facilitated. The principle maintains the original property of Session data, and only needs to be modulated in a load balancer.
2 Cluster unified management Session replication
And copying the Session under the support of a maintenance principle of the source IP address Session. The principle of Session sharing information means that a dedicated server is arranged in a cluster system, the function of the dedicated server is to store all sessions uniformly, and when the sessions are required to be used in data processing, Session data can be acquired from the server, so that the purposes of Session synchronization and Session sharing are achieved.
The realization principle of the method is that the Session is established or updated in the server of any connection point in the cluster, and the updated Session is copied to other node servers, thereby effectively ensuring that different node servers respectively have the sessions of themselves. After the request of the user is distributed to any processor, the same Session state is obtained, thereby realizing Session sharing. The process is a replication process, modulation is carried out through a cluster, certain setting is carried out through a server, and the fact that setting modes of all servers are not single is guaranteed.
Therefore, according to the method, a new ordered model is constructed to realize efficient sharing of Session sessions, which is a problem to be solved urgently.
Disclosure of Invention
In order to solve the technical problem, the invention provides a sharing method of Session sessions in a distributed cluster system, which constructs a new ordered model to realize efficient sharing of Session sessions.
The invention relates to a sharing method of Session sessions in a distributed cluster system, which comprises the steps of caching data, establishing indexes, sorting the data and writing the Session data into a disk, dividing the Session data into a plurality of small data blocks, accelerating the speed of the data during writing and reading, and further improving the Session sharing concurrency capability;
according to the reading and writing process of session data, a disk data index needs to be stored in the cluster, and data with high search rate is used as an index standard, so that the session sharing response capability is improved;
establishing a session index, and processing an index structure to ensure that the index structure can meet retrieval requirements;
according to the established Session index, the inclusion relation between the keyword matrixes is stored by using key value pairs, and the keyword index matrixes are established, so that the keyword indexes can be shared in the logic areas where different keyword combinations are located, the relevance between Session data of the same keyword is improved, and the Session sharing efficiency is further effectively improved.
The invention relates to a sharing method of Session in a distributed cluster system, wherein the Session data writing operation comprises the following steps:
s11, reading external program data, reading data in blocks, and inputting the data into distributed nodes in batches;
s12, establishing a data index, and sharing a cable in the cluster;
s13, merging the data blocks according to the indexes;
s14, submitting the processed data to an HDFS client for physical disk writing operation;
and S15, merging the data blocks according to the indexes.
The invention relates to a sharing method of Session in a distributed cluster system, which comprises the following specific procedures of Session data reading operation:
s21, receiving a data reading request of an external program;
s22, searching whether the cluster stores the data to be accessed;
s23, if yes, repeating the step S21, if no, searching the data index in the cluster;
s24, mapping the retrieved data index to a management client of the disk file system;
s25, the management client of the disk file system reads and merges data according to the received index record, the sorted data is cached in the cluster, and the data is returned to the external program by the node;
s26, activating a data pre-storage mechanism, and setting the data read from the disk file system as a file with high use frequency;
and S27, caching the files in the cluster, and replacing the files with the lowest use frequency.
Compared with the prior art, the invention has the beneficial effects that: the method for realizing the efficient sharing of the Session Session in the distributed cluster system is to utilize a server to encrypt and program the Session data of a client and store the Session data on the client in a distributed manner. When the client accesses the server again, the server can acquire the information in the corresponding Session from the request, thereby realizing the sharing of the Session. The new model has the advantages that Session data are stored in the client, other server information is not needed, the storage length of related data is not limited, and a large amount of client data can be stored; meanwhile, Session content can be safely shared.
Drawings
Figure 1 is based on the Session maintenance principle of the source IP address;
FIG. 2 is a detailed flow diagram of a session data write operation;
FIG. 3 is a detailed flow diagram of a session data read operation;
FIG. 4 is a logical address two-dimensional flat session index setup diagram;
fig. 5 is a key matrix index table.
Detailed Description
The following examples are given to further illustrate the embodiments of the present invention. The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.
Examples
1. Session-based ordered model Session data access
The distributed cluster session sharing aiming at the ordered model mainly comprises caching data, index establishment, data sorting and data writing into a disk, and session data are divided into a plurality of small data blocks, so that the speed of the data during writing and reading is increased, and the session sharing concurrency capability is improved.
The specific flow of the session data writing operation is shown in fig. 2.
The specific flow of the session data reading operation is shown in fig. 3.
According to the reading and writing process of session data, a disk data index needs to be stored in the cluster, and data with high search rate is used as an index standard, so that the session sharing response capability is improved.
2. Session index establishment
Because the time consumed by the network data in the storage process is random, the key of session sharing is to establish the session index in real time, and convenience is provided for maintaining the data index on the cluster. Therefore, the index structure needs to be processed to ensure that the index structure can meet the retrieval requirement.
Fig. 4 shows a logical address two-dimensional plane session index, which represents the logical address of the file of the server by the positions of two-dimensional coordinates x-axis and y-axis, and forms the mesh address.
As can be seen from fig. 4: in the logical address plane, each common search key is assigned a freely coded matrix in which the data have the same key, according to which the design of the sharing scheme is implemented.
3. Implementation of a sharing scheme
And storing the inclusion relationship between the key word matrixes by using key value pairs according to the established session index, wherein the figure 5 is an index table established by the method.
The information in fig. 5 includes the belonging matrix index information and the grid two-dimensional plane coordinate information, and by establishing the keyword index matrix, the information can be shared in the logic areas where different keyword combinations are located, so that the relevance between Session data of the same keyword is improved, and the Session sharing efficiency is further effectively improved.
The method for realizing the efficient sharing of the Session Session in the distributed cluster system is to utilize a server to encrypt and program the Session data of a client and store the Session data on the client in a distributed manner. When the client accesses the server again, the server can acquire the information in the corresponding Session from the request, thereby realizing the sharing of the Session. The new model has the advantages that Session data are stored in the client, other server information is not needed, the storage length of related data is not limited, and a large amount of client data can be stored; meanwhile, Session content can be safely shared.
The above description is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, several modifications and variations can be made without departing from the technical principle of the present invention, and these modifications and variations should also be regarded as the protection scope of the present invention.
Claims (3)
1. A sharing method of Session conversation in distributed cluster system is characterized in that caching data, index establishing, data sorting and conversation data writing into a disk, dividing the conversation data into a plurality of small data blocks, so as to accelerate the speed of data writing and reading and further improve the conversation sharing concurrency capability;
according to the reading and writing process of session data, a disk data index needs to be stored in the cluster, and data with high search rate is used as an index standard, so that the session sharing response capability is improved;
establishing a session index, and processing an index structure to ensure that the index structure can meet retrieval requirements;
according to the established Session index, the inclusion relation between the keyword matrixes is stored by using key value pairs, and the keyword index matrixes are established, so that the keyword indexes can be shared in the logic areas where different keyword combinations are located, the relevance between Session data of the same keyword is improved, and the Session sharing efficiency is further effectively improved.
2. The method of claim 1, wherein the Session data write operation comprises the steps of:
s11, reading external program data, reading data in blocks, and inputting the data into distributed nodes in batches;
s12, establishing a data index, and sharing a cable in the cluster;
s13, merging the data blocks according to the indexes;
s14, submitting the processed data to an HDFS client for physical disk writing operation;
and S15, merging the data blocks according to the indexes.
3. The method of claim 1, wherein the Session data reading operation comprises the following specific procedures:
s21, receiving a data reading request of an external program;
s22, searching whether the cluster stores the data to be accessed;
s23, if yes, repeating the step S21, if no, searching the data index in the cluster;
s24, mapping the retrieved data index to a management client of the disk file system;
s25, the management client of the disk file system reads and merges data according to the received index record, the sorted data is cached in the cluster, and the data is returned to the external program by the node;
s26, activating a data pre-storage mechanism, and setting the data read from the disk file system as a file with high use frequency;
and S27, caching the files in the cluster, and replacing the files with the lowest use frequency.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910959690.6A CN110633256A (en) | 2019-10-10 | 2019-10-10 | Session Session sharing method in distributed cluster system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910959690.6A CN110633256A (en) | 2019-10-10 | 2019-10-10 | Session Session sharing method in distributed cluster system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110633256A true CN110633256A (en) | 2019-12-31 |
Family
ID=68975905
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910959690.6A Pending CN110633256A (en) | 2019-10-10 | 2019-10-10 | Session Session sharing method in distributed cluster system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110633256A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022033099A1 (en) * | 2020-08-13 | 2022-02-17 | 华为技术有限公司 | Index construction method and apparatus |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050204045A1 (en) * | 1999-09-24 | 2005-09-15 | Ruslan Belkin | Mechanism for enabling session information to be shared across multiple processes |
| US20140304499A1 (en) * | 2013-04-06 | 2014-10-09 | Citrix Systems, Inc. | Systems and methods for ssl session management in a cluster system |
| CN104580226A (en) * | 2015-01-15 | 2015-04-29 | 上海瀚之友信息技术服务有限公司 | Session data sharing system and method |
| CN105516264A (en) * | 2015-11-30 | 2016-04-20 | 努比亚技术有限公司 | Distributed cluster system based session sharing method, apparatus and system |
| CN109150936A (en) * | 2017-06-19 | 2019-01-04 | 北京宝兰德软件股份有限公司 | The sharing method and device of session object Session in a kind of distributed type assemblies |
| CN109842686A (en) * | 2019-03-05 | 2019-06-04 | 国家电网有限公司信息通信分公司 | A kind of SiteServer LBS for realizing trans-regional colony dispatching |
-
2019
- 2019-10-10 CN CN201910959690.6A patent/CN110633256A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050204045A1 (en) * | 1999-09-24 | 2005-09-15 | Ruslan Belkin | Mechanism for enabling session information to be shared across multiple processes |
| US20140304499A1 (en) * | 2013-04-06 | 2014-10-09 | Citrix Systems, Inc. | Systems and methods for ssl session management in a cluster system |
| CN104580226A (en) * | 2015-01-15 | 2015-04-29 | 上海瀚之友信息技术服务有限公司 | Session data sharing system and method |
| CN105516264A (en) * | 2015-11-30 | 2016-04-20 | 努比亚技术有限公司 | Distributed cluster system based session sharing method, apparatus and system |
| CN109150936A (en) * | 2017-06-19 | 2019-01-04 | 北京宝兰德软件股份有限公司 | The sharing method and device of session object Session in a kind of distributed type assemblies |
| CN109842686A (en) * | 2019-03-05 | 2019-06-04 | 国家电网有限公司信息通信分公司 | A kind of SiteServer LBS for realizing trans-regional colony dispatching |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022033099A1 (en) * | 2020-08-13 | 2022-02-17 | 华为技术有限公司 | Index construction method and apparatus |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR20150088442A (en) | Method for managing distributed files based on information centric network and apparatus therefor | |
| CN105005611B (en) | A kind of file management system and file management method | |
| EP1330907A2 (en) | Method and apparatus for real-time parallel delivery of segments of a large payload file | |
| JP2009295127A (en) | Access method, access device and distributed data management system | |
| Zeng et al. | Optimal metadata replications and request balancing strategy on cloud data centers | |
| Singh et al. | Scalable metadata management techniques for ultra-large distributed storage systems--A systematic review | |
| Duan et al. | CSTORE: A desktop-oriented distributed public cloud storage system | |
| US11675806B2 (en) | Aggregate and transactional networked database query processing | |
| CN110633256A (en) | Session Session sharing method in distributed cluster system | |
| US20230195726A1 (en) | Selecting between hydration-based scanning and stateless scale-out scanning to improve query performance | |
| Shao et al. | Effective load balancing mechanism for heterogeneous range queriable cloud storage | |
| Gao et al. | Compact, popularity-aware and adaptive hybrid data placement schemes for heterogeneous cloud storage | |
| KR20030014513A (en) | Meshod and System of Sharing Client Data For Distributing Load of Server | |
| Cao et al. | Data allocation of large-scale key-value store system using kinetic drives | |
| KR20140045738A (en) | Cloud storage system | |
| Chen et al. | A greedy approach for caching in distributed data stores | |
| US10659330B2 (en) | Channel management in scalable messaging system | |
| Liu et al. | HASG: Security and efficient frame for accessing cloud storage | |
| Nakagawa et al. | Jobcast—Parallel and distributed processing framework Data processing on a cloud style KVS database | |
| Meng et al. | A network load sensitive block placement strategy of HDFS | |
| Duan et al. | A high‐performance distributed file system for large‐scale concurrent HD video streams | |
| Mohamad et al. | Implementation of Sub-Grid-Federation Model for Performance Improvement in Federated Data Grid | |
| Piernas et al. | Leveraging OSD+ devices for implementing a high‐throughput parallel file system | |
| Xu et al. | C 2: adaptive load balancing for metadata server cluster in cloud-scale storage systems | |
| Zhang et al. | Oasis: Controlling Data Migration in Expansion of Object-based Storage Systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191231 |
|
| RJ01 | Rejection of invention patent application after publication |