CN112468614A - Method for automatically identifying access style supported by object storage - Google Patents
Method for automatically identifying access style supported by object storage Download PDFInfo
- Publication number
- CN112468614A CN112468614A CN202011467064.4A CN202011467064A CN112468614A CN 112468614 A CN112468614 A CN 112468614A CN 202011467064 A CN202011467064 A CN 202011467064A CN 112468614 A CN112468614 A CN 112468614A
- Authority
- CN
- China
- Prior art keywords
- access
- bucket
- endpoint
- storage
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L61/00—Network arrangements, protocols or services for addressing or naming
- H04L61/45—Network directories; Name-to-address mapping
- H04L61/4505—Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols
- H04L61/4511—Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols using domain name system [DNS]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a method for automatically identifying an access style supported by object storage, which comprises the following steps: accessing endpoint information, bucket information and object key information stored in a storage input object; the access storage forms an access domain name according to a < bucket > < endpoint > rule; performing first DNS analysis; if the first DNS analysis result is successful, accessing the object storage by adopting a virtual hosting style; if the first DNS analysis result is failure, inputting http (s)/< endpoint >/< bucket >/< object key >, and performing second DNS analysis; if the second DNS analysis result is successful, accessing the object storage by adopting a path style; the method can quickly and accurately select the object storage access mode, can automatically select the object storage access mode without manually confirming the object storage access mode, and effectively improves the selection speed of the object storage access mode.
Description
Technical Field
The invention relates to the field of object storage management, in particular to a method for automatically identifying an access style supported by object storage.
Background
In the prior art, accessing a file in an object storage generally includes two access modes, namely a path mode and a virtual managed mode. Path style (path style), which is a way for object storage to be used early, is not recommended at present, but newer object storage systems still support backward compatibility; a virtual-hosted style (virtual-hosted style) that stores a currently recommended manner of use for an object, which is supported by newer object stores but not by partially older object stores; thus, the access mode of the object storage needs to be deployed.
In the prior art, the deployment of object stores can be divided into three categories: a first category, supporting both "path styles" and "virtual hosted styles"; the second type only supports 'virtual managed style', and the third type only supports 'path style'; because the object storage supporting modes on the line in different time periods are different, when one object storage is accessed, it is usually necessary to manually confirm which access mode the object storage supports, which causes difficulty in software system configuration and incapability of automatically identifying the supporting access pattern.
Accordingly, the prior art is deficient and needs improvement.
Disclosure of Invention
The invention aims to overcome the defects of the prior art, provides a method for automatically identifying access patterns supported by object storage, and solves the problem that the access patterns supported by the object storage cannot be automatically identified by manually confirming the access patterns supported by the object storage in the prior art.
The technical scheme of the invention is as follows: a method of automatically identifying an object store support access pattern, comprising the steps of:
s1: and accessing end information, bucket information and object key information stored in the storage input object.
S2: the access storage forms an access domain name according to a < bucket > < endpoint > rule; and performing a first DNS resolution on the access domain name < bucket > < endpoint >.
S3: and if the first DNS analysis result is successful, accessing the object storage by adopting a virtual managed style.
S4: and if the first DNS analysis result is failure, inputting http (s)/< endpoint >/< bucket >/< object key > according to endpoint information, bucket information and object key information, and performing second DNS analysis on the http (s)/< endpoint >/< bucket >/< object key >.
S5: and if the second DNS analysis result is successful, accessing the object storage by adopting the path style.
The access object storage forms an access domain name according to an end point information, a bucket information and an object key information stored by an object according to a < bucket > < end point > rule, and carries out a first DNS analysis, if the first DNS analysis result is successful, the corresponding object storage supports virtual hosted style access, the access storage preferentially adopts the virtual hosted style access when the access object storage is accessed, if the first DNS analysis result is failed, the corresponding object storage does not support the virtual hosted access, further, the access object storage supports path style access according to the end point information, the bucket information and the object key information which are stored by the object and input http(s) and/or the bucket >/and/or the object key information, and carries out a second DNS analysis, if the second DNS analysis result is successful, the corresponding object storage supports path style access, and the access storage adopts a path style when the access object storage is accessed, the access storage can quickly and accurately select the access mode of the object storage, the access mode of the object storage does not need to be confirmed manually, the selection of the access mode of the object storage can be automatically performed through the method, and the selection speed of the access mode is effectively improved; on the other hand, the method and the device preferentially test whether the object storage to be accessed supports the virtual hosting style, preferentially select the virtual hosting style when the object storage to be accessed simultaneously supports the path style and the virtual hosting style, and improve the access efficiency.
Further, the object store in step S1 is configured to provide end information, bucket information, and object key information to the access store. The object storage in step S1 is an object storage to be accessed for access storage, where the object storage provides end information, bucket information, and object key information in access storage before access, and the provided end information, bucket information, and object key information are determined by the object storage.
Further, the step S2 further includes the following steps:
s20: and the access storage forms an access domain name according to the input endpoint information, the bucket information and the object key information stored by the object and the < bucket > < endpoint > rule.
S21: the access store sends a request to a domain name resolution server for a first DNS resolution for accessing a domain name < bucket > < endpoint >.
S22: and the domain name resolution server carries out first DNS resolution on the access domain name < bucket > < endpoint >, and feeds back the first DNS resolution result to the access storage.
The access storage sends a request for performing first DNS analysis on the < bucket > < endpoint > to the domain name analysis server, completes the first DNS analysis through the domain name analysis server, sends a first DNS analysis result to the access storage, and confirms whether the corresponding object storage supports the virtual hosted style or not according to the first DNS analysis result.
Further, the step S4 further includes the following steps:
s40: and if the first DNS analysis result is failure, inputting http(s) and// < end >/< bucket >/< object key > by the access memory according to the end information, the bucket information and the object key information stored by the object.
S41: the access store sends a request to a domain name resolution server for a second DNS resolution for the http (s)/< endpoint >/< bucket >/< object key >.
S42: and the domain name resolution server performs second DNS resolution on http (s)/< end >/< bucket >/< object key >, and feeds back the resolution result to the access storage.
Preferably, in step S42, the domain name resolution server performs a second DNS resolution on < endpoint > in http (S)/< endpoint >/< bucket >/< object key >. If the first DNS analysis result is failure, the corresponding object storage does not support virtual hosted style access, whether the corresponding object storage supports path style access is further tested, corresponding http (s)/not/but/object key > is input according to end information, bucket information and object key information of the object storage, second DNS analysis is carried out on < end > in the http (s)/not/but/object key > through a domain name resolution server, and whether the corresponding object storage supports path style access is confirmed according to the second DNS analysis result.
Further, the step S5 is followed by the step S6:
s6: and if the second DNS analysis result is failure, the domain name analysis server feeds back the second DNS analysis result to the access storage as failure, and the access storage checks the reason that the second DNS analysis result is failure. The reason why the second DNS resolution result is failure generally has two cases, the first case: the corresponding object stores the provided endpoint information, bucket information and object key information, and errors exist, so that the second DNS analysis result is failure; in the second case: the network accessing the storage is not connected, resulting in a failure of the second DNS resolution.
By adopting the scheme, the method for automatically identifying the access mode supported by the object storage can quickly and accurately select the object storage access mode without manually confirming the access mode of the object storage, and can automatically select the object storage access mode so as to effectively improve the selection speed of the access mode; whether the object storage to be accessed supports the virtual hosting style or not is preferentially tested, and when the object storage to be accessed simultaneously supports the path style and the virtual hosting style, the virtual hosting style is preferentially selected, so that the object storage accessing efficiency is improved.
Drawings
FIG. 1 is a block flow diagram of the present invention;
FIG. 2 is a block flow diagram of step S2 according to the present invention;
fig. 3 is a block diagram of the process of step S4 according to the present invention.
Detailed Description
The invention is described in detail below with reference to the figures and the specific embodiments.
Referring to fig. 1, the present invention provides a method for automatically identifying an access style supported by an object storage, comprising the following steps:
s1: and accessing end information, bucket information and object key information stored in the storage input object.
Specifically, in this embodiment, the endpoint information stored by the object is: s3.amazonaws. com; the bucket information is example; the object key information is: txt.
S2: the access storage forms an access domain name according to a < bucket > < endpoint > rule; and performing a first DNS resolution on the access domain name < bucket > < endpoint >. Specifically, in this embodiment, the access domain name is example.s3. amazonaws.com.
S3: and if the first DNS analysis result is successful, accessing the object storage by adopting a virtual managed style.
S4: and if the first DNS analysis result is failure, inputting http (s)/< endpoint >/< bucket >/< object key > according to endpoint information, bucket information and object key information, and performing second DNS analysis on the http (s)/< endpoint >/< bucket >/< object key >. Specifically, in the present embodiment, the http (s)/< end >/< bucket >/< object key > is https:// s3. amplitude.
S5: and if the second DNS analysis result is successful, accessing the object storage by adopting the path style.
The access object storage forms an access domain name according to an end information, a bucket information and an object key information stored in an object according to a < bucket > < end > rule, and carries out first DNS analysis on an example 3. example concerns.com, if the first DNS analysis result is successful, the corresponding object storage supports virtual hosted style access, the access storage preferentially adopts virtual hosted style access when the access object storage is accessed, if the first DNS analysis result is failed, the corresponding object storage does not support virtual hosted access, further, the access object storage supports path style access according to the point information, the bucket information and the object key information stored in the object storage, the https:// s3. example concerns.com/example/text, and carries out second DNS analysis, if the second DNS analysis result is successful, the access object storage adopts a path for access, and the access object storage can be selected in a rapid access mode, the access mode of the object storage can be automatically selected by the method without manually confirming the access mode of the object storage, so that the selection speed of the access mode is effectively improved; on the other hand, the method and the device preferentially test whether the object storage to be accessed supports the virtual hosting style, preferentially select the virtual hosting style when the object storage to be accessed simultaneously supports the path style and the virtual hosting style, and improve the access efficiency.
Specifically, in this embodiment, the object store in step S1 is configured to provide end information, bucket information, and object key information to the access store. The object storage in step S1 is an object storage to be accessed for access storage, where the object storage provides end information, bucket information, and object key information in access storage before access, and the provided end information, bucket information, and object key information are determined by the object storage.
Referring to fig. 2, the step S2 further includes the following steps:
s20: and the access storage forms an access domain name according to the input endpoint information, the bucket information and the object key information stored by the object and the < bucket > < endpoint > rule. Specifically, in this embodiment, the access domain name is example.s3. amazonaws.com.
S21: the access store sends a request to a domain name resolution server for a first DNS resolution to access a domain name example.s3. amazonaws.com.
S22: and the domain name resolution server carries out first DNS resolution on the access domain name example.s3.amazonaws.com and feeds back the first DNS resolution result to the access storage.
The access storage sends a request for performing first DNS analysis on example.s3.amazonaws.com to the domain name analysis server, completes the first DNS analysis through the domain name analysis server, sends a first DNS analysis result to the access storage, and confirms whether the corresponding object storage supports the virtual hosting style or not according to the first DNS analysis result.
Referring to fig. 3, the step S4 further includes the following steps:
s40: if the first DNS analysis result is failure, the access storage inputs https:// s3. amazonas. com/example/text. txt according to the end information, bucket information and object key information stored by the object.
S41: the access store sends a request to a domain name resolution server for a second DNS resolution for https:// s3. amazonawcom/example/test.
S42: and the domain name resolution server performs second DNS resolution on https:// s3.amazonaws.com/example/test.txt, and feeds back a resolution result to the access storage.
In step S42, the domain name resolution server performs a second DNS resolution on < endpoint > in https:// S3. amazonaw.com/example/test.txt, where < endpoint > in this embodiment is S3. amazonaw.com. If the first DNS analysis result is failure, the corresponding object storage does not support virtual hosted style access, whether the corresponding object storage supports path style access is further tested, whether corresponding https:// s3. involved. com/example/test.txt is input according to end information, bucket information and object key information of the object storage, second DNS analysis is carried out on s3. involved. com in https:// s3. involved. com/example/test.txt through a domain name analysis server, and whether the corresponding object storage supports path style access is confirmed according to the second DNS analysis result.
Specifically, in this embodiment, the step S5 is followed by the step S6:
s6: and if the second DNS analysis result is failure, the domain name analysis server feeds back the second DNS analysis result to the access storage as failure, and the access storage checks the reason that the second DNS analysis result is failure. The reason why the second DNS resolution result is failure generally has two cases, the first case: the corresponding object stores the provided endpoint information, bucket information and object key information, and errors exist, so that the second DNS analysis result is failure; in the second case: the network accessing the storage is not connected, resulting in a failure of the second DNS resolution.
In summary, the present invention provides a method for automatically identifying access patterns supported by object storage, which can quickly and accurately select an access pattern of object storage, and can automatically select an access pattern of object storage without manually confirming the access pattern of object storage, thereby effectively increasing the speed of selecting an access pattern; whether the object storage to be accessed supports the virtual hosting style or not is preferentially tested, and when the object storage to be accessed simultaneously supports the path style and the virtual hosting style, the virtual hosting style is preferentially selected, so that the object storage accessing efficiency is improved.
The present invention is not limited to the above preferred embodiments, and any modifications, equivalent substitutions and improvements made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (6)
1. A method for automatically identifying an object store support access pattern, comprising the steps of:
s1: accessing endpoint information, bucket information and object key information stored in a storage input object;
s2: the access storage forms an access domain name according to a < bucket > < endpoint > rule; performing first DNS analysis on the access domain name < bucket > < endpoint >;
s3: if the first DNS analysis result is successful, accessing the object storage by adopting a virtual hosting style;
s4: if the first DNS analysis result is failure, inputting http (s)/< endpoint >/< bucket >/< object key > according to endpoint information, bucket information and object key information, and performing second DNS analysis on the http (s)/< endpoint >/< bucket >/< object key >;
s5: and if the second DNS analysis result is successful, accessing the object storage by adopting the path style.
2. The method for automatically identifying the access style supported by the object store according to claim 1, wherein the object store in step S1 is used for providing end information, bucket information and object key information to the access store.
3. The method for automatically identifying an object storage support access pattern as claimed in claim 1, wherein said step S2 further comprises the steps of:
s20: the access storage forms an access domain name according to the input endpoint information, the bucket information and the object key information stored by the object and the rule of < bucket > < endpoint >;
s21: the access storage sends a request for performing first DNS resolution on an access domain name < bucket > < endpoint > to a domain name resolution server;
s22: and the domain name resolution server carries out first DNS resolution on the access domain name < bucket > < endpoint >, and feeds back the first DNS resolution result to the access storage.
4. The method for automatically identifying an object storage support access pattern as claimed in claim 1, wherein said step S4 further comprises the steps of:
s40: if the first DNS analysis result is failure, the access storage inputs http (s)/< endpoint >/< bucket >/< object > according to endpoint information, bucket information and object key information stored by the object;
s41: the access storage sends a request for second DNS resolution on the http (s)/< endpoint >/< bucket >/< object key > to a domain name resolution server;
s42: and the domain name resolution server performs second DNS resolution on http (s)/< end >/< bucket >/< object key >, and feeds back the resolution result to the access storage.
5. The method of claim 4, wherein in step S42, the DNS server performs a second DNS resolution on < endpoint > in http (S)/< endpoint >/< bucket >/< object key >.
6. The method of claim 4, wherein the step S5 is further followed by the step S6:
s6: and if the second DNS analysis result is failure, the domain name analysis server feeds back the second DNS analysis result to the access storage as failure, and the access storage checks the reason that the second DNS analysis result is failure.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011467064.4A CN112468614B (en) | 2020-12-14 | 2020-12-14 | Method for automatically identifying access style supported by object storage |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011467064.4A CN112468614B (en) | 2020-12-14 | 2020-12-14 | Method for automatically identifying access style supported by object storage |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112468614A true CN112468614A (en) | 2021-03-09 |
| CN112468614B CN112468614B (en) | 2022-09-30 |
Family
ID=74803956
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011467064.4A Active CN112468614B (en) | 2020-12-14 | 2020-12-14 | Method for automatically identifying access style supported by object storage |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112468614B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103685611A (en) * | 2013-12-31 | 2014-03-26 | 山石网科通信技术有限公司 | Network access processing method and device |
| US20140215574A1 (en) * | 2013-01-31 | 2014-07-31 | Google Inc. | Accessing objects in hosted storage |
| US20150304414A1 (en) * | 2014-04-17 | 2015-10-22 | Go Daddy Operating Company, LLC | Allocating hosting server resources via migration paths |
| CN106027295A (en) * | 2016-05-16 | 2016-10-12 | 乐视控股（北京）有限公司 | Hosting method and hosting system for static website |
-
2020
- 2020-12-14 CN CN202011467064.4A patent/CN112468614B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140215574A1 (en) * | 2013-01-31 | 2014-07-31 | Google Inc. | Accessing objects in hosted storage |
| CN103685611A (en) * | 2013-12-31 | 2014-03-26 | 山石网科通信技术有限公司 | Network access processing method and device |
| US20150304414A1 (en) * | 2014-04-17 | 2015-10-22 | Go Daddy Operating Company, LLC | Allocating hosting server resources via migration paths |
| CN106027295A (en) * | 2016-05-16 | 2016-10-12 | 乐视控股（北京）有限公司 | Hosting method and hosting system for static website |
Non-Patent Citations (1)
| Title |
|---|
| 杨勇: "一种文件路径与属性信息分离的分布式元数据组织方法", 《中国优秀硕士学位论文全文数据库》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112468614B (en) | 2022-09-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9304808B2 (en) | Updating a workflow when a user reaches an impasse in the workflow | |
| CN110399267B (en) | PCIE (peripheral component interface express) equipment monitoring method, system and equipment of server and readable storage medium | |
| CN107453960A (en) | A kind of methods, devices and systems that test data is handled in service testing | |
| CN107133244B (en) | Method and device for testing database migration | |
| CN112148315A (en) | Software deployment method, device, server and storage medium | |
| CN108628765B (en) | Method and device for realizing Cache in open-source distributed storage software Ceph | |
| CN110781083A (en) | H5 client code setting multi-environment testing method and system | |
| CN107729097B (en) | Display page configuration method and corresponding equipment | |
| CN103927252A (en) | Cross-component log recording method, device and system | |
| CN113238965B (en) | Interface test script generation method, system and storage medium | |
| CN112468614B (en) | Method for automatically identifying access style supported by object storage | |
| CN112363762B (en) | Fusion command processing method, system, device and medium | |
| CN110807000B (en) | File repair method and device, electronic equipment and storage medium | |
| CN107229650B (en) | Test method and device | |
| CN115712397A (en) | Cache verification device, method and system | |
| JP4851566B2 (en) | DNS test apparatus, DNS test method, and DNS test program | |
| CN111539019B (en) | Processing method, device, equipment and storage medium of application module | |
| CN112751950B (en) | Address updating method and device | |
| CN111400117B (en) | Method for automatically testing Ceph cluster | |
| CN111339100B (en) | Data checking method and device | |
| CN105893241A (en) | Updating method and device for test data | |
| CN115437903A (en) | Interface test method, device, apparatus, storage medium, and program | |
| CN106202289A (en) | A kind of homepage finding method and electronic equipment | |
| CN112463444A (en) | Data inconsistency repairing method and related device | |
| CN116306409B (en) | Chip verification method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 518000 17th floor, block B, Sunshine Technology Innovation Center, No.2 Shanghua Road, Nanshan street, Nanshan District, Shenzhen City, Guangdong Province Patentee after: Shenzhen Ruiyun Technology Co.,Ltd. Patentee after: SHENZHEN YUNYU TECHNOLOGY Co.,Ltd. Address before: 518000 17th floor, block B, Sunshine Technology Innovation Center, No.2 Shanghua Road, Nanshan street, Nanshan District, Shenzhen City, Guangdong Province Patentee before: SHENZHEN RAYVISION TECHNOLOGY CO.,LTD. Patentee before: SHENZHEN YUNYU TECHNOLOGY Co.,Ltd. |
|
| CP01 | Change in the name or title of a patent holder |