CN112468614B - Method for automatically identifying access style supported by object storage - Google Patents

Method for automatically identifying access style supported by object storage Download PDF

Info

Publication number
CN112468614B
CN112468614B CN202011467064.4A CN202011467064A CN112468614B CN 112468614 B CN112468614 B CN 112468614B CN 202011467064 A CN202011467064 A CN 202011467064A CN 112468614 B CN112468614 B CN 112468614B
Authority
CN
China
Prior art keywords
access
bucket
endpoint
storage
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011467064.4A
Other languages
Chinese (zh)
Other versions
CN112468614A (en
Inventor
周双全
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Ruiyun Technology Co ltd
Shenzhen Yunyu Technology Co ltd
Original Assignee
Shenzhen Yunyu Technology Co ltd
Shenzhen Rayvision Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Yunyu Technology Co ltd, Shenzhen Rayvision Technology Co ltd filed Critical Shenzhen Yunyu Technology Co ltd
Priority to CN202011467064.4A priority Critical patent/CN112468614B/en
Publication of CN112468614A publication Critical patent/CN112468614A/en
Application granted granted Critical
Publication of CN112468614B publication Critical patent/CN112468614B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L61/00Network arrangements, protocols or services for addressing or naming
    • H04L61/45Network directories; Name-to-address mapping
    • H04L61/4505Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols
    • H04L61/4511Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols using domain name system [DNS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a method for automatically identifying an access style supported by object storage, which comprises the following steps: accessing endpoint information, bucket information and object key information stored in a storage input object; the access storage forms an access domain name according to a < bucket > < endpoint > rule; performing first DNS analysis; if the first DNS analysis result is successful, accessing the object storage by adopting a virtual hosting style; if the first DNS analysis result is failure, inputting http (s)/< endpoint >/< bucket >/< object key >, and performing second DNS analysis; if the second DNS analysis result is successful, accessing the object storage by adopting a path style; the method can quickly and accurately select the object storage access mode, can automatically select the object storage access mode without manually confirming the object storage access mode, and effectively improves the selection speed of the object storage access mode.

Description

Method for automatically identifying access style supported by object storage
Technical Field
The invention relates to the field of object storage management, in particular to a method for automatically identifying an access style supported by object storage.
Background
In the prior art, accessing a file in an object storage generally includes two access modes, namely a path mode and a virtual managed mode. Path style (path style), which is a way for object storage to be used early, is not recommended at present, but newer object storage systems still support backward compatibility; a virtual-hosted style (virtual-hosted style) that stores a currently recommended manner of use for an object, which is supported by newer object stores but not by partially older object stores; therefore, the access mode of the object storage needs to be deployed.
In the prior art, the deployment of object stores can be divided into three categories: a first category, supporting both "path styles" and "virtual hosted styles"; the second type only supports 'virtual managed style', and the third type only supports 'path style'; because the modes supported by the object storage on the line in different time periods are different, when one object storage is accessed, the user usually needs to manually confirm which access mode the object storage supports, so that the software system is difficult to configure, and the automatic identification of the supported access pattern cannot be performed.
Accordingly, the prior art is deficient and needs improvement.
Disclosure of Invention
The invention aims to overcome the defects of the prior art, provides a method for automatically identifying access patterns supported by object storage, and solves the problem that the access patterns supported by the object storage cannot be automatically identified by manually confirming the access patterns supported by the object storage in the prior art.
The technical scheme of the invention is as follows: a method of automatically identifying an object store support access pattern, comprising the steps of:
s1: and accessing endpoint information, bucket information and object key information stored in the storage input object.
S2: the access storage forms an access domain name according to a < bucket > < endpoint > rule; and performing a first DNS resolution on the access domain name < bucket > < endpoint >.
S3: and if the first DNS analysis result is successful, accessing the object storage by adopting a virtual managed style.
S4: and if the first DNS analysis result is failure, inputting http (s)/< endpoint >/< bucket >/< object key > according to endpoint information, bucket information and object key information, and performing second DNS analysis on the http (s)/< endpoint >/< bucket >/< object key >.
S5: and if the second DNS analysis result is successful, accessing the object storage by adopting a path style.
The access object storage forms an access domain name according to an end point information, a bucket information and an object key information stored by an object according to a < bucket > < end point > rule, and carries out a first DNS analysis, if the first DNS analysis result is successful, the corresponding object storage supports virtual hosted style access, the access storage preferentially adopts the virtual hosted style access when the access object storage is accessed, if the first DNS analysis result is failed, the corresponding object storage does not support the virtual hosted access, further, the access object storage supports path style access according to the end point information, the bucket information and the object key information which are stored by the object and input http(s) and/or the bucket >/and/or the object key information, and carries out a second DNS analysis, if the second DNS analysis result is successful, the corresponding object storage supports path style access, and the access storage adopts a path style when the access object storage is accessed, the access storage can quickly and accurately select the access mode of the object storage, the access mode of the object storage does not need to be confirmed manually, the selection of the access mode of the object storage can be automatically performed through the method, and the selection speed of the access mode is effectively improved; on the other hand, the method and the device preferentially test whether the object storage to be accessed supports the virtual hosting style, preferentially select the virtual hosting style when the object storage to be accessed simultaneously supports the path style and the virtual hosting style, and improve the access efficiency.
Further, the object store in step S1 is configured to provide end information, bucket information, and object key information to the access store. The object storage in step S1 is the object storage to be accessed by the access storage, and the object storage provides the endpoint information, bucket information, and object key information before accessing the storage, and the provided endpoint information, bucket information, and object key information are determined by the object storage.
Further, the step S2 further includes the following steps:
s20: and the access storage forms an access domain name according to the input endpoint information, the bucket information and the object key information stored by the object and the < bucket > < endpoint > rule.
S21: the access store sends a request for a first DNS resolution for an access domain name < bucket > < endpoint > to a domain name resolution server.
S22: and the domain name resolution server carries out first DNS resolution on the access domain name < bucket > < endpoint >, and feeds back the first DNS resolution result to the access storage.
The access storage sends a request for performing first DNS analysis on the < bucket > < endpoint > to the domain name analysis server, completes the first DNS analysis through the domain name analysis server, sends a first DNS analysis result to the access storage, and confirms whether the corresponding object storage supports the virtual hosted style or not according to the first DNS analysis result.
Further, the step S4 further includes the following steps:
s40: and if the first DNS analysis result is failure, inputting http(s) and// < end >/< bucket >/< object key > by the access memory according to the end information, the bucket information and the object key information stored by the object.
S41: the access store sends a request to a domain name resolution server for a second DNS resolution for the http (s)/< endpoint >/< bucket >/< object key >.
S42: and the domain name resolution server performs second DNS resolution on http (s)/< end >/< bucket >/< object key >, and feeds back the resolution result to the access storage.
Preferably, in step S42, the domain name resolution server performs a second DNS resolution on < endpoint > in http (S)/< endpoint >/< bucket >/< object key >. If the first DNS analysis result is failure, the corresponding object storage does not support virtual hosted style access, whether the corresponding object storage supports path style access is further tested, corresponding http (s)/not/but/object key > is input according to end information, bucket information and object key information of the object storage, second DNS analysis is carried out on < end > in the http (s)/not/but/object key > through a domain name resolution server, and whether the corresponding object storage supports path style access is confirmed according to the second DNS analysis result.
Further, the step S5 is followed by the step S6:
s6: and if the second DNS analysis result is failure, the domain name analysis server feeds back the second DNS analysis result to the access storage as failure, and the access storage checks the reason that the second DNS analysis result is failure. There are generally two cases for the reason that the second DNS resolution result is failure, the first case: the corresponding object stores the provided endpoint information, bucket information and object key information, and errors exist, so that the second DNS analysis result is failure; in the second case: the network accessing the storage is not connected, resulting in a failure of the second DNS resolution.
By adopting the scheme, the method for automatically identifying the access mode supported by the object storage can quickly and accurately select the object storage access mode without manually confirming the access mode of the object storage, and can automatically select the object storage access mode so as to effectively improve the selection speed of the access mode; and preferentially testing whether the object storage to be accessed supports the virtual hosting style, and preferentially selecting the virtual hosting style when the object storage to be accessed simultaneously supports the path style and the virtual hosting style, so that the efficiency of accessing the object storage is improved.
Drawings
FIG. 1 is a block flow diagram of the present invention;
FIG. 2 is a block flow diagram of step S2 according to the present invention;
fig. 3 is a block diagram of the process of step S4 according to the present invention.
Detailed Description
The invention is described in detail below with reference to the figures and the specific embodiments.
Referring to fig. 1, the present invention provides a method for automatically identifying an access style supported by an object storage, comprising the following steps:
s1: and accessing endpoint information, bucket information and object key information stored in the storage input object.
Specifically, in this embodiment, the endpoint information stored by the object is: s3.amazonaws. com; the bucket information is example; the object key information is: txt.
S2: the access storage forms an access domain name according to a < bucket > < endpoint > rule; and performing a first DNS resolution on the access domain name < bucket > < endpoint >. Specifically, in this embodiment, the access domain name is example.s3. amazonaws.com.
S3: and if the first DNS analysis result is successful, accessing the object storage by adopting a virtual hosting style.
S4: and if the first DNS analysis result is failure, inputting http (s)/< endpoint >/< bucket >/< object key > according to endpoint information, bucket information and object key information, and performing second DNS analysis on the http (s)/< endpoint >/< bucket >/< object key >. Specifically, in the present embodiment, the http (s)/< end >/< bucket >/< object key > is https:// s3. amplitude.
S5: and if the second DNS analysis result is successful, accessing the object storage by adopting the path style.
The access object storage forms an access domain name according to an end information, a bucket information and an object key information stored in an object according to a < bucket > < end > rule, and carries out first DNS analysis on an example 3. example concerns.com, if the first DNS analysis result is successful, the corresponding object storage supports virtual hosted style access, the access storage preferentially adopts virtual hosted style access when the access object storage is accessed, if the first DNS analysis result is failed, the corresponding object storage does not support virtual hosted access, further, the access object storage supports path style access according to the point information, the bucket information and the object key information stored in the object storage, the https:// s3. example concerns.com/example/text, and carries out second DNS analysis, if the second DNS analysis result is successful, the access object storage adopts a path for access, and the access object storage can be selected in a rapid access mode, the access mode of the object storage does not need to be confirmed manually, and the selection of the access mode of the object storage can be automatically carried out through the method, so that the selection speed of the access mode is effectively improved; on the other hand, the method and the device preferentially test whether the object storage to be accessed supports the virtual hosting style, preferentially select the virtual hosting style when the object storage to be accessed simultaneously supports the path style and the virtual hosting style, and improve the access efficiency.
Specifically, in this embodiment, the object store in step S1 is configured to provide endpoint information, bucket information, and object key information to the access store. The object storage in step S1 is an object storage to be accessed for access storage, where the object storage provides end information, bucket information, and object key information in access storage before access, and the provided end information, bucket information, and object key information are determined by the object storage.
Referring to fig. 2, the step S2 further includes the following steps:
s20: and the access storage forms an access domain name according to the input endpoint information, the bucket information and the object key information stored by the object and the < bucket > < endpoint > rule. Specifically, in this embodiment, the access domain name is example.s3. amazonaws.com.
S21: the access store sends a request to a domain name resolution server for a first DNS resolution to access a domain name example.s3. amazonaws.com.
S22: and the domain name resolution server carries out first DNS resolution on the access domain name example.s3.amazonaws.com and feeds back the first DNS resolution result to the access storage.
The access storage sends a request for performing first DNS analysis on example.s3.amazonaws.com to a domain name analysis server, completes the first DNS analysis through the domain name analysis server, sends a first DNS analysis result to the access storage, and confirms whether the corresponding object storage supports a virtual hosting style or not according to the first DNS analysis result.
Referring to fig. 3, the step S4 further includes the following steps:
s40: if the first DNS analysis result is failure, the access storage inputs https:// s3. amplitude. com/example/test. txt according to the end information, bucket information and object key information stored by the object.
S41: the access store sends a request to a domain name resolution server for a second DNS resolution for https:// s3. amazonawcom/example/test.
S42: and the domain name resolution server performs second DNS resolution on https:// s3.amazonaws.com/example/test.txt, and feeds back a resolution result to the access storage.
In step S42, the domain name resolution server performs a second DNS resolution on < endpoint > in https:// S3. amazonaw.com/example/test.txt, where < endpoint > in this embodiment is S3. amazonaw.com. If the first DNS analysis result is failure, the corresponding object storage does not support virtual hosted style access, whether the corresponding object storage supports path style access is further tested, whether corresponding https:// s3. involved. com/example/test.txt is input according to end information, bucket information and object key information of the object storage, second DNS analysis is carried out on s3. involved. com in https:// s3. involved. com/example/test.txt through a domain name analysis server, and whether the corresponding object storage supports path style access is confirmed according to the second DNS analysis result.
Specifically, in this embodiment, the step S5 is followed by the step S6:
s6: and if the second DNS analysis result is failure, the domain name analysis server feeds back the second DNS analysis result to the access storage, and the access storage checks the reason that the second DNS analysis result is failure. The reason why the second DNS resolution result is failure generally has two cases, the first case: the corresponding object stores the provided endpoint information, bucket information and object key information, and errors exist, so that the second DNS analysis result is failure; in the second case: the network accessing the storage is not connected, resulting in a failure of the second DNS resolution.
In summary, the present invention provides a method for automatically identifying access patterns supported by object storage, which can quickly and accurately select an object storage access manner, without manually confirming the access manner of the object storage, and can automatically select an object storage access manner by the method of the present invention, thereby effectively increasing the speed of selecting the access manner; and preferentially testing whether the object storage to be accessed supports the virtual hosting style, and preferentially selecting the virtual hosting style when the object storage to be accessed simultaneously supports the path style and the virtual hosting style, so that the efficiency of accessing the object storage is improved.
The present invention is not limited to the above preferred embodiments, and any modifications, equivalent substitutions and improvements made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (6)

1. A method for automatically identifying an object store support access pattern, comprising the steps of:
s1: accessing endpoint information, bucket information and object key information stored in a storage input object;
s2: the access storage forms an access domain name according to a < bucket > < endpoint > rule; performing first DNS analysis on the access domain name < bucket > < endpoint >;
s3: if the first DNS analysis result is successful, accessing the object storage by adopting a virtual hosting style;
s4: if the first DNS analysis result is failure, inputting http (s)/< endpoint >/< bucket >/< object key > according to endpoint information, bucket information and object key information, and performing second DNS analysis on the http (s)/< endpoint >/< bucket >/< object key >;
s5: and if the second DNS analysis result is successful, accessing the object storage by adopting the path style.
2. The method for automatically identifying the access style supported by the object store according to claim 1, wherein the object store in step S1 is used for providing end information, bucket information and object key information to the access store.
3. The method for automatically identifying an object storage support access pattern as claimed in claim 1, wherein said step S2 further comprises the steps of:
s20: the access storage forms an access domain name according to the input endpoint information, bucket information and object key information stored by the object and a < bucket > < endpoint > rule;
s21: the access storage sends a request for performing first DNS resolution on an access domain name < bucket > < endpoint > to a domain name resolution server;
s22: and the domain name resolution server carries out first DNS resolution on the access domain name < bucket > < endpoint >, and feeds back the first DNS resolution result to the access storage.
4. The method for automatically identifying an object storage support access pattern as claimed in claim 1, wherein said step S4 further comprises the steps of:
s40: if the first DNS analysis result is failure, the access storage inputs http (s)/< endpoint >/< bucket >/< object > according to endpoint information, bucket information and object key information stored by the object;
s41: the access storage sends a request for second DNS resolution on the http (s)/< endpoint >/< bucket >/< object key > to a domain name resolution server;
s42: and the domain name resolution server performs second DNS resolution on http (s)/< end >/< bucket >/< object key >, and feeds back the resolution result to the access storage.
5. The method of claim 4, wherein in step S42, the DNS server performs a second DNS resolution on < endpoint > in http (S)/< endpoint >/< bucket >/< object key >.
6. The method of claim 4, wherein the step S5 is further followed by the step S6:
s6: and if the second DNS analysis result is failure, the domain name analysis server feeds back the second DNS analysis result to the access storage as failure, and the access storage checks the reason that the second DNS analysis result is failure.
CN202011467064.4A 2020-12-14 2020-12-14 Method for automatically identifying access style supported by object storage Active CN112468614B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011467064.4A CN112468614B (en) 2020-12-14 2020-12-14 Method for automatically identifying access style supported by object storage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011467064.4A CN112468614B (en) 2020-12-14 2020-12-14 Method for automatically identifying access style supported by object storage

Publications (2)

Publication Number Publication Date
CN112468614A CN112468614A (en) 2021-03-09
CN112468614B true CN112468614B (en) 2022-09-30

Family

ID=74803956

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011467064.4A Active CN112468614B (en) 2020-12-14 2020-12-14 Method for automatically identifying access style supported by object storage

Country Status (1)

Country Link
CN (1) CN112468614B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103685611A (en) * 2013-12-31 2014-03-26 山石网科通信技术有限公司 Network access processing method and device
CN106027295A (en) * 2016-05-16 2016-10-12 乐视控股(北京)有限公司 Hosting method and hosting system for static website

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9154502B2 (en) * 2013-01-31 2015-10-06 Google Inc. Accessing objects in hosted storage
US20150304414A1 (en) * 2014-04-17 2015-10-22 Go Daddy Operating Company, LLC Allocating hosting server resources via migration paths

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103685611A (en) * 2013-12-31 2014-03-26 山石网科通信技术有限公司 Network access processing method and device
CN106027295A (en) * 2016-05-16 2016-10-12 乐视控股(北京)有限公司 Hosting method and hosting system for static website

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
一种文件路径与属性信息分离的分布式元数据组织方法;杨勇;《中国优秀硕士学位论文全文数据库》;20171115;全文 *

Also Published As

Publication number Publication date
CN112468614A (en) 2021-03-09

Similar Documents

Publication Publication Date Title
CN109302522A (en) Test method, device and computer system and medium
US20120084756A1 (en) Accurate identification of software tests based on changes to computer software code
CN107453960A (en) A kind of methods, devices and systems that test data is handled in service testing
CN107133244B (en) Method and device for testing database migration
CN108347356B (en) Multi-protocol unit testing method and device, electronic equipment and storage medium
CN108459850B (en) Method, device and system for generating test script
CN112148315A (en) Software deployment method, device, server and storage medium
CN108829838A (en) A kind of account information batch processing method and server
CN107729097B (en) Display page configuration method and corresponding equipment
CN107092502B (en) Automatic application configuration method and device based on cloud operating system
CN112468614B (en) Method for automatically identifying access style supported by object storage
WO2016165461A1 (en) Automated testing method and apparatus for network management system software of telecommunications network
CN107590064A (en) A kind of application upgrade method of testing, device and system
CN110069277A (en) Using loading method, using online equipment, storage medium and device
CN109240928A (en) Test method, device, equipment and storage medium
CN112363762A (en) Fusion command processing method, system, device and medium
CN115712397A (en) Cache verification device, method and system
CN107229650B (en) Test method and device
JP4851566B2 (en) DNS test apparatus, DNS test method, and DNS test program
CN111400117B (en) Method for automatically testing Ceph cluster
CN111539019B (en) Processing method, device, equipment and storage medium of application module
CN114238143A (en) ES data number making method, system and storage medium for interface test
CN115437903A (en) Interface test method, device, apparatus, storage medium, and program
CN113704114A (en) Automatic testing method, device, equipment and medium for functional interface
CN110970083B (en) Integrated circuit repairing method and device, storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP01 Change in the name or title of a patent holder
CP01 Change in the name or title of a patent holder

Address after: 518000 17th floor, block B, Sunshine Technology Innovation Center, No.2 Shanghua Road, Nanshan street, Nanshan District, Shenzhen City, Guangdong Province

Patentee after: Shenzhen Ruiyun Technology Co.,Ltd.

Patentee after: SHENZHEN YUNYU TECHNOLOGY Co.,Ltd.

Address before: 518000 17th floor, block B, Sunshine Technology Innovation Center, No.2 Shanghua Road, Nanshan street, Nanshan District, Shenzhen City, Guangdong Province

Patentee before: SHENZHEN RAYVISION TECHNOLOGY CO.,LTD.

Patentee before: SHENZHEN YUNYU TECHNOLOGY Co.,Ltd.