CN107463577A - A kind of data-storage system and data search method - Google Patents

A kind of data-storage system and data search method Download PDF

Info

Publication number
CN107463577A
CN107463577A CN201610393783.3A CN201610393783A CN107463577A CN 107463577 A CN107463577 A CN 107463577A CN 201610393783 A CN201610393783 A CN 201610393783A CN 107463577 A CN107463577 A CN 107463577A
Authority
CN
China
Prior art keywords
metadata
main frame
target
file destination
file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610393783.3A
Other languages
Chinese (zh)
Other versions
CN107463577B (en
Inventor
金中良
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201610393783.3A priority Critical patent/CN107463577B/en
Publication of CN107463577A publication Critical patent/CN107463577A/en
Application granted granted Critical
Publication of CN107463577B publication Critical patent/CN107463577B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2458Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
    • G06F16/2471Distributed queries
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/14Details of searching files based on file metadata
    • G06F16/148File search processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/182Distributed file systems

Abstract

The embodiment of the invention discloses a kind of data-storage system and data search method, for distributed storage file metadata.Present invention method includes:Metadata main frame, for storage file metadata, return to the file destination metadata;Main frame is inquired about, the metadata lookup for receiving to the file destination metadata is asked, it is determined that being stored with the target metadata main frame of the file destination metadata, the file destination metadata is obtained from the target metadata main frame.When increasing with the scale of system, the main frame that can be used for the file metadata of storage is also more and more, you can and it is more and more to receive the main frame of the inquiry to file metadata, therefore will not be limited by the service ability of metadata main frame when system extends.

Description

A kind of data-storage system and data search method
Technical field
The present invention relates to electricity field, more particularly to a kind of data-storage system and data search method.
Background technology
Distributed storage technology is the key technology of big data system, and this memory technology can be more masters Being locally stored for machine shares out, using the storage system that the multiple host is unified as one.Such In storage system, what any main frame can be transparent accesses any main frame of this storage system.
Current most popular distributed storage technology is distributed file system HDFS.In HDFS In, the main frame of actual storage data file is referred to as Data Node, and HDFS system includes more Data Node.In system any Data Node can according to the Generating Data File file metadata, Then file metadata can be stored onto another specific main frame, the main frame of the storage file metadata It is referred to as Name Node.In general, in HDFS system, Name Node have two, Same content is stored respectively, it is active and standby each other.When Data Node1 application programs need to read a data During file, first Name Node are asked to return to the file metadata to the data file, then according to Name Node return this document metadata finds the main frame Data Node2 of data actual storage, finally from this Data Node2 kinds obtain the data file.
Name Node are as a main frame, and its processing to data is always limited, therefore service ability It is limited.But in actual applications, large-scale system is generally required, the Data Node in the system Quantity it is quite big, and the quantity of file metadata for needing to store is also sizable.Have simultaneously big The main frame of amount needs to scan for the file metadata of storage, because Name Node service ability is past Toward the so substantial amounts of search of reply is insufficient to, easily cause system crash so that the scale of system be difficult to after It is continuous to expand.
The content of the invention
The embodiments of the invention provide a kind of data-storage system and data search method, for distribution Storage file metadata.
In view of this, the application first aspect provides a kind of data-storage system, and the system includes:Member Data host, for storage file metadata, return to file destination metadata;Main frame is inquired about, for connecing Receive and the metadata lookup of the file destination metadata is asked, it is determined that being stored with the file destination metadata Target metadata main frame, the file destination metadata is obtained from the target metadata main frame.
The data-storage system is made up of multiple host, the quantity size of main frame, can also continue to extend. The main frame can be used as metadata main frame, for storage file metadata, and return to file metadata. The main frame is also used as inquiring about main frame, for being asked when reception to the metadata lookup of file destination metadata When asking, determine to be stored with the metadata main frame of this document metadata according to metadata lookup request, and from This document metadata is obtained in the metadata main frame.
It should be noted that the inquiry main frame and the metadata main frame may be same main frame, i.e., ought look into When asking metadata lookup request of the main frame reception to file destination metadata, asked according to the metadata lookup It is determined that when the metadata main frame for being stored with this document metadata is the machine, this document member can be obtained from the machine Data.
Because the All hosts in system can serve as the metadata main frame of storage file metadata, without It is that All Files metadata is all centrally stored on a certain specific main frame, therefore when with system When scale is increasing, the main frame that can be used for the file metadata of storage is also more and more, you can to connect Main frame by the inquiry to file metadata is more and more, therefore will not be by metadata master during system extension The limitation of the service ability of machine.
With reference to the application's in a first aspect, the first embodiment of the first aspect of the application, the system Including:Routing table main frame, for storing routing table entry, return to the target routing lists entry, the target Routing table entry is used to indicate that the file destination metadata is stored in the target metadata main frame.
With reference to the first embodiment of the first aspect of the application, second of the first aspect of the application Embodiment, the inquiry main frame include determining unit, and the determining unit is stored with target text for determination The target metadata main frame of part metadata;The determining unit includes:First determination subelement, for basis Metadata lookup request determines to be stored with the target routing lists main frame of target routing lists entry;It is single to obtain son Member, for obtaining the target routing lists in the target routing lists main frame that is determined from first determination subelement Entry;Second determination subelement, for the target routing lists entry obtained according to the acquisition subelement, It is determined that it is stored with the target metadata main frame of the file destination metadata.
Routing table entry is used to indicate that the file destination metadata is stored in the target metadata main frame.
Optionally, inquire about main frame possibly directly can not ask determination to be stored with the target by metadata lookup The target metadata main frame of file metadata, in this case, the main frame in the data-storage system is also Routing table main frame can be used as, the routing table main frame is used to store routing table entry, and the routing table entry is used The target metadata main frame of the file destination metadata is stored with instruction.
Specifically, the corresponding relation of file metadata and the metadata main frame of storage this document metadata can be with It is stored as a kind of routing table formed in the form of file directory, in the routing table each Routing table entry can indicate a file metadata and store the metadata main frame of this document metadata Corresponding relation.In embodiments of the present invention, the routing table is divided into multiple routing table entrys, deposits respectively Storage is in each main frame of system, in another angle, it may also be said to the routing table bar of the storage in system Mesh forms a complete routing table formed in the form of file directory.
Storing the target routing lists main frame of target routing lists entry can be drawn using consistent hash algorithm, then Either inquiring about main frame needs to inquire about the target routing lists main frame for being used for obtaining target routing lists entry, or Person is metadata storage host it needs to be determined that target routing lists master for storing the target routing lists entry Machine, the same main frame that can be determined.
Storing the target routing lists main frame of target routing lists entry can be drawn using consistent hash algorithm, then Either inquiring about main frame needs to inquire about the target routing lists main frame for being used for obtaining target routing lists entry, or Person is metadata storage host it needs to be determined that target routing lists master for storing the target routing lists entry Machine, the same main frame that can be determined.In addition, in general, may be used also by hash algorithm Make it that each routing table entry is that near random is equably stored on multiple host, therefore each road There is certain stationarity by the storage location of table clause.
With reference to second of embodiment of the first aspect of the application, the first aspect of the application the third Embodiment, the inquiry main frame also include:Memory cell, for when the inquiry main frame is from the target element number After the file destination metadata is obtained in main frame, the file destination metadata is stored.
With reference to the third embodiment of the first aspect of the application, the 4th kind of the first aspect of the application Embodiment, the target routing lists main frame also include:Updating block, for when the return target routing lists After entry, the target routing lists entry is updated, the target routing lists entry after being updated, the renewal Target routing lists entry afterwards is used to indicate that the file destination metadata is stored in the inquiry main frame.
The 4th kind of the third embodiment, the first aspect of the application with reference to the first aspect of the application Embodiment, the 5th kind of embodiment of the first aspect of the application, the target metadata main frame also include: Unit is deleted, after returning to the file destination metadata, deletes the file destination metadata.
The first embodiment, the application of the first aspect of first aspect, the application with reference to the application Second of embodiment of first aspect, the third embodiment of the first aspect of the application, this Shen 4th kind of embodiment of first aspect please, the 6th kind of embodiment of the first aspect of the application should Inquiry main frame also includes:Search unit, for when the inquiry main frame receive the metadata lookup request after, In local search this document metadata, if it is true to trigger the lookup main frame less than this document metadata for search Surely the step of being stored with the target metadata main frame of the file destination metadata.
The application second aspect provides a kind of data search method, for being somebody's turn to do in such as the application second aspect Any one system, this method include:Inquiring about main frame reception please to the metadata lookup of file destination metadata Ask;The inquiry main frame determines to be stored with the target metadata main frame of the file destination metadata;Inquiry master Machine obtains the file destination metadata from the target metadata main frame.
When inquiring about metadata lookup request of the main frame reception to file destination metadata, user can be passed through The search request to some data or file is needed in terminal input, according to the lookup to data or file Request determines file destination metadata, so as to generate the metadata lookup request to file destination metadata. If the target routing lists main frame and the inquiry main frame are not same main frames, the inquiry main frame can be to mesh Mark the acquisition that routing table main frame is sent to the target routing lists entry to ask, the target routing lists main frame receives This to target routing lists entry acquisition request when, return to the catalogue routing table entry.
If the target metadata main frame and the inquiry main frame are not same main frames, the inquiry main frame can be with The acquisition sent to target metadata main frame to the file destination metadata is asked, the target metadata main frame When receiving the acquisition request to file destination metadata, the catalogue routing table entry is returned.When inquiry is led , optionally, can be by target text after machine obtains the file destination metadata from the target metadata main frame Part metadata is moved to local, and deletes the file destination metadata in target metadata main frame, and Update the target routing lists entry in target routing lists main frame.
Because the All hosts in system can serve as the metadata main frame of storage file metadata, without It is that All Files metadata is all centrally stored on a certain specific main frame, therefore when with system When scale is increasing, the main frame that can be used for the file metadata of storage is also more and more, you can to connect Main frame by the inquiry to file metadata is more and more, therefore will not be by metadata master during system extension The limitation of the service ability of machine.
With reference to the second aspect of the application, the first embodiment of the second aspect of the application, this method Including:The inquiry main frame determines to be stored with the target of target routing lists entry according to metadata lookup request Routing table main frame;The inquiry main frame obtains the target routing lists entry from the target routing lists main frame;Should Inquiry main frame determines to be stored with the target element number of the file destination metadata according to the target routing lists entry According to main frame.
With reference to the second aspect of the application, second of embodiment of the second aspect of the application, this method Also include:The inquiry main frame stores the file destination metadata.
The first embodiment, the application of the second aspect of second aspect, the application with reference to the application Second aspect second of embodiment, the third embodiment of the second aspect of the application, the party Method also includes:The inquiry main frame is from the local search file destination metadata;If search the file destination Metadata, then return to the file destination metadata;If search triggers less than the file destination metadata The step of inquiry main frame determines to be stored with the target metadata main frame of the file destination metadata.
As can be seen from the above technical solutions, the embodiment of the present invention has advantages below:
Because the All hosts in system can serve as the metadata main frame of storage file metadata, without It is that All Files metadata is all centrally stored on a certain specific main frame, therefore when with system When scale is increasing, the main frame that can be used for the file metadata of storage is also more and more, you can to connect Main frame by the inquiry to file metadata is more and more, therefore will not be by metadata master during system extension The limitation of the service ability of machine.
Brief description of the drawings
Fig. 1 is the configuration diagram of data-storage system in the embodiment of the present application;
Fig. 2 is one embodiment schematic diagram that main frame is inquired about in the embodiment of the present application;
Fig. 3 is one embodiment schematic diagram of metadata main frame in the embodiment of the present application;
Fig. 4 is one embodiment schematic diagram of routing table main frame in the embodiment of the present application;
Fig. 5 is one embodiment schematic diagram of data search method in the embodiment of the present application;
Fig. 6 is another embodiment schematic diagram of data search method in the embodiment of the present application;
Fig. 7 is another embodiment schematic diagram of data search method in the embodiment of the present application;
Fig. 8 is one embodiment schematic diagram of the main frame in system in the embodiment of the present application;
Fig. 9 is another embodiment schematic diagram of the main frame in system in the embodiment of the present application.
Embodiment
The embodiments of the invention provide a kind of data-storage system and data search method, for distribution Storage file metadata.
In order that those skilled in the art more fully understand scheme of the embodiment of the present invention, below in conjunction with this Accompanying drawing in inventive embodiments, the technical scheme in the embodiment of the present invention is clearly and completely described, Obviously, described embodiment only a part of embodiment of the present invention, rather than whole embodiments. Based on the embodiment in the present invention, those of ordinary skill in the art are not under the premise of creative work is made The every other embodiment obtained, should all belong to the scope of protection of the invention.
Term " first ", " second " in description and claims of this specification and above-mentioned accompanying drawing, " Three ", the (if present) such as " 4th " is for distinguishing similar object, without specific for describing Order or precedence.It should be appreciated that the data so used can exchange in the appropriate case, so as to this In the embodiment that describes can be implemented with the order in addition to the content for illustrating or describing herein.In addition, Term " comprising " and " having " and their any deformation, it is intended that cover it is non-exclusive include, for example, Process, method, system, product or the equipment for containing series of steps or unit are not necessarily limited to clearly Those steps or unit listed, but may include not list clearly or for these processes, side The intrinsic other steps of method, product or equipment or unit.
Instantly with the development of mechanics of communication, the epoch of big data are moved towards gradually, in face of of such a size number According to amount of storage, independent storage server has been difficult to meet.Have much for the technology of big data, And distributed storage technology is the key technology of big data system.Distributed storage technology can be more masters Being locally stored for machine shares out, using the storage system that the multiple host is unified as one, when wherein appointing When what main frame needs some data or the file in system, appointing for this storage system can be accessed What main frame, so as to obtain the data or file.
Distributed file system HDFS is to be used to obtain widest distributed storage technology so far. In HDFS, the main frame of actual storage data file is referred to as data host Data Node, as Data Node not only can also obtain the data of needs with data storage or file by accessing other main frames Or file, HDFS include more such Data Node.Specific access method is to appoint in HDFS What Data Node can be according to the data or file generated file metadata, then can be by this document member number According to storage to another specifically dedicated for storing on the main frame of this document metadata, storage this document member The main frame of data is referred to as metadata main frame Name Node.It should be noted that in general, In HDFS, two Name Node are often had, it is active and standby each other, same content is stored, to prevent Wherein one faulty or uncontrollable situation such as invaded.Specifically, when answering in Data Node1 When needing to read a data or file with program, or user requires to look up one using Data Node1 When data or file, Name Node typically can be first accessed, and ask it to return to the data or file File metadata, then determine that data or file are actual according to Name Node return this document metadata The main frame Data Node2 of storage, then obtain the data or file from the Data Node2 kinds.
However, Name Node in HDFS are as a main frame, in face of the extension of system, increasingly More Data Node need to scan for data or file, and a main frame faces so big volumes of searches, Its service ability is limited.Due to Name Node service ability often be insufficient to reply so it is a large amount of Search, be likely to result in slowing for Data Node search, serious possibly even causes system to collapse Burst, so that the scale of system is difficult to continue to extend.
Therefore, in embodiments of the present invention, it is proposed that a kind of data-storage system and data search method, For distributed storage file metadata, due to the All hosts in system can storage file metadata, Without All Files metadata is all centrally stored on a certain or two specific main frame, therefore When increasing with the scale of system, it can be used for the main frame of file metadata of storage also increasingly It is more, you can it is more and more stronger to receive the service ability of the inquiry to file metadata, therefore the extension of system It will not be influenceed by the amount of storage of file metadata and on the volumes of searches of this document metadata.
In view of this, as shown in figure 1, being a kind of frame for data-storage system that the embodiment of the present invention proposes Structure schematic diagram, the data-storage system are made up of multiple host, and the main frame can be used as metadata main frame, For storage file metadata, and return to file metadata.The main frame is also used as inquiring about main frame, For when receiving the metadata lookup request to file destination metadata, being asked according to the metadata lookup It is determined that being stored with the metadata main frame of this document metadata, and this document member is obtained from the metadata main frame Data.It should be noted that the inquiry main frame and the metadata main frame may be same main frame, that is, work as , please according to the metadata lookup when inquiring about metadata lookup request of the main frame reception to file destination metadata When to ask determination to be stored with the metadata main frame of this document metadata be the machine, this document can be obtained from the machine Metadata., can also be it is determined that being stored with the member of this document metadata in other feasible embodiments During data host, first inquire about whether the machine is stored with this document metadata, be not construed as limiting herein.
Optionally, in some feasible embodiments, inquiry main frame possibly can not be looked into directly by metadata Request is looked for determine to be stored with the target metadata main frame of the file destination metadata, in this case, should Main frame in data-storage system is also used as routing table main frame, and the routing table main frame, which is used to store, to be route Table clause, the routing table entry are used to indicate the target metadata main frame for being stored with the file destination metadata. Specifically, in embodiments of the present invention, the metadata main frame of file metadata and storage this document metadata Corresponding relation can be stored as a kind of routing table formed in the form of file directory, the road One file metadata and storage this document metadata can be indicated by each routing table entry in table Metadata main frame corresponding relation.In embodiments of the present invention, the routing table is divided into multiple routes Table clause, it is respectively stored in each main frame of system, in another angle, it may also be said in system The routing table entry of storage forms a complete routing table formed in the form of file directory.
In some feasible embodiments, the target routing lists main frame of storage target routing lists entry can be adopted Drawn with consistent hash algorithm, then either inquiring about main frame needs to inquire about for obtaining target routing lists entry The target routing lists main frame, or metadata storage host it needs to be determined that for store the target route The target routing lists main frame of table clause, the same main frame that can be determined.
Specifically, as shown in Fig. 2 it is the one embodiment of main frame as inquiry main frame in a kind of system Schematic diagram, the inquiry main frame include:
Receiving unit 201, the metadata lookup for receiving to the file destination metadata are asked.
Determining unit 203, for being stored with the file destination member of the receiving unit 201 instruction according to determination The target metadata main frame of data.
Acquiring unit 204, obtained for obtaining in the target metadata main frame determined from the determining unit 203 Take the file destination metadata.
Specifically, the determining unit 203 can include:
First determination subelement 2031, the metadata lookup for being received according to the receiving unit 201 please Determination is asked to be stored with the target routing lists main frame of target routing lists entry.
Subelement 2032 is obtained, for the target routing lists master determined from first determination subelement 2031 The target routing lists entry is obtained in machine.
Second determination subelement 2033, for the target routing lists obtained according to the acquisition subelement 2032 Entry determines to be stored with the target metadata main frame of the file destination metadata.
Optionally, the inquiry main frame 200 can also include:
First memory cell 205, the mesh is obtained from the target metadata main frame for the acquiring unit 204 After marking file metadata, the file destination metadata of the acquiring unit 204 acquisition is stored.
Optionally, the inquiry main frame 200 can also include:
Search unit 202, the metadata lookup to file destination metadata is received for the receiving unit 201 After request, from the local file destination metadata, if the file destination metadata should be arrived, returning should File destination metadata, if should trigger the determining unit 203 less than the file destination metadata and perform Its function.
As shown in figure 3, it is that a kind of main frame in system shows as one embodiment of metadata main frame 300 It is intended to.
Second memory cell 301, for storage file metadata.
First returning unit 302, for returning to file destination metadata.
Optionally, the metadata main frame 300 can also include:
Unit 303 is deleted, after returning to the file destination metadata, deletes the file destination metadata.
As shown in figure 4, it is a kind of one embodiment schematic diagram of the main frame in system as routing table main frame.
3rd memory cell 401, for storing routing table entry.
Second returning unit 402, when receiving the routing inquiry request to target routing lists entry, returning should The target routing lists entry of 3rd memory cell 401 storage, the target routing lists entry are used to indicate this File destination metadata is stored in the target metadata main frame.
Optionally, the metadata main frame 400 can also include:
Updating block 403, after returning to the file destination metadata for second returning unit 402, delete Except the file destination metadata.
It is apparent to those skilled in the art that for convenience and simplicity of description, it is above-mentioned to retouch The specific work process for the unit stated, step 501 is may be referred in following embodiments of the method to step 510 Corresponding process, will not be repeated here.
For ease of understanding, below to the specific interactive stream of the data search method in the embodiment of the present invention Journey is described, referring to Fig. 5, one embodiment of data search method includes in the embodiment of the present invention:
501st, main frame reception is inquired about to ask the metadata lookup of file destination metadata.
In embodiments of the present invention, the metadata lookup of file destination metadata is asked when inquiry main frame receives When asking, the search request needed to some data or file can be inputted in terminal by user, according to this File destination metadata is determined to the search request of data or file, so as to generate to file destination metadata Metadata lookup request.In other feasible embodiments, user can be directly received to target text Part metadata metadata lookup request, such as certain download software download window in directly key entry link or Person's code so that the metadata lookup that can be received to inquiry main frame to file destination metadata can be produced Request.Either when it be server or terminal to inquire about main frame, when inquiry main frame some applies journey in operation Sequence so that need target data file, then generation, then can be with this to the demand of file destination metadata Receive and the metadata lookup of file destination metadata is asked.
In some feasible embodiments, file destination metadata or file metadata can be a chains Connect or be a seed file or be the instruction that other can indicate to store target data file, It is not construed as limiting herein.In other feasible embodiments, inquiry main frame can also receive other main frames hair The metadata lookup to file destination metadata sent is asked, and is not construed as limiting herein.
It should be noted that in embodiments of the present invention, when inquiry main frame is received to file destination metadata Metadata lookup request when, can according to metadata lookup ask determination be stored with file destination metadata Target metadata main frame.In some feasible embodiments, directly it can be asked by metadata lookup It is determined that the target metadata main frame of file destination metadata is stored with, in other feasible embodiments, It can also be realized by the concrete mode of following steps 504 to step 506.
502nd, main frame is inquired about from the local search file destination metadata.
Optionally, in some feasible embodiments, when inquiry main frame is received to file destination metadata Metadata lookup request when, can be first in the local search file destination metadata.Specifically, look into Search can be realized by the traversal of the file directory to local by asking main frame.In some feasible embodiments In, in general, most application programs, the storage of file can be divided into multiple catalogues.Different main frames, The data file of operation is stored under different catalogues, and application program is based on such a to the traversal of file File directory form.It should be noted that under normal circumstances, most application program is to file system Using and accessing for system is all the storage form for meeting file directory, if some application programs are to text The access mode of part does not meet the storage form, then can adapt to the pattern by changing application to reach Optimal performance.
In another feasible embodiment, inquiry main frame is looked into according to the metadata to file destination metadata The target metadata main frame for looking for request to determine to be stored with the file destination metadata is exactly the machine, is not made herein Limit.
If it should be noted that finding the file destination metadata by local search, perform following real The step 503 in example is applied, if not finding the file destination metadata by local search, is performed following Step 504 in embodiment is to step 506.
503rd, inquiry main frame returns to the file destination metadata.
In some feasible embodiments, when inquiring about main frame from local search to the file destination metadata, This document metadata can be then returned to, to allow inquiry main frame to pass through the file destination metadata query To target data file.
504th, main frame is inquired about to be determined to be stored with the target of target routing lists entry according to metadata lookup request Routing table main frame.
Optionally, in some feasible embodiments, when inquiry main frame is received to file destination metadata When metadata lookup is asked, it can be asked to determine to be stored with target routing lists entry according to metadata lookup Target routing lists main frame.Specifically, the metadata lookup request to file destination metadata can include One key (file directory), it then can be calculated, be obtained according to given hash function pairs key To H (key).It should be noted that any main frame, at any time, passes through given hash The function pair key is calculated, what the hash value calculated was just as, so as to ensure either to be used for Need to inquire about the inquiry main frame of the target routing lists entry, it is desired nonetheless to store the target routing lists entry Metadata main frame, corresponding node, i.e. target routing lists main frame can be always found according to hash value.Separately Outside, in general, by hash algorithm it is also possible that each routing table entry is that near random is uniform Ground is stored on multiple host, therefore the storage location of each routing table entry has certain stationarity.
In some feasible embodiments, in order to be backed up to routing table entry, to prevent some meanings be present Outer situation loses data, generally requires two or the above backs up to routing table entry, it is preferred that Target routing lists entry can be stored using two main frames, it is active and standby each other.When inquiry main frame according to Metadata lookup request determines to be stored with the target routing lists main frame of target routing lists entry, the target road There may be two or more by table main frame, it is preferred that one nearer from the machine can be selected, or Shorter one of data path.
505th, inquiry main frame obtains the target routing lists entry from the target routing lists main frame.
In some feasible embodiments, if the target routing lists main frame and the inquiry main frame are not same Main frame, the then acquisition that the inquiry main frame can be to the transmission of target routing lists main frame to the target routing lists entry Request, when the target routing lists main frame receives the acquisition request to target routing lists entry, return to the mesh Record routing table entry.In other feasible embodiments, if the target routing lists main frame and inquiry master Machine is same main frame, then can perform in similar step 502 and step 503 as in above-mentioned embodiment Shown, from the local target routing lists entry for obtaining and needing, here is omitted.It is feasible at other Embodiment in, specifically, inquiry main frame can access the target routing lists main frame, travel through the target road By the file directory of table main frame, to inquire about the target routing lists entry.
506th, main frame is inquired about to be determined to be stored with being somebody's turn to do for the file destination metadata according to the target routing lists entry Target metadata main frame.
In some feasible embodiments, because target routing lists entry instruction is stored with the file destination The target metadata main frame of metadata, therefore, it can determine to be stored with this by the target routing lists entry The target metadata main frame of file destination metadata.Specifically, due in target routing lists entry, The file destination metadata is corresponding with the target metadata main frame, then can determine that the target metadata main frame.
507th, inquiry main frame obtains the file destination metadata from the target metadata main frame.
In some feasible embodiments, if the target metadata main frame and the inquiry main frame are not same Main frame, the then acquisition that the inquiry main frame can be to the transmission of target metadata main frame to the file destination metadata Request, when the target metadata main frame receives the acquisition request to file destination metadata, return to the mesh Record routing table entry.In other feasible embodiments, if the target metadata main frame and inquiry master Machine is same main frame, then can perform such as the step 502 and step 503 in above-mentioned embodiment, herein not Repeat again.In other feasible embodiments, specifically, inquiry main frame can access the target element number According to main frame, the file directory of the target metadata main frame is traveled through, to inquire about the file destination metadata.
In some feasible embodiments, when inquiry main frame obtains the target from the target metadata main frame After file metadata, optionally, file destination metadata can be moved to local, and delete in target File destination metadata in metadata main frame, and update the target routing lists in target routing lists main frame Entry.Specifically, following embodiment step 508, step 509 and steps 510 are refer to, it is necessary to say Bright, following steps 508, step 509 and step 510 have no sequential relationship.
508th, inquiry main frame stores the file destination metadata.
In some feasible embodiments, it is preferred that when inquiry main frame determines to need that the target is commonly used During file metadata, the file destination metadata can be stored, if to cause the target is commonly used later File metadata, it is not necessary in access target metadata main frame, but directly in native query.If The scheme of the storage file destination metadata uses on a large scale in systems, then most of to inquire about main frames all The file metadata of needs can be stored, then the requirement to file metadata most of the time can be It is local to meet, therefore a large amount of reduce scans for other main frames in system, is so as to greatly improve The performance and efficiency of system.
509th, target routing lists main frame updates the target routing lists entry, the target routing lists after being updated Entry, the target routing lists entry after the renewal are used to indicate that the file destination metadata is stored in the inquiry In main frame.
In some feasible embodiments, when target routing lists main frame returns to target route to the inquiry main frame After table clause, if after the inquiry main frame can store the file destination metadata, can be to the target road The information is sent by table main frame, then the routing table main frame can update the target routing lists entry, obtain more The target routing lists entry after new.In other feasible embodiments, if systemic presupposition rule is, Store the file destination metadata after inquiring about main frame and obtaining the file destination metadata, then need not be to The target routing lists main frame sends the information, the target routing lists main frame return the catalogue routing table entry it Afterwards, you can voluntarily update the catalogue routing table entry.Optionally, the target route entry after the renewal can To indicate that the file destination metadata is stored in the inquiry main frame, in other feasible embodiments, If the target metadata main frame deletes the file destination metadata, the target routing lists main frame after the renewal It can indicate that the file destination metadata is stored in the inquiry main frame, and delete the file destination metadata Information in the target metadata main frame, specifically, refer to the step 510 in following embodiments.However, If the target metadata main frame retains the file destination metadata, the target routing lists after obtained renewal Main frame can indicate that the file destination metadata is stored in the inquiry main frame, while indicate target routing lists Main frame can indicate that the file destination metadata is stored in the target metadata main frame, not limit herein.
510th, target metadata main frame deletes the file destination metadata.
In some feasible embodiments, optionally, when target metadata main frame returns to the inquiry main frame After file destination metadata, if the target metadata main frame determines the machine and is of little use the file destination member number According to can be deleted.When target metadata main frame to the inquiry main frame return file destination metadata it Afterwards, can be to the target metadata main frame if after the inquiry main frame can store the file destination metadata The information is sent, then the routing table main frame can delete the file destination metadata.It is feasible at other In embodiment, if systemic presupposition rule is, stored after inquiring about main frame and obtaining the file destination metadata The file destination metadata, then the information need not be sent to the target metadata main frame, the target element number After the file destination metadata being returned to according to main frame, you can voluntarily delete the file destination metadata.
It should be noted that, although there is no sequential between embodiment step 508, step 509 and step 510 Relation, but step 508 and step 510 all should be corresponding with step 509.As looked into step 508 Ask main frame and store the file destination metadata, then target routing lists main frame updates the target in step 509 Routing table entry, the target routing lists entry after the renewal should indicate that the file destination metadata is stored in In the inquiry main frame.If likewise, the target metadata main frame deletes the file destination metadata, relatively Answer, target routing lists main frame should update the target routing lists entry, the target road after obtained renewal It should no longer indicate that the file destination metadata is stored in the target metadata main frame by table clause.
Step 501 is entered to step 510 by interactive flow chart to data search method in above-described embodiment Description is gone, in order to allow reader to be easier to understand, below referring to Fig. 6, the present embodiment passes through in systems The angle of main frame data inspection method is described.It should be noted that it is succinct in order to what is described, Do not include process of the inquiry main frame in local search in following examples, and do not include inquiry main frame storage The file destination metadata, target routing lists main frame update the target routing lists entry and target metadata Main frame deletes the process of the file destination metadata.Step 601 and above-described embodiment i.e. in following examples Step 501 correspondence, the step 504 of step 602 to step 605 and above-described embodiment to step 507 It is corresponding.
Another embodiment of data search method includes in the embodiment of the present invention:
601st, main frame reception is inquired about to ask the metadata lookup of file destination metadata.
602nd, main frame is inquired about to be determined to be stored with the target of target routing lists entry according to metadata lookup request Routing table main frame.
603rd, inquiry main frame obtains the target routing lists entry from the target routing lists main frame.
604th, main frame is inquired about to be determined to be stored with being somebody's turn to do for the file destination metadata according to the target routing lists entry Target metadata main frame.
605th, inquiry main frame obtains the file destination metadata from the target metadata main frame.
Step 601 is identical with the step 501 of above-described embodiment in the present embodiment, step 602 to step 605 Identical to step 507 with the step 504 of above-described embodiment, here is omitted.
In above-described embodiment step 601 to step 605 by angle in systems to data search method It is described, in order to allow reader to be easier to understand, below referring to Fig. 7, the present embodiment is by inquiring about Data inspection method is described the angle of the unilateral flow of host computer side.
Referring to Fig. 7, another embodiment of data search method includes in the embodiment of the present invention:
701st, main frame reception is inquired about to ask the metadata lookup of file destination metadata.
702nd, main frame is inquired about by from the local search file destination metadata, judging locally whether there is the mesh Mark file metadata.
703rd, inquiry main frame returns to the file destination metadata.
704th, main frame is inquired about to be determined to be stored with the target of target routing lists entry according to metadata lookup request Routing table main frame.
705th, inquiry main frame obtains the target routing lists entry from the target routing lists main frame.
706th, main frame is inquired about to be determined to be stored with being somebody's turn to do for the file destination metadata according to the target routing lists entry Target metadata main frame.
707th, inquiry main frame obtains the file destination metadata from the target metadata main frame.
708th, inquiry main frame stores the file destination metadata.
Step 701 is to the step 501 of step 708 and above-described embodiment to step 508 phase in the present embodiment Together, here is omitted.
The main frame of system can also include server in the embodiment of the present invention, and Fig. 8 is that the embodiment of the present invention carries A kind of server architecture schematic diagram supplied, the server 800 can be produced and compared because of configuration or performance difference Big difference, one or more central processing units (central processing units, CPU) can be included 822 (for example, one or more processors) and memory 832, one or more storages should With the storage medium 830 of program 842 or data 844 (such as one or more mass memory units). Wherein, memory 832 and storage medium 830 can be of short duration storage or persistently storage.It is stored in storage The program of medium 830 can include one or more modules (diagram does not mark), and each module can be with Including being operated to the series of instructions in server.Further, central processing unit 822 can be set To be communicated with storage medium 830, the series of instructions in storage medium 830 is performed on server 800 Operation.
Server 800 can also include one or more power supplys 826, one or more it is wired or Radio network interface 850, one or more input/output interfaces 858, and/or, one or one with Upper operating system 841, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM etc..
Main frame in the signified system of the embodiment of the present invention, can be terminal or server, only Possessing has the function of inquiry main frame and metadata main frame, it is preferred that can also possess routing table master The function of machine.Specifically, terminal can be used as, including mobile phone, tablet personal computer, PDA (Personal Digital Assistant, personal digital assistant), POS (Point of Sales, point-of-sale terminal), vehicle-mounted computer etc. appoint Meaning terminal device, as shown in figure 9, being illustrated by taking mobile phone as an example, for convenience of description, illustrate only The part related to the embodiment of the present invention, particular technique details do not disclose, refer to the embodiment of the present invention Method part:
Fig. 9 is illustrated that the block diagram of the part-structure of the mobile phone related to terminal provided in an embodiment of the present invention. With reference to figure 9, mobile phone includes:Radio frequency (Radio Frequency, RF) circuit 910, memory 920, Input block 930, display unit 940, sensor 950, voicefrequency circuit 960, Wireless Fidelity (wireless Fidelity, WiFi) part such as module 970, processor 980 and power supply 990.People in the art Member is appreciated that the handset structure shown in Fig. 9 does not form the restriction to mobile phone, can include than figure Show more or less parts, either combine some parts or different parts arrangement.
In several embodiments provided herein, it should be understood that disclosed system, device and Method, it can realize by another way.For example, device embodiment described above is only to show Meaning property, for example, the division of the unit, only a kind of division of logic function can when actually realizing To there is other dividing mode, such as multiple units or component can combine or be desirably integrated into another System, or some features can be ignored, or not perform.Another, shown or discussed is mutual Coupling or direct-coupling or communication connection can be INDIRECT COUPLING by some interfaces, device or unit Or communication connection, can be electrical, mechanical or other forms.
For convenience and simplicity of description, the specific work process of the server of foregoing description or terminal, can With reference to the corresponding process in above method embodiment, will not be repeated here.
The unit illustrated as separating component can be or may not be it is physically separate, make It can be for the part that unit is shown or may not be physical location, you can with positioned at a place, Or it can also be distributed on multiple NEs.Can select according to the actual needs part therein or Person's whole unit realizes the purpose of this embodiment scheme.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, Can also be that unit is individually physically present, can also two or more units be integrated in a list In member.Above-mentioned integrated unit can both be realized in the form of hardware, can also use software function list The form of member is realized.
If the integrated unit is realized in the form of SFU software functional unit and is used as independent production marketing Or in use, it can be stored in a computer read/write memory medium.Based on such understanding, sheet Part that the technical scheme of invention substantially contributes to prior art in other words or the technical scheme It can completely or partially be embodied in the form of software product, the computer software product is stored in one In storage medium, including some instructions to cause a computer equipment (can be personal computer, Server, or network equipment etc.) perform all or part of step of each embodiment methods described of the present invention Suddenly.And foregoing storage medium includes:USB flash disk, mobile hard disk, read-only storage (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CD Etc. it is various can be with the medium of store program codes.
Described above, the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations; Although the present invention is described in detail with reference to the foregoing embodiments, one of ordinary skill in the art should Work as understanding:It can still modify to the technical scheme described in foregoing embodiments, or to it Middle some technical characteristics carry out equivalent substitution;And these modifications or replacement, do not make appropriate technical solution Essence depart from various embodiments of the present invention technical scheme spirit and scope.

Claims (11)

1. a kind of data-storage system, it is characterised in that including multiple host, the system includes:
Metadata main frame, for storage file metadata, return to file destination metadata;
Main frame is inquired about, the metadata lookup for receiving to the file destination metadata is asked, it is determined that depositing The target metadata main frame of the file destination metadata is contained, is obtained from the target metadata main frame The file destination metadata.
2. system according to claim 1, it is characterised in that also include:
Routing table main frame, for storing routing table entry, return to the target routing lists entry, the mesh Mark routing table entry is used to indicate that the file destination metadata is stored in the target metadata main frame.
3. system according to claim 2, it is characterised in that the inquiry main frame includes determining unit, The determining unit is used to determine the target metadata main frame for being stored with the file destination metadata, described Determining unit includes:
First determination subelement, for asking determination to be stored with target routing lists according to the metadata lookup The target routing lists main frame of entry;
Subelement is obtained, in the target routing lists main frame that is determined from first determination subelement Obtain the target routing lists entry;
Second determination subelement, for according to it is described acquisition subelement obtain the target routing lists entry, It is determined that it is stored with the target metadata main frame of the file destination metadata.
4. system according to claim 3, it is characterised in that the inquiry main frame also includes:
Memory cell, for obtaining the target from the target metadata main frame when the inquiry main frame After file metadata, the file destination metadata is stored.
5. system according to claim 4, it is characterised in that the target routing lists main frame also includes:
Updating block, for after the target routing lists entry is returned, updating the target routing lists Entry, the target routing lists entry after being updated, the target routing lists entry after the renewal are used to refer to Show that the file destination metadata is stored in the inquiry main frame.
6. according to the system of claim 4 or 5, it is characterised in that the target metadata main frame is also Including:
Unit is deleted, after returning to the file destination metadata, deletes the file destination member number According to.
7. according to system any one of claim 1-5, it is characterised in that the inquiry main frame is also Including:
Search unit, for after the inquiry main frame receives metadata lookup request, in local The file metadata is searched for, if it is true to trigger the lookup main frame less than the file metadata for search Surely the step of being stored with the target metadata main frame of the file destination metadata.
8. a kind of data search method, it is characterised in that for any one as described in claim 1-7 System, methods described include:
Main frame reception is inquired about to ask the metadata lookup of file destination metadata;
The inquiry main frame determines to be stored with the target metadata main frame of the file destination metadata;
The inquiry main frame obtains the file destination metadata from the target metadata main frame.
9. method according to claim 8, it is characterised in that the inquiry main frame has determined storage Stating the target metadata main frame of file destination metadata includes:
The inquiry main frame determines to be stored with the mesh of target routing lists entry according to metadata lookup request Mark routing table main frame;
The inquiry main frame obtains the target routing lists entry from the target routing lists main frame;
The inquiry main frame determines to be stored with the file destination metadata according to the target routing lists entry The target metadata main frame.
10. method according to claim 8, it is characterised in that the main frame of inquiring about is from the target After the file destination metadata is obtained in metadata main frame, in addition to:
The inquiry main frame stores the file destination metadata.
11. according to claim 8-10 methods describeds, it is characterised in that the inquiry main frame is received to mesh After the metadata lookup request for marking file metadata, in addition to:
File destination metadata described in the inquiry main frame from local search;
If searching the file destination metadata, the file destination metadata is returned;
If search less than the file destination metadata, trigger the inquiry main frame determine to be stored with it is described The step of target metadata main frame of file destination metadata.
CN201610393783.3A 2016-06-06 2016-06-06 Data storage system and data searching method Active CN107463577B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610393783.3A CN107463577B (en) 2016-06-06 2016-06-06 Data storage system and data searching method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610393783.3A CN107463577B (en) 2016-06-06 2016-06-06 Data storage system and data searching method

Publications (2)

Publication Number Publication Date
CN107463577A true CN107463577A (en) 2017-12-12
CN107463577B CN107463577B (en) 2021-01-29

Family

ID=60545329

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610393783.3A Active CN107463577B (en) 2016-06-06 2016-06-06 Data storage system and data searching method

Country Status (1)

Country Link
CN (1) CN107463577B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108449376A (en) * 2018-01-31 2018-08-24 合肥和钧正策信息技术有限公司 A kind of load-balancing method of big data calculate node that serving enterprise

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102201986A (en) * 2011-05-10 2011-09-28 苏州两江科技有限公司 Zonal routing method for non-relational database Cassandra
CN102737130A (en) * 2012-06-21 2012-10-17 广州从兴电子开发有限公司 Method and system for processing metadata of hadoop distributed file system (HDFS)
CN102890678A (en) * 2011-07-20 2013-01-23 华东师范大学 Gray-code-based distributed data layout method and query method
CN103150394A (en) * 2013-03-25 2013-06-12 中国人民解放军国防科学技术大学 Distributed file system metadata management method facing to high-performance calculation
CN103647797A (en) * 2013-11-15 2014-03-19 北京邮电大学 Distributed file system and data access method thereof
CN103793534A (en) * 2014-02-28 2014-05-14 苏州博纳讯动软件有限公司 Distributed file system and implementation method for balancing storage loads and access loads of metadata
CN104391930A (en) * 2014-11-21 2015-03-04 用友软件股份有限公司 Distributed file storage device and method
CN104461792A (en) * 2014-12-03 2015-03-25 浪潮集团有限公司 HA method for clearing single-point failure of NAMENODE of HADOOP distributed file system
WO2015124042A1 (en) * 2014-02-24 2015-08-27 华为技术有限公司 Method, device and host for updating metadata stored in columns in distributed file system
CN104967641A (en) * 2014-08-15 2015-10-07 浙江大华技术股份有限公司 Method for realizing data synchronization of main/standby metadata servers and apparatus thereof
US20150304400A1 (en) * 2002-11-20 2015-10-22 Vcvc Iii Llc Semantically representing a target entity using a semantic object
WO2016033193A1 (en) * 2014-08-26 2016-03-03 Matthew Hayden Harper Distributed input/output architecture for network functions virtualization
US20160156947A1 (en) * 2012-05-31 2016-06-02 Magnum Semiconductor, Inc. Transport stream multiplexers and methods for providing packets on a transport stream

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150304400A1 (en) * 2002-11-20 2015-10-22 Vcvc Iii Llc Semantically representing a target entity using a semantic object
CN102201986A (en) * 2011-05-10 2011-09-28 苏州两江科技有限公司 Zonal routing method for non-relational database Cassandra
CN102890678A (en) * 2011-07-20 2013-01-23 华东师范大学 Gray-code-based distributed data layout method and query method
US20160156947A1 (en) * 2012-05-31 2016-06-02 Magnum Semiconductor, Inc. Transport stream multiplexers and methods for providing packets on a transport stream
CN102737130A (en) * 2012-06-21 2012-10-17 广州从兴电子开发有限公司 Method and system for processing metadata of hadoop distributed file system (HDFS)
CN103150394A (en) * 2013-03-25 2013-06-12 中国人民解放军国防科学技术大学 Distributed file system metadata management method facing to high-performance calculation
CN103647797A (en) * 2013-11-15 2014-03-19 北京邮电大学 Distributed file system and data access method thereof
WO2015124042A1 (en) * 2014-02-24 2015-08-27 华为技术有限公司 Method, device and host for updating metadata stored in columns in distributed file system
CN103793534A (en) * 2014-02-28 2014-05-14 苏州博纳讯动软件有限公司 Distributed file system and implementation method for balancing storage loads and access loads of metadata
CN104967641A (en) * 2014-08-15 2015-10-07 浙江大华技术股份有限公司 Method for realizing data synchronization of main/standby metadata servers and apparatus thereof
WO2016033193A1 (en) * 2014-08-26 2016-03-03 Matthew Hayden Harper Distributed input/output architecture for network functions virtualization
CN104391930A (en) * 2014-11-21 2015-03-04 用友软件股份有限公司 Distributed file storage device and method
CN104461792A (en) * 2014-12-03 2015-03-25 浪潮集团有限公司 HA method for clearing single-point failure of NAMENODE of HADOOP distributed file system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108449376A (en) * 2018-01-31 2018-08-24 合肥和钧正策信息技术有限公司 A kind of load-balancing method of big data calculate node that serving enterprise

Also Published As

Publication number Publication date
CN107463577B (en) 2021-01-29

Similar Documents

Publication Publication Date Title
CN106375528B (en) A kind of mobile phone ID determines method and its abnormality detection processing method
CN105512320B (en) User ranking obtaining method and device and server
CN107911249A (en) Order line sending method, device and the equipment of a kind of network equipment
CN106407303A (en) Data storage method and apparatus, and data query method and apparatus
CN106251202A (en) Maliciously order recognition methods and device
CN111639253B (en) Data weight judging method, device, equipment and storage medium
CN105630823A (en) Method, device and system for monitoring cache data based on distributed system
AU2017268599B2 (en) Method, device, server and storage medium of searching a group based on social network
CN105227352A (en) A kind of update method of user ID collection and device
CN105574170A (en) Web page link opening method and terminal
CN105095313A (en) Data access method and equipment
CN105939355A (en) Data access method and system, as well as client and server
CN105224532A (en) Data processing method and device
CN107092609A (en) A kind of information-pushing method and device
CN104750872A (en) Method and device for searching service object
CN104424304A (en) Personalized recommendation and guide system based on context awareness information and control method
CN103581224A (en) Method and device for pushing information
CN110740155B (en) Request processing method and device in distributed system
CN110737747A (en) data operation method, device and system
CN105203121A (en) Dynamically Integrating Offline And Online Suggestions In A Geographic Application
CN103326925A (en) Message push method and device
US20080005200A1 (en) Method and apparatus for synchronizing of databases connected by wireless interface
CN107463577A (en) A kind of data-storage system and data search method
WO2023143595A1 (en) Method and system for communication between processors, storage medium, and processor
CN116071614A (en) Sample data processing method, related device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20200201

Address after: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen

Applicant after: HUAWEI TECHNOLOGIES Co.,Ltd.

Address before: 210012 HUAWEI Nanjing base, 101 software Avenue, Yuhuatai District, Jiangsu, Nanjing

Applicant before: Huawei Technologies Co.,Ltd.

GR01 Patent grant
GR01 Patent grant