CN102880430B - A kind of management system of raid-array and method - Google Patents
A kind of management system of raid-array and method Download PDFInfo
- Publication number
- CN102880430B CN102880430B CN201210348282.5A CN201210348282A CN102880430B CN 102880430 B CN102880430 B CN 102880430B CN 201210348282 A CN201210348282 A CN 201210348282A CN 102880430 B CN102880430 B CN 102880430B
- Authority
- CN
- China
- Prior art keywords
- raid
- memory extension
- group
- disk
- switch board
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The invention discloses management system and the method for a kind of raid-array (RAID), adopt the framework of full switch type to store switch board and be connected with the topology of Memory Extension cabinet, solved the performance bottleneck problem between the especially multiple Memory Extension cabinets of disk storage system and storage switch board; The every group of RAID that the present invention is directed to RAID deployment mode effectively controls the quantity of member's dish, ensures that each member's dish has independently hyperdisk passage to be connected to storage switch board and RAID check disk, has ensured the integral operation performance of RAID group.
Description
Technical field
The present invention relates to disk storage system administrative skill field, relate in particular to a kind of raid-array(RAID) management system and method.
Background technology
Along with calculating the expansion of scale and the appearance of emerging application model (as cloud computing, Internet of Things), several greatlyGrow with each passing day according to application. Raid-array (RAID, RedundantArrayofInexpensiveDisks) be widely used in large data-storage system as large storage facilities independently. Memory ExtensionCabinet is the high performance-price ratio storage elementary cell generally using, and is generally connected to storage control by FC or SAS cableCabinet processed, carries out RAID configuration management by storage switch board.
In current Storage system construction, PB level storage system is very general, high-performance calculation,In Digital Media environment, even there is single cover storage system more than 10PB. In this type of application, on the one handNumber of disks, up to thousands of, be used many cover Memory Extension cabinets, can adopt on the other hand and cross over multiple cabinetsPolylith disk configuration RAID. In traditional FC-AL framework, JBOD is modal disk extended mode.Fig. 1 is the RAID management system schematic diagram based on FC-AL framework in prior art, as shown in Figure 1, and storageBetween switch board and extension cabinet, between extension cabinet and extension cabinet, conventionally adopt the mode of similar daisy chain to open upFlutter tissue, the feature of this expansion structure is the disk channel that all disks are shared a maximum 4Gb/s, performanceBottleneck is obvious, once and this arbitrated loop go wrong, all disks all can be affected, which byGradually be eliminated; The selection of RAID member's dish adopts self-defined mode, can be limited to a cabinet inside,Also can cross over multiple cabinets. When carry out RAID configuration across multiple extension cabinet, the daisy chain between cabinetMay become performance bottleneck.
Fig. 2 is the RAID management system schematic diagram based on SAS disk channel technology in prior art. SAS pointBe the disk channel technology that current industrial circle generally adopts to a disk channel technology, no matter which is performanceOr reliability has huge lifting with respect to FC-AL: each disk-to-disk controller has independenceThe data link of 6Gb/s, be a kind of disk topological structure of switch type, but this connection only limits to diskCabinet inside, between disk chassis and disk chassis, adopt 2 each other the SAS disk channel of redundancy connect,Therefore connecting multiple disk chassis in the situation that, the SAS bandwidth chahnel between disk chassis and Magnetic Disk ControlerOutlet bandwidth will forming property bottleneck.
No matter be that FC-AL or SAS connect, its effective bandwidth maximum is only 3GB left and right, and every disk existsStorage system performance is about 60MB/S, and therefore, only 50 disks of need can be by the effective bandwidth of whole passageTake, in the large data storage environment of the magnanimity up to thousands of disks, the performance bottleneck of expansion link veryObviously. Cross over multiple Memory Extension cabinets and carry out the RAID performance in when configuration in order to promote many disks, now propose onePlant management system and the method for raid-array.
Summary of the invention
Technical problem to be solved by this invention be to provide a kind of raid-array management system andMethod, well to solve the performance bottleneck problem of many disk expansion links.
For achieving the above object, the present invention is achieved through the following technical solutions:
The management system of a kind of raid-array (RAID), described system comprise storage switch board andAt least two Memory Extension cabinets, is characterized in that, logical between described storage switch board and each Memory Extension cabinetCrossing independently data channel connects;
Wherein, described each Memory Extension cabinet is provided with the disk of predetermined quantity, and described storage switch board arrangesHave RAID controller, described RAID controller is for selecting the disk of different Memory Extension cabinet predetermined quantitiesBe configured to RAID group, and the RAID group completing based on described configuration is carried out data read-write operation.
Described RAID group comprises is selected in different Memory Extension cabinets by RAID controller that monolithic disk is configured toRAID group, wherein, in every group of RAID, the number of member's dish is 20 to the maximum.
Described independently data channel comprises the point-to-point disk channel of SAS.
Described every group of RAID member dish is by independent RAID controller or electric switch module (ESM)Parts manage.
Described storage switch board is provided with main RAID controller and from RAID controller, adopts principal and subordinate to controlBetween mode and each Memory Extension cabinet, be connected by data channel independently.
Described RAID group has data check function.
The present invention also discloses the management method of a kind of raid-array (RAID), and the method is based on bagThe management system of drawing together the raid-array of storage switch board and at least two Memory Extension cabinets realizes dataRead operation and write operation, pass through independently data channel between described storage switch board and each Memory Extension cabinetConnect, described each Memory Extension cabinet is provided with the disk of predetermined quantity, and described storage switch board arrangesThere is RAID controller,
RAID controller selects the disk of predetermined quantity in different Memory Extension cabinets to be configured to RAID group;
RAID controller writes data to be written in pre-configured RAID group;
RAID controller reads data to be read from pre-configured RAID group.
Described RAID group comprises is selected in different Memory Extension cabinets by RAID controller that monolithic disk is configured toRAID group, wherein, in every group of RAID, the number of member's dish is 20 to the maximum.
Described storage switch board is provided with main RAID controller and from RAID controller, adopts principal and subordinate to controlBetween mode and each Memory Extension cabinet, be connected by data channel independently.
Described RAID group has data check function.
Technical scheme of the present invention, adopts the framework of full switch type to store switch board and Memory Extension cabinetTopology connects, and has solved the performance between the especially multiple Memory Extension cabinets of disk storage system and storage switch boardBottleneck problem; The every group of RAID that the present invention is directed to RAID deployment mode effectively controls the quantity of member's dish, protectsDemonstrate,proving each member's dish has independently hyperdisk passage to be connected to storage switch board and RAID check disk, ensuresThe integral operation performance of RAID group.
Brief description of the drawings
Fig. 1 is the RAID management system schematic diagram based on FC-AL framework in prior art;
Fig. 2 is the RAID management system schematic diagram based on SAS disk channel technology in prior art;
Fig. 3 is the management system schematic diagram of the raid-array of the specific embodiment of the invention;
Fig. 4 is the RAID configuration management pattern diagram of the specific embodiment of the invention one;
Fig. 5 is the RAID configuration management pattern diagram of the specific embodiment of the invention two;
Fig. 6 is the RAID configuration management pattern diagram of the specific embodiment of the invention three;
Fig. 7 is the management method flow chart of the raid-array of the specific embodiment of the invention.
Detailed description of the invention
Below in conjunction with drawings and Examples, the invention will be further described.
Fig. 3 is the management system schematic diagram of the raid-array of the specific embodiment of the invention. Described systemTurnkey is drawn together storage switch board and at least two Memory Extension cabinets, described storage switch board and each Memory Extension cabinetBetween connect by data channel independently; Wherein, described each Memory Extension cabinet is provided with predetermined numberThe disk of amount, described storage switch board is provided with RAID controller, and described RAID controller is for selecting notDisk with predetermined quantity in Memory Extension cabinet is configured to RAID group, and the RAID completing based on described configurationGroup is carried out data read-write operation.
Described storage switch board is provided with main RAID controller and from RAID controller, adopts principal and subordinate to controlBetween mode and each Memory Extension cabinet, be connected by data channel independently.
As shown in Figure 3, between storage switch board and each Memory Extension cabinet, there is 1 independently high-performance SASIt is interconnected that disk channel carries out high speed, and the full switch type topology having formed from storage switch board to Memory Extension cabinet connectsConnect, avoided the performance bottleneck problem that in prior art, traditional bus connects.
Fig. 4 is the RAID configuration management pattern diagram of the specific embodiment of the invention one. As shown in Figure 4, fromIn raid-array management system, select the Memory Extension cabinet of predetermined quantity, described Memory Extension cabinet canTo select according to the order of extension cabinet or any Selection and Constitute, in the present embodiment, select Memory ExtensionCabinet 1, Memory Extension cabinet 2, Memory Extension cabinet 3 ... Memory Extension cabinet N, has two with each Memory Extension cabinetIndividual memory disk is that example describes RAID configuration management pattern. From Memory Extension cabinet 1, Memory Extension cabinet2, Memory Extension cabinet 3 ... in Memory Extension cabinet N, select respectively disk 1 to form one and cross over multiple storages expansionsThe RAID1 group of showcase; Described Memory Extension cabinet 1, Memory Extension cabinet 2, Memory Extension cabinet 3 ... storage is expandedOther disks in showcase N the like, final, the monolithic disk of each Memory Extension cabinet belongs to respectively notSame RAID group. Wherein, in each extension cabinet, the selecting sequence of disk 1 and disk 2 is not restricted. Like this,In each RAID group, each member dish is positioned at different Memory Extension cabinets, by SAS magnetic completely independentlyDish passage is connected to storage switch board, and performance or reliability all have higher guarantee.
In the present embodiment, described RAID group comprises by RAID controller selects monolithic in different Memory Extension cabinetsThe RAID group that disk is configured to, wherein, in every group of RAID, the number of member's dish is 20 to the maximum. Described every groupRAID member's dish manages by independent RAID controller or electric switch module (ESM), hasEffect has been controlled the XOR expense of every group of RAID, has ensured the integral operation performance of RAID group.
Fig. 5 is the RAID configuration management pattern diagram of the specific embodiment of the invention two. As shown in Figure 5, fromIn raid-array management system, select the Memory Extension cabinet of predetermined quantity, described Memory Extension cabinet canTo select according to the order of extension cabinet or any Selection and Constitute, in the present embodiment, select Memory ExtensionCabinet 1, Memory Extension cabinet 2 ... Memory Extension cabinet 19, Memory Extension cabinet 20 ... Memory Extension cabinet N, with oftenIt is that example describes RAID configuration management pattern that individual Memory Extension cabinet has two memory disks. From Memory ExtensionCabinet 1, Memory Extension cabinet 2 ... in Memory Extension cabinet 19, Memory Extension cabinet 20, select respectively disk 1 to formCross over the RAID1 group of multiple Memory Extension cabinets for one; Described Memory Extension cabinet 1, Memory Extension cabinet 2In Memory Extension cabinet 19, remaining disk 2 forms multiple depositing of leap with the disk 1 in Memory Extension cabinet NStorage extension cabinet RAID2 group, in Memory Extension cabinet 20 remaining disk 2 again with other Memory Extension cabinets inMonolithic disk forms other RAID group, the like, final, the monolithic disk of each Memory Extension cabinet dividesDo not belong to different RAID groups. Wherein, in each extension cabinet, the selecting sequence of disk 1 and disk 2 is not limitSystem. Like this, in each RAID group, each member's dish is positioned at different Memory Extension cabinets, by completely onlyVertical SAS disk channel is connected to storage switch board, and performance or reliability all have higher guarantee.
In the present embodiment, described RAID group comprises by RAID controller selects monolithic in different Memory Extension cabinetsThe RAID group that disk is configured to, wherein, in every group of RAID, the number of member's dish is 20 to the maximum. Described every groupRAID member's dish manages by independent RAID controller or electric switch module (ESM), hasEffect has been controlled the XOR expense of every group of RAID, has ensured the integral operation performance of RAID group.
Fig. 6 is the RAID configuration management pattern diagram of the specific embodiment of the invention three. As shown in Figure 6, fromIn raid-array management system, select the Memory Extension cabinet of predetermined quantity, described Memory Extension cabinet canTo select according to the order of extension cabinet or to select arbitrarily, in the present embodiment, selection Memory Extension cabinet 1,Memory Extension cabinet 2 ... Memory Extension cabinet N-1, Memory Extension cabinet N, RAID controller is selected different storagesIn extension cabinet, the disk of predetermined quantity is configured to RAID group, and the disk of described predetermined quantity can be according to actual feelingsCondition arranges. As shown in Figure 6, to have two memory disks be that example is to RAID configuration management mould to each Memory Extension cabinetFormula describes. The disk 1 in each Memory Extension cabinet and disk 2 are combined into virtual magnetic by RAID controllerDish, from Memory Extension cabinet 1, Memory Extension cabinet 2 ... difference in Memory Extension cabinet N-1, Memory Extension cabinet NSelect virtual disk 1, virtual disk 2 ... a leap of virtual disk N-1, virtual disk N composition is multipleThe RAID1 group of Memory Extension cabinet; The like, final, the single virtual disk of each Memory Extension cabinet dividesDo not belong to different RAID groups. Like this, in each RAID group, each member's dish is positioned at different storagesExtension cabinet, is connected to storage switch board by SAS disk channel completely independently, no matter performance or reliableProperty has higher guarantee.
In the present embodiment, described RAID group comprises by RAID controller selects in different Memory Extension cabinets twoThe RAID group being configured to after the virtual processing of disk, wherein, in every group of RAID, the number of member's dish is 20 to the maximum.Described every group of RAID member dish is undertaken by independent RAID controller or electric switch module (ESM)Manage, effectively controlled the XOR expense of every group of RAID, ensured the integral operation performance of RAID group.
Conventional RAID comprises seven kinds of basic RAID ranks from RAID0 to RAID6, also hasThe combining form of basic RAID rank, as the combination of RAID10(RAID0 and RAID1), RAID50(combination of RAID0 and RAID5) etc. Different RAID ranks are representing different memory properties, dataSecurity and carrying cost. For example, RAID0 is called again Stripe or Striping, and it has represented allThe highest memory property in RAID rank. The principle that RAID0 improves memory property is that continuous data are disperseedTo access on multiple disks, the execution that system has request of data just can be walked abreast by multiple disks, each diskExecution belongs to its part request of data. Parallel work-flow in this data can make full use of busBandwidth, significantly improve disk entirety access performance. RAID0 is irredundant configuration management pattern, when certain magneticDish breaks down and can cause the data of all disks all cannot use, and has greatly increased the probability of data degradation.Redundant configuration management mode can improve the security (as RAID1) of storage system, but this kind of pattern disk utilizesRate is low. In order to improve the security of RAID, in some RAID, increased data check function, as RAID3,RAID5, RAID6, in the time that certain disk breaks down, as long as this disk is changed, then RAID controllerCan in new building, rebuild according to data check function the data of damaging.
Fig. 7 is the management method flow chart of the raid-array of the specific embodiment of the invention. As Fig. 7Shown in, the management method of described raid-array is based on comprising storage switch board and at least two storagesThe management system of the raid-array of extension cabinet realizes data reading operation and write operation, described storage controlBetween cabinet processed and each Memory Extension cabinet, be connected by data channel independently, described storage switch board is establishedBe equipped with RAID controller, described each Memory Extension cabinet is provided with the disk of predetermined quantity,
RAID controller selects the disk of predetermined quantity in different Memory Extension cabinets to be configured to RAID group;
RAID controller writes data to be written in pre-configured RAID group;
RAID controller reads data to be read from pre-configured RAID group.
Described RAID group comprises is selected in different Memory Extension cabinets by RAID controller that monolithic disk is configured toRAID group, wherein, in every group of RAID, the number of member's dish is 20 to the maximum.
Described storage switch board is provided with main RAID controller and from RAID controller, adopts principal and subordinate to controlBetween mode and each Memory Extension cabinet, be connected by data channel independently.
Described RAID group has data check function.
Described independently data channel comprises the point-to-point disk channel of SAS.
In the scale test of 300 disks, carry out the storage system of RAID tissue based on technical solution of the present inventionSystem performance is 3.5 times of employing traditional approach system.
Technical scheme of the present invention, adopts the framework of full switch type to store switch board and Memory Extension cabinetTopology connects, and has solved the performance between the especially multiple Memory Extension cabinets of disk storage system and storage switch boardBottleneck problem; Effectively control the quantity of member's dish for the every group of RAID that adopts RAID deployment mode of the present invention,Ensure that each member's dish has independently hyperdisk passage to be connected to storage switch board and RAID check disk, protectsHinder the integral operation performance of RAID group.
Above are only preferred embodiment of the present invention and institute's application technology principle, be anyly familiar with the artIn the technical scope that technical staff discloses in the present invention, the variation that can expect easily or replacement, all should be encompassed inIn protection scope of the present invention.
Claims (8)
1. the management system of a raid-array (RAID), described system comprises storage switch board and at least two Memory Extension cabinets, it is characterized in that, between described storage switch board and each Memory Extension cabinet, be connected by data channel independently;
Wherein, described each Memory Extension cabinet is provided with the disk of predetermined quantity, described storage switch board is provided with RAID controller, described RAID controller is for selecting the disk of different Memory Extension cabinet predetermined quantities to be configured to RAID group, and the RAID group completing based on described configuration is carried out data read-write operation; Described RAID group comprises by RAID controller selects the RAID group that in different Memory Extension cabinets, monolithic disk is configured to, and in every group of RAID, the number of member's dish is 20 to the maximum.
2. the management system of raid-array according to claim 1 (RAID), is characterized in that, described independently data channel comprises the point-to-point disk channel of SAS.
3. the management system of raid-array according to claim 1 (RAID), is characterized in that, described every group of RAID member dish manages by independent RAID controller or electric switch module (ESM).
4. the management system of raid-array according to claim 1 (RAID), it is characterized in that, described storage switch board is provided with main RAID controller and from RAID controller, adopts between mode that principal and subordinate controls and each Memory Extension cabinet by data channel independently and is connected.
5. the management system of raid-array according to claim 1 (RAID), is characterized in that, described RAID group has data check function.
6. the management method of a raid-array (RAID), the management system of the raid-array of the method based on comprising storage switch board and at least two Memory Extension cabinets realizes data reading operation and write operation, between described storage switch board and each Memory Extension cabinet, be connected by data channel independently, described each Memory Extension cabinet is provided with the disk of predetermined quantity, described storage switch board is provided with RAID controller, it is characterized in that
RAID controller selects the disk of predetermined quantity in different Memory Extension cabinets to be configured to RAID group;
RAID controller writes data to be written in pre-configured RAID group;
RAID controller reads data to be read from pre-configured RAID group;
Wherein, described RAID group comprises by RAID controller selects the RAID group that in different Memory Extension cabinets, monolithic disk is configured to, and in every group of RAID, the number of member's dish is 20 to the maximum.
7. the management method of raid-array according to claim 6 (RAID), it is characterized in that, described storage switch board is provided with main RAID controller and from RAID controller, adopts between mode that principal and subordinate controls and each Memory Extension cabinet by data channel independently and is connected.
8. the management method of raid-array according to claim 6 (RAID), is characterized in that, described RAID group has data check function.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210348282.5A CN102880430B (en) | 2012-09-18 | 2012-09-18 | A kind of management system of raid-array and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210348282.5A CN102880430B (en) | 2012-09-18 | 2012-09-18 | A kind of management system of raid-array and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102880430A CN102880430A (en) | 2013-01-16 |
| CN102880430B true CN102880430B (en) | 2016-05-11 |
Family
ID=47481778
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210348282.5A Active CN102880430B (en) | 2012-09-18 | 2012-09-18 | A kind of management system of raid-array and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102880430B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103440177A (en) * | 2013-08-23 | 2013-12-11 | 浪潮电子信息产业股份有限公司 | Storage control redundancy method based on multiple NUMA physical layer partitions |
| CN106161384A (en) | 2015-04-15 | 2016-11-23 | 伊姆西公司 | For providing the method and system of the secure access to data in a mobile device |
| CN106155574B (en) * | 2015-04-17 | 2021-01-15 | 伊姆西Ip控股有限责任公司 | Method and device for constructing expandable storage device and expanded storage device |
| CN107315541A (en) * | 2017-06-16 | 2017-11-03 | 郑州云海信息技术有限公司 | A kind of method of dual controller storage extension cabinet cascade |
| CN114564237B (en) * | 2022-01-27 | 2023-07-14 | 苏州浪潮智能科技有限公司 | Method, system, terminal and storage medium for expanding disk array card connection link |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101218571B (en) * | 2005-06-27 | 2012-07-11 | 达西系统股份有限公司 | System and method for performing image postposition write operation, and bus bridge |
| JP2007087053A (en) * | 2005-09-21 | 2007-04-05 | Oki Electric Ind Co Ltd | Disk array control device and control method |
| CN101221485A (en) * | 2008-01-24 | 2008-07-16 | 创新科存储技术（深圳）有限公司 | Method for establishing redundant magnetic disk array and control device thereof |
| CN101441553B (en) * | 2008-12-18 | 2010-12-08 | 成都市华为赛门铁克科技有限公司 | Method and apparatus for creating redundant space on magnetic disk |
| CN102375703A (en) * | 2011-12-12 | 2012-03-14 | 创新科存储技术有限公司 | Method for automatically selecting disk during creating of RAID (Redundant Array of Inexpensive Disks) |
| CN102609219B (en) * | 2012-01-20 | 2015-05-06 | 华为技术有限公司 | Redundant array of independent disks RAID controller and system |
-
2012
- 2012-09-18 CN CN201210348282.5A patent/CN102880430B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN102880430A (en) | 2013-01-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102880428B (en) | The creation method of distributed Redundant Array of Independent Disks (RAID) and device | |
| CN102122235B (en) | RAID4 (redundant array of independent disks) system and data reading and writing method thereof | |
| CN102880430B (en) | A kind of management system of raid-array and method | |
| JP5444464B2 (en) | Storage system | |
| CN104407813B (en) | A kind of RAID system and method based on solid storage medium | |
| CN102622189B (en) | The device of Storage Virtualization, date storage method and system | |
| CN103733175B (en) | File processing method, device and storage equipment | |
| CN103946821B (en) | data storage architecture extension system and method | |
| US8930745B2 (en) | Storage subsystem and data management method of storage subsystem | |
| CN105843557B (en) | Redundant storage system, redundant storage method and redundant storage device | |
| CN105472047B (en) | Storage system | |
| US8914578B2 (en) | Capacity-expansion of a logical volume | |
| CN101923501B (en) | Disk array multi-level fault tolerance method | |
| CN104123100A (en) | Controlling data storage in an array of storage devices | |
| CN103793182A (en) | Scalable storage protection | |
| CN105681074A (en) | Method and device for enhancing reliability and availability of dual-computer clusters | |
| CN102135862B (en) | Disk storage system and data access method thereof | |
| CN103019893A (en) | Multi-disk fault-tolerant two-dimensional hybrid disk RAID4 system architecture and read-write method thereof | |
| US20120324202A1 (en) | Storage system comprising multiple storage control apparatus | |
| CN102164165B (en) | Management method and device for network storage system | |
| JP2015099438A (en) | Storage control device, storage control method, and storage control program | |
| CN103761059A (en) | Multi-disk storage method and system for mass data management | |
| CN105988727A (en) | RAID-based storage method and storage device | |
| CN101997919B (en) | Storage resource management method and device | |
| CN104572374B (en) | Processing method, device and the storage device of storage |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C56 | Change in the name or address of the patentee | ||
| CP03 | Change of name, title or address |
Address after: 100085 No. 1, building 3, building ten, No. 8, 813 street, Beijing, Haidian District Patentee after: Beijing Lianchuang Xinan Technology Co., Ltd. Address before: 100085, room 712, room 7, block D, Jinyu Ka Wah building, No. 9, 3rd Street, Haidian District, Beijing Patentee before: Beijing Lianchuang Xinan Technology Co.,Ltd. |