CN109358866B - Multi-cloud management system for application - Google Patents
Multi-cloud management system for application Download PDFInfo
- Publication number
- CN109358866B CN109358866B CN201810907302.5A CN201810907302A CN109358866B CN 109358866 B CN109358866 B CN 109358866B CN 201810907302 A CN201810907302 A CN 201810907302A CN 109358866 B CN109358866 B CN 109358866B
- Authority
- CN
- China
- Prior art keywords
- application
- platform
- cloud
- management system
- cloud management
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/60—Software deployment
- G06F8/65—Updates
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Stored Programmes (AREA)
Abstract
The invention discloses an application-oriented multi-cloud management system. The application-oriented multi-cloud management system comprises: the application management module comprises a service directory unit and an application center unit, wherein the service directory unit provides the functions of activating, forbidding, upgrading and the like of the platform function module and supports the dynamic expansion of the platform function; the application center unit provides application management and application life cycle management, and supports the functions of downloading application, installing application, uploading application, deleting application and the like; the cloud management module can be used for receiving and managing a plurality of cloud platforms running by enterprise users; and the multi-cloud management module is used for managing different types of cloud platforms on the unified platform and providing a unified entrance.
Description
Technical Field
The invention belongs to the technical field of cloud platforms, and particularly relates to an application-oriented multi-cloud management system.
Background
With the maturity of cloud computing, the IT business of enterprise users is gradually clouded and migrated to various cloud platforms, especially to an open source cloud platform. Meanwhile, for the security consideration of enterprises, businesses with high security requirements can be deployed in private clouds, and meanwhile, in order to deal with occasions with higher expansibility, such as high concurrency requirements in a specific time period, parts of businesses can be deployed in public clouds. Moreover, with the expansion of the business scale of the enterprise, the cloud platform can be independently built at a plurality of sites. Therefore, a multi-cloud management platform for uniformly managing a plurality of cloud platforms of an enterprise, including a public cloud and a private cloud, is bound to become a future trend and is also bound to become a demand pain point of enterprise-level users. Therefore, the multi-cloud management platform needs to take the characteristics of multiple heterogeneous cloud platforms into consideration, and can rapidly bring multiple cloud platforms of different types and different sites into management.
More importantly, with the development of the internet direction of the enterprise IT application, the application needs to have faster development and online speed, and the period of online business is shortened. Therefore, applications are gradually moving towards micro services, and IT is necessary that a cloud platform supporting micro-service applications abandons the traditional resource-centric approach, can conveniently import and release applications by taking applications as a center, and thus, the online speed of IT services is increased. In the direction of the cloud platform multi-cloud development, the multi-cloud management platform also needs to have the capability of rapidly online IT services by taking the application as a center.
Some existing multi-cloud management systems simply butt joint public clouds such as an AWS (active graphics system) and an Alice cloud and private clouds such as a VMware and an Openstack cloud, cannot provide comprehensive monitoring, and cannot effectively support application release. The enterprise IT application and a plurality of cloud platforms supporting the application cannot be well combined, and the enterprise IT application and the cloud platforms supporting the application still have cracks, so that the requirement of supporting the micro-service rapid release of the business is not met. In addition, from the cloud management platform, the coupling degree of each component and service is high, online smooth upgrade and expansion are difficult, and richer functions cannot be introduced into the management platform quickly.
Disclosure of Invention
The invention aims to solve the problems in the prior art and provides an application-oriented multi-cloud management system.
In order to achieve the above object, the present invention adopts the following technical solution, and an application-oriented multi-cloud management system includes: the application management module comprises a service directory unit and an application center unit, wherein the service directory unit provides the functions of activating, forbidding, upgrading and the like of the platform function module and supports the dynamic expansion of the platform function; the application center unit provides application management and application life cycle management, and supports the functions of downloading application, installing application, uploading application, deleting application and the like; the cloud management module can be used for receiving and managing a plurality of cloud platforms running by enterprise users; and the multi-cloud management module is used for managing different types of cloud platforms on the unified platform and providing a unified entrance.
Preferably, the service directory unit calls an interface provided by the bottom layer arrangement, the application installation package and the storage mirror image to realize the management of the platform-level service, and can realize one-key installation deployment and dynamic upgrade of the platform-level service; and newly added platform-level services can be introduced into the service directory unit, and the new services are installed in the underlying micro service platform, all the services are packaged into an application installation package, and the package management tool of the micro platform services is arranged by arranging and installing the applications.
Preferably, the application center unit provides application management and application lifecycle management, supports functions of downloading applications, installing applications, uploading applications, deleting applications, and the like, and can install applications to a cloud platform resource pool inside a client platform or a multi-cloud management system.
Preferably, the cloud management module further provides statistics of virtual resources and hardware resources, and monitors and alarms resources for different clouds.
Preferably, the multi-cloud management system develops a multi-cloud management component for implementing encapsulation of the multi-cloud interface.
Preferably, the multi-cloud management system development appliance component is used for realizing management of the application; and the multi-cloud management system calls an interface of the murano to install and deploy the corresponding application to the openstack platform by means of an application management tool (murano) of the openstack, and can call interfaces provided by different clouds to install the application for the applications of other cloud platforms.
Preferably, after the user registers, the multi-cloud management system and the openstack share the authority authentication system, a domain is created for the user, a corresponding authority is allocated to the domain, and a quota is set.
Preferably, a cloud platform resource pool is arranged in the multi-cloud management system, and after a user registers and logs in, the cloud platform resource pool is automatically associated, and a quota is set, so that the user enters a cloud platform console.
Compared with the prior art, the technical scheme provided by the invention has the following beneficial effects: the technical effects of the application-oriented multi-cloud management system are mainly embodied in the following aspects:
application management, which can lead applications into an EMS cloud platform management system;
the method comprises the steps of application installation, wherein the application installation can be deployed to any cloud platform managed by EMS by one key;
the service directory can manage platform-level services and can activate, close and upgrade certain platform services in the service directory; the plug-in mechanism of the front end and the back end is provided, and the platform function can be expanded by one key;
cloud management is added, and a plurality of cloud platforms of a client can be brought into EMS (energy management system) unified management;
monitoring and alarming, namely providing resource statistics, monitoring and alarming for a plurality of cloud platforms brought into management;
online upgrade, managed enterprise applications, and components of the EMS system are hot-pluggable online upgrades.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention and not to limit the invention. In the drawings:
fig. 1 is a schematic diagram of an implementation of an application-oriented multi-cloud management system provided in an embodiment of the present invention;
FIG. 2 is an exemplary diagram of a cloud management module;
FIG. 3 is a schematic diagram of an implementation of an application center unit;
FIG. 4 is a schematic flow diagram of a cloud management module implementation;
fig. 5 is a flow diagram of an implementation of the application center unit.
Detailed Description
In order to make the technical problems, technical solutions and advantageous effects to be solved by the present invention clearer and clearer, the present invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
In the claims, the specification and the drawings of the present invention, unless otherwise expressly limited, the terms "first", "second" or "third", etc. are used for distinguishing between different items and not for describing a particular sequence.
In the claims, the specification and the drawings of the present invention, unless otherwise expressly limited, all directional or positional relationships indicated by the terms "center," "lateral," "longitudinal," "horizontal," "vertical," "top," "bottom," "inner," "outer," "upper," "lower," "front," "rear," "left," "right," "clockwise," "counterclockwise," and the like are based on the directional or positional relationships indicated in the drawings and are used for convenience in describing the present invention and for simplicity in description, but do not indicate or imply that the device or element so indicated must have a particular orientation or be constructed and operated in a particular orientation, and therefore should not be construed as limiting the scope of the present invention.
In the claims, the description and the drawings of the present application, unless otherwise expressly limited, the terms "fixedly connected" or "fixedly connected" should be interpreted broadly, that is, any connection between the two that does not have a relative rotational or translational relationship, that is, non-detachably fixed, integrally connected, and fixedly connected by other devices or elements.
In the claims, the specification and the drawings of the present invention, the terms "including", "having" and their variants, if used, are intended to be inclusive and not limiting.
As shown in fig. 1 to 5, an embodiment of the present invention provides an application-centric technical method capable of incorporating multiple heterogeneous cloud platforms (e.g., openstack, vvvare, aws) into a unified management, so as to implement unified data statistics, monitoring, and cloud platform resource operation, and support an EMS (easy cloud management system) for fast publishing of applications.
The application-oriented multi-cloud management system provided by the embodiment of the invention takes the application as a center, is oriented to application management, can realize the management of the application in a multi-cloud management platform, can install and deploy the application to different cloud platforms by one key, and really solves the requirement pain of users; moreover, a monitoring and alarming mechanism is perfected, and data monitoring and alarming on a plurality of cloud platforms are realized in real time.
In addition, the multi-cloud management system for the application realizes micro-servitization of the components and the services, all the services and the components are packaged into the application installation package, any new functional module and component can be dynamically inserted into the multi-cloud management platform in the form of the application installation package, one-key installation can be realized, online upgrade is realized, and expansibility is strong.
Specifically, the application-oriented multi-cloud management system comprises an application management module, a cloud adding management module and a multi-cloud management module.
The application management module comprises a service directory unit and an application center unit, wherein the service directory unit provides functions of activating, disabling, upgrading and the like of the platform function module and supports dynamic expansion of the platform function; the application center unit provides application management and application life cycle management, and supports the functions of downloading application, installing application, uploading application, deleting application and the like;
the cloud adding management module can be used for receiving and managing a plurality of cloud platforms which are operated by enterprise users and comprises a private cloud and a public cloud, and clients can simultaneously examine the states of the plurality of clouds and application management in the clouds through the cloud adding function, so that the purpose of optimizing the use of the users is achieved;
the multi-cloud management module manages different types of cloud platforms on a unified platform, provides a unified entrance and solves the problem of multi-cloud management. Moreover, different cloud resources are counted and monitored, so that management of a user is facilitated, micro-service of the service assembly is realized, and all services run in a micro-service platform; and the application-oriented method can realize one-key deployment of the application to the client cloud platform.
In the application management module, the service directory unit calls an interface provided by the bottom layer arrangement, the application installation package and the storage mirror image to realize the management of the platform-level service, and can realize the one-key installation deployment and the dynamic upgrade of the platform-level service; and newly added platform-level services can be introduced into the service directory unit, and the new services are installed in the underlying micro service platform, all the services are packaged into an application installation package, and the application installation package is installed by arranging a package management tool of the micro platform services
And the service directory unit also provides interface operation, and all service upgrading, installation and deployment can be operated through the interface. The running states of different services can be checked through the interface, and the difficulty of operation, maintenance and management is greatly reduced.
Therefore, the application-oriented multi-cloud management system can realize the application and the plug-in of the back-end service, and the front-end interface also realizes the plug-in. Back-end services and front-end applications developed according to the EMS development standard. The method can be installed and deployed on the EMS multi-cloud management system by one key, thus enhancing the expandability of the platform to a great extent and solving the problems of poor expandability and difficult operation and maintenance of the multi-cloud platform.
The application center unit provides application management and application life cycle management, supports functions of downloading applications, installing applications, uploading applications, deleting applications and the like, and can install the applications to an ECS resource pool in a client platform or a multi-cloud management system.
The cloud management module can be used for bringing cloud platforms of a plurality of enterprise clients, including private clouds or public clouds, into the EMS platform for unified management. Moreover, the cloud management module provides a cloud console, and can manage any cloud platform. The cloud management module also provides statistics of virtual resources and hardware resources, so that monitoring and alarming of resources are carried out on different clouds.
In addition, in order to implement operations on multiple clouds, the application-oriented multi-cloud management system needs to develop related components to interface with different clouds and call interfaces provided by the different clouds, so as to implement management on cloud platform resources, and the application-oriented multi-cloud management system develops a multi-cloud management component (peak) to implement encapsulation on a multi-cloud interface.
For monitoring of various cloud resources, monitoring tools such as a data acquisition tool zabbix can be used for realizing, and an open source tool grafana can be introduced for displaying data.
For the management of the application, the multi-cloud management system for the application develops an appliance component. For the application of the openstack cloud platform, the application-oriented multi-cloud management system calls the interface of the murano to deploy the corresponding application installation to the openstack platform by means of the application management tool murano of the openstack, and for the application of other cloud platforms, the interfaces provided by different clouds can be called to realize the installation of the application.
Moreover, after the user registers, the multi-cloud management system and the openstack share the authority authentication system, a domain is created for the user, corresponding authority is distributed for the user, a quota value is set, and the user can operate resources under the project in a cloud platform.
The platform level service will register with the service at the authority authentication at startup, consistent with other services in openstack. All resources are isolated by projects.
Each platform-level service is provided with an authority authentication middleware and an authority file, and the service sends a request to an authority authentication system for verification after receiving the request;
and after the return value is taken, checking whether the user has the right to access a certain interface, and returning the resource in the corresponding project after the authentication is passed.
In addition, a cloud platform resource pool is arranged in the multi-cloud management system, and after a user registers and logs in, the cloud platform resource pool is automatically associated, quota is set, and therefore the user enters a cloud platform console. Moreover, the cloud platform resource pool can also be used for disaster recovery, and the multi-cloud management function can backup data of the hosted customer cloud to the cloud platform resource pool.
For example, in the application-oriented multi-cloud management system, an EMS bottom layer is constructed to run a micro-service platform, all platform-level services run on the micro-service, and an orchestration, application installation package and storage mirror image component are installed in the micro-service. The main role of these three components is to install the service. Management of EMS platform level services can be achieved with these three components.
Specifically, the microservice platform is deployed first, with all platform-level services running on top of the microservice platform. The EMS-Dashboard, the authority system, the Murano and other components are manufactured into an application installation package and installed in the micro service platform, so that the application installation package can be used as a bottom layer support of the application and can be installed by a palm key to achieve the purpose of installing the application by a key.
And meanwhile, multi-cloud management, label service and an appliance are developed into an application and run in a micro-service platform. The components are communicated through rest api, so that the loose coupling effect is achieved.
The deployment process adopts automatic deployment, manual configuration is not needed in the whole process, the automation degree is high, the product maturity is high, and automatic upgrading and rollback can be realized.
It should be noted that, for micro-servitization of services and components to achieve the purpose of smooth online upgrade, all applications and services can be run on the micro-service platform by means of the open source container management tool.
While the foregoing description shows and describes the preferred embodiments of the present invention, it is to be understood that the invention is not limited to the forms disclosed herein, but is not to be construed as excluding other embodiments and is capable of use in various other combinations, modifications, and environments and is capable of changes within the scope of the inventive concept as described herein, commensurate with the above teachings, or the skill or knowledge of the relevant art. And that modifications and variations may be effected by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (7)
1. An application-oriented multi-cloud management system, comprising:
the application management module comprises a service directory unit and an application center unit, wherein the service directory unit provides the functions of activating, forbidding and upgrading the platform function module and supports the dynamic expansion of the platform function; the application center unit provides application management and application life cycle management, and supports the functions of downloading application, installing application, uploading application and deleting application;
the cloud management module can be used for receiving and managing a plurality of cloud platforms running by enterprise users; and
the multi-cloud management module is used for managing different types of cloud platforms on the unified platform and providing a unified inlet;
the service directory unit calls interfaces provided by the bottom layer arrangement, the application installation package and the storage mirror image to realize the management of the platform-level service, and realizes the one-key installation deployment and the dynamic upgrade of the platform-level service; introducing newly added platform-level services into the service directory unit, installing the newly added platform-level services into a micro service platform at the bottom layer, packaging all services and components into an application installation package, and arranging the application installation package to be a package management tool of the micro service platform; any new functional module and component are inserted into the multi-cloud management system in the form of an application installation package;
the platform-level services can perform authority authentication when being started, all resources are isolated through projects, each platform-level service is provided with an authority authentication middleware and an authority file, and the platform-level services can send requests to an authority authentication system for verification after receiving the requests;
and constructing a bottom-layer operation micro-service platform in the application-oriented multi-cloud management system, wherein all platform-level services are operated on the micro-service platform.
2. An application-oriented multi-cloud management system according to claim 1, wherein: the application center unit installs the application to a client platform or a resource pool inside a multi-cloud management system.
3. An application-oriented multi-cloud management system according to claim 1, wherein: the cloud management module also provides statistics of virtual resources and hardware resources, and monitors and alarms resources for different clouds.
4. An application-oriented multi-cloud management system according to claim 1, wherein: the multi-cloud management system develops a multi-cloud management component for realizing the encapsulation of the multi-cloud interface.
5. An application-oriented multi-cloud management system according to claim 1, wherein: the multi-cloud management system development appliance component is used for realizing management of the application; and the multi-cloud management system calls an interface of the murano to install and deploy the corresponding application to the openstack platform by means of an application management tool murano of the openstack, and calls interfaces provided by different clouds to realize the installation of the application for the applications of other cloud platforms.
6. An application-oriented multi-cloud management system according to claim 5, wherein: the multi-cloud management system and the openstack share the keystone, after a user registers, a domain is created for the user, corresponding authority is distributed to the domain, and a quota value is set.
7. An application-oriented multi-cloud management system according to claim 1, characterized in that: and a cloud platform resource pool is arranged in the multi-cloud management system, and after a user registers and logs in, the cloud platform resource pool is automatically associated, and the quota is set, so that the user enters a cloud platform console.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810907302.5A CN109358866B (en) | 2018-08-09 | 2018-08-09 | Multi-cloud management system for application |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810907302.5A CN109358866B (en) | 2018-08-09 | 2018-08-09 | Multi-cloud management system for application |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109358866A CN109358866A (en) | 2019-02-19 |
| CN109358866B true CN109358866B (en) | 2021-06-25 |
Family
ID=65349859
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810907302.5A Active CN109358866B (en) | 2018-08-09 | 2018-08-09 | Multi-cloud management system for application |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109358866B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110413262A (en) * | 2019-07-23 | 2019-11-05 | 北京启迪区块链科技发展有限公司 | A kind of management method of business function, apparatus and system |
| CN110825452A (en) * | 2019-10-10 | 2020-02-21 | 国云科技股份有限公司 | Cloud service adaptation module management method for multi-cloud management |
| CN110928662B (en) * | 2019-11-28 | 2022-09-09 | 国网信息通信产业集团有限公司 | Distributed timing task scheduler facing micro-service architecture |
| CN111049904A (en) * | 2019-12-12 | 2020-04-21 | 上海联蔚信息科技有限公司 | Method and equipment for monitoring multiple public cloud resources |
| CN111580832A (en) * | 2020-04-29 | 2020-08-25 | 电科云(北京)科技有限公司 | Application release system and method applied to heterogeneous multi-cloud environment |
| CN111835820A (en) * | 2020-05-21 | 2020-10-27 | 上海灏拓智能科技有限公司 | System and method for realizing cloud management |
| CN112748983A (en) * | 2020-12-29 | 2021-05-04 | 中国人寿保险股份有限公司上海数据中心 | OpenStack-based virtual private cloud system and construction method thereof |
| CN113407607B (en) * | 2021-06-22 | 2023-06-27 | 中国联合网络通信集团有限公司 | Multi-cloud heterogeneous data processing method and device and electronic equipment |
| CN114095315B (en) * | 2021-12-28 | 2023-10-24 | 南京纳特通信电子有限公司 | Instrument system architecture |
| CN114978856A (en) * | 2022-05-11 | 2022-08-30 | 北京辛诺创新科技有限公司 | Multi-cloud computing management platform and method |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106055388A (en) * | 2016-06-25 | 2016-10-26 | 国云科技股份有限公司 | Cloud platform application automatic deployment framework |
| CN108270728A (en) * | 2016-12-30 | 2018-07-10 | 上海华讯网络系统有限公司 | Mixing cloud management system and method based on container |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8589481B2 (en) * | 2011-09-14 | 2013-11-19 | Microsoft Corporation | Multi tenant access to applications |
-
2018
- 2018-08-09 CN CN201810907302.5A patent/CN109358866B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106055388A (en) * | 2016-06-25 | 2016-10-26 | 国云科技股份有限公司 | Cloud platform application automatic deployment framework |
| CN108270728A (en) * | 2016-12-30 | 2018-07-10 | 上海华讯网络系统有限公司 | Mixing cloud management system and method based on container |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109358866A (en) | 2019-02-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109358866B (en) | Multi-cloud management system for application | |
| US11385938B2 (en) | Cloud platform system | |
| US20210314223A1 (en) | Managing Virtual Network Functions | |
| US11146620B2 (en) | Systems and methods for instantiating services on top of services | |
| Chohan et al. | Appscale: Scalable and open appengine application development and deployment | |
| US10013291B1 (en) | Enhanced software application platform | |
| EP2633400B1 (en) | Stateful applications operating in a stateless cloud computing environment | |
| US11153297B2 (en) | Systems and methods to facilitate certificate and trust management across a distributed environment | |
| US10318273B2 (en) | Updating software components through online stores | |
| US9521194B1 (en) | Nondeterministic value source | |
| JP2021518018A (en) | Function portability for service hubs with function checkpoints | |
| CN108089913B (en) | Virtual machine deployment method of super-fusion system | |
| CN102833310B (en) | Workflow engine trunking system based on virtualization technology | |
| US20200137029A1 (en) | Secure channel for cloud deployment unit | |
| CN108667639B (en) | Resource management method and management server in private cloud environment | |
| US20190028331A1 (en) | Systems and methods for update propagation between nodes in a distributed system | |
| US10296411B1 (en) | Endpoint call backoff in a computing service environment | |
| Bunch et al. | Appscale: open-source platform-as-a-service | |
| CN106293847B (en) | A kind of method of virtual platform supporting | |
| US20190087204A1 (en) | Template-based software discovery and management in virtual desktop infrastructure (VDI) environments | |
| CN103327108A (en) | Cross-platform software management platform based on cloud and construction method thereof | |
| CN105357067A (en) | Test method and system for cloud platform | |
| CN112637304A (en) | Cross-cloud resource processing system and resource management method | |
| CN110489305B (en) | Server management method and device | |
| CN110855739A (en) | Container technology-based remote and heterogeneous resource unified management method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20221021 Address after: 100094 107-2, 1st Floor, Building 1, East Yard, No. 10, Xibeiwang East Road, Haidian District, Beijing Patentee after: Beijing easy Star Technology Development Co.,Ltd. Address before: 210012 room 109, building 4, 168 software Avenue, Yuhuatai District, Nanjing City, Jiangsu Province Patentee before: NANJING EASYSTACK SOFTWARE TECHNOLOGY CO.,LTD. |