CN108173919A - Big data platform builds system, method, equipment and computer-readable medium - Google Patents
Big data platform builds system, method, equipment and computer-readable medium Download PDFInfo
- Publication number
- CN108173919A CN108173919A CN201711406871.3A CN201711406871A CN108173919A CN 108173919 A CN108173919 A CN 108173919A CN 201711406871 A CN201711406871 A CN 201711406871A CN 108173919 A CN108173919 A CN 108173919A
- Authority
- CN
- China
- Prior art keywords
- service
- big data
- resource
- data platform
- service request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/51—Discovery or management thereof, e.g. service location protocol [SLP] or web services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
Abstract
The present invention proposes that a kind of big data platform builds system, including:Web layers, for receiving the service request of user;Management level for receiving Web layers of service request, and generate service installation, deployment and administration order;Container floor, including multiple containers cluster, for performing the order of management level and feedback command implementing result;Resource layer, for providing carrier for the container floor.The present invention is based on containers to build big data service, and by the inconsistency of container shield bottom physical machine, therefore service does not perceive physical machine, can facilitate and carry out resource expansion and management.Meanwhile resource Heterogeneity is also solved, it can be by service arrangement beyond the clouds or in physical machine.
Description
Technical field
The present invention relates to big data technical field more particularly to a kind of big data platform build system and method, equipment and
Computer-readable medium.
Background technology
At present, building the solution of big data platform has Cloudera, Ambari etc., however bottom is all based on physics
Machine is gradually completing installing and deploying for various big data services, therefore must keep high consistency for physical machine.
Therefore, in the prior art there are still it is following the shortcomings that:
1st, the bottom of structure big data service at present is all based on physical machine, high to the coherence request of physical machine, and not
The convenient extension and management that whole resource is carried out to platform.Meanwhile it is not easy to the cloudization deployment and management of service.
2nd, since current technology can only dispose a set of service in same cluster, it is not easy to multi-user's use.
3rd, existing container programming facility can determine how to be interacted between container, however can only solve Container Management
Relevant Arrangement itself, and the Arrangement of the application based on container can not be solved.
Invention content
The embodiment of the present invention provides a kind of big data platform building method, device, equipment and computer-readable medium, with solution
Certainly or alleviate one or more technical problems of the prior art.
In a first aspect, an embodiment of the present invention provides a kind of big data platforms to build system, including:
Web layers, for receiving the service request of user;
Management level for receiving Web layers of service request, and generate service installation, deployment and administration order;
Container floor, including multiple containers cluster, for performing the order of management level and feedback command implementing result;
Resource layer, for providing carrier for the container floor.
With reference to first aspect, in the first realization method of first aspect, described Web layers is interacted the present invention by user
Interface receives the service request of user.
With reference to first aspect, in second of realization method of first aspect, the management level include the present invention:Management clothes
Be engaged in device, database, from node, scheduling of resource module and client-side interface;
The management server, for receiving Web layers of service request;
It is described from node, for the service request of asynchronous execution user, and send call signal to the scheduling of resource mould
Block and client-side interface;
For being managed collectively the resource information of each container cluster, resource is distributed for service for the scheduling of resource module;
The client-side interface for accessing the cluster of container floor, issues and services installation, deployment and the order managed to institute
It states in container cluster, and obtains command execution results;
The database, information, container cluster and the service after the completion of information, service arrangement for storage service request
Resource information..
With reference to first aspect, in the third realization method of first aspect, the container cluster includes multiple the present invention
Node, each node include multiple service modules, and each service module includes multiple containers.
With reference to first aspect, the present invention in the 4th kind of realization method of first aspect, the resource layer include high in the clouds and
Physical machine.
Second aspect, an embodiment of the present invention provides a kind of big data platform building methods, include the following steps:
Pass through the service request of Web layers of reception user;
Web layers of service request is received by management level, and generates service installation, deployment and administration order;
Order and the feedback command implementing result of management level are performed by container floor, the container floor includes multiple containers collection
Group, and be deployed in resource layer.
With reference to second aspect, the present invention is described to pass through Web layers of reception user in the first realization method of second aspect
Service request include:The service request of user is received by user interface.
With reference to second aspect, the present invention is described to receive Web by management level in second of realization method of second aspect
The service request of layer, and generate the step of servicing installation, deployment and administration order and include:
Web layers of service request is received by management server;
By performing the service request of user from node asynchronous, and call signal is sent to the scheduling of resource module and visitor
Family end interface;
The resource information of each container cluster is managed collectively by scheduling of resource module, resource is distributed for service;
The cluster of container floor is accessed by client-side interface, the order for issue service installation, disposing and managing to the appearance
In device cluster, and obtain command execution results;
Pass through information, container cluster and the service resource after the completion of the information of database purchase service request, service arrangement
Information.
With reference to second aspect, in the third realization method of second aspect, the container cluster includes multiple the present invention
Node, each node include multiple service modules, and each service module includes multiple containers.
With reference to second aspect, the present invention in the 4th kind of realization method of second aspect, the resource layer include high in the clouds and
Physical machine.
The function of the system by hardware can also be performed corresponding software and be realized by hardware realization.It is described
Hardware or software include the one or more and corresponding module of above-mentioned function.
In a possible design, the structure that big data platform builds system includes processor and memory, described
Memory supports big data platform to build the journey that system performs big data platform building method in above-mentioned second aspect for storing
Sequence, the processor are configurable for performing the program stored in the memory.The big data platform builds system also
It can include communication interface, system and other equipment or communication are built for big data platform.
The third aspect, an embodiment of the present invention provides a kind of computer-readable mediums, are built for storing big data platform
Computer software instructions used in system, including for performing involved by the big data platform building method of above-mentioned second aspect
Program.
A technical solution in above-mentioned technical proposal has the following advantages that or advantageous effect:The embodiment of the present invention is based on holding
Device builds big data service, and by the inconsistency of container shield bottom physical machine, therefore service does not perceive physical machine, Ke Yifang
Just resource expansion and management are carried out.Meanwhile resource Heterogeneity is also solved, it can be by service arrangement beyond the clouds or physical machine
On.In addition, affixing one's name to multiple nodes in the middle part of container cluster, different service modules is disposed in each node, it on the one hand can be in order to
Multi-user uses, and on the other hand can be arranged on different vessels in one node, user only perceives and is served by, Bu Huizhi
It connects and perceives container resource.
Above-mentioned general introduction is merely to illustrate that the purpose of book, it is not intended to be limited in any way.Except foregoing description
Schematical aspect, except embodiment and feature, by reference to attached drawing and the following detailed description, the present invention is further
Aspect, embodiment and feature will be what is be readily apparent that.
Description of the drawings
In the accompanying drawings, unless specified otherwise herein, otherwise represent the same or similar through the identical reference numeral of multiple attached drawings
Component or element.What these attached drawings were not necessarily to scale.It should be understood that these attached drawings are depicted only according to the present invention
Some disclosed embodiments, and should not serve to limit the scope of the present invention.
Fig. 1 is that the big data platform of embodiment one builds the Organization Chart of system;
Fig. 2 is that the big data platform of embodiment one builds the signal transmission schematic diagram of system;
Fig. 3 is the schematic diagram of the container cluster of embodiment one;
Fig. 4 is the step flow chart of the big data platform building method of embodiment three;
Fig. 5 is the specific steps flow chart of the step S120 of embodiment three;
Fig. 6 is that the big data platform of embodiment five builds equipment connection block diagram.
Specific embodiment
Hereinafter, certain exemplary embodiments are simply just described.As one skilled in the art will recognize that
Like that, without departing from the spirit or scope of the present invention, described embodiment can be changed by various different modes.
Therefore, attached drawing and description are considered essentially illustrative rather than restrictive.
The embodiment of the present invention is aimed to solve the problem that or alleviated to be needed to be deployed in physical machine when big data platform in the prior art is built
On, resource expansion and the Related Technical Issues of management are carried out to platform so as to inconvenient.The embodiment of the present invention mainly employs base
In the technical solution of container structure big data service, so as to shield the inconsistency of bottom physical machine, to solve the prior art
One or more technical problems.The expansion for carrying out technical solution by following embodiment separately below describes.
Embodiment one
It please refers to Fig.1 and Fig. 2, is respectively that the big data platform of the embodiment of the present invention one builds the Organization Chart and letter of system
Number transmission schematic diagram.The present embodiment one provides a kind of big data platform and builds system, including:Web layers 110, management level 120,
Container floor 130 and resource layer 140.
The Web layers 110, for receiving the service request of user.
Wherein, the Web layers 110 can interact the service request that (UI) interface 111 receives user by user.Work as Web
After layer 110 receives the service request of user, request can be forwarded to by http modes in management level 120.
The management level 120 for receiving Web layers of service request, and generate service installation, deployment and administration order.
Specifically, the management level 120 include:Management server 121, from node (salve) 123, scheduling of resource module
(resource-scheduler) 124, client-side interface 124 and database 125.
The management server 121, for receiving Web layers of service request.Specifically, in the present embodiment one, it is described
Management server 121 can receive Web layers of service request by Rest-Api.
It is described from node 122, for the service request of asynchronous execution user, and send call signal to the scheduling of resource
Module and client-side interface.
The scheduling of resource module 123, for being managed collectively the resource information of each container cluster, for service distribution money
Source.
The client-side interface 124 for accessing the cluster of container floor, issues the order of service installation, deployment and management
Into the container cluster, and obtain command execution results;
The database 125, the information for storage service request, the information after the completion of service arrangement, container cluster and
Service Source information.
The container floor 130, including multiple containers cluster 131, for performing the order of management level and feedback command is held
Row result.As shown in figure 3, the container cluster 131 includes multiple nodes (node), each node (node) includes multiple clothes
Business module, each service module include multiple containers (container).
The resource layer 140, for providing carrier for the container floor.In the present embodiment one, the resource layer includes
Physical machine.
The big data platform for introducing the present embodiment one in detail below builds systematic difference steps flow chart:
First, user can submit corresponding service request by Web layers 110.Then, by Web layers 110 by the use
Family request is sent in management level 120, asks installation, deployment and the management of execution service according to user by management level 120.
Wherein, the unified service request for receiving user of management server 121 is first passed through, then writes request results and information
Enter in database 125, finally again by seeking unity of action and handling from node 122.
It is described to pass through related service that scheduling of resource module 123 and client-side interface 124 is called to perform user from node 122
Request.Specifically, being managed collectively the resource information of each container cluster by scheduling of resource module 123, resource is distributed for service.
Then, the container cluster 131 of container floor 130 then by client-side interface 124 is accessed, issues service installation, deployment and management
It orders in the container cluster 131, and obtains command execution results.In the present embodiment one, the container floor 130 can portion
Administration is in the physical machine of resource layer 140.
Embodiment two
The present embodiment two provides a kind of big data platform and builds system, identical with the basic framework of embodiment one,
Difference lies in:The resource layer 140 of the present embodiment two includes high in the clouds and physical machine, and the container floor 130 can be deployed in cloud simultaneously
On end and physical machine.Wherein, in the present embodiment two, the high in the clouds includes public cloud and private clound.User can be as needed,
Big data platform is built in public cloud or private clound.
The overall architecture that the big data platform of the present embodiment two builds system is identical with embodiment one with operation logic, therefore not
It repeats again.
Embodiment three
The present embodiment three corresponds to embodiment one, provides a kind of big data platform building method.Referring to Fig. 4, it is
The step flow chart of the big data platform building method of the present embodiment three.
The big data platform building method of the present embodiment three, includes the following steps:
S110:Pass through the service request of Web layers of reception user.
In one embodiment, the service request of user can be received by user interface in this step S110.
S120:Web layers of service request is received by management level, and generates service installation, deployment and administration order.
As shown in figure 5, in this step S120, specifically include:
S121:Web layers of service request is received by management server.
S122:By performing the service request of user from node asynchronous, and call signal is sent to the scheduling of resource mould
Block and client-side interface.
S123:The resource information of each container cluster is managed collectively by scheduling of resource module, resource is distributed for service.
S124:The cluster of container floor is accessed by client-side interface, the order for issue service installation, disposing and managing to institute
It states in container cluster, and obtains command execution results.
S125:Pass through information, container cluster and the service after the completion of the information of database purchase service request, service arrangement
Resource information.
S130:Order and the feedback command implementing result of management level are performed by container floor, the container floor includes multiple
Container cluster, and be deployed in resource layer.In the present embodiment three, the resource layer includes physical machine, the container floor deployment
In physical machine.The container cluster includes multiple nodes, and each node includes multiple service modules, each service module packet
Include multiple containers.
The present embodiment three is identical with the principle of embodiment one, and so it will not be repeated.
Example IV
The present embodiment four provides a kind of big data platform building method, identical with the basic step of embodiment three,
Difference lies in:The resource layer of the present embodiment four includes high in the clouds and physical machine, and the container floor can be disposed beyond the clouds and object simultaneously
On reason machine.Wherein, in the present embodiment four, the high in the clouds includes public cloud and private clound.User can be as needed, will count greatly
According to platform building in public cloud or private clound.
The application mode of the present embodiment four is identical with embodiment three with principle, and so it will not be repeated.
Embodiment five
The embodiment of the present invention five provides a kind of big data platform and builds equipment, as shown in fig. 6, the equipment includes:Memory
310 and processor 320,310 memory of memory contain the computer program that can be run on the processor 320.The processor 320
The big data platform building method in above-described embodiment is realized when performing the computer program.The memory 310 and processing
The quantity of device 320 can be one or more.
The equipment further includes:
Communication interface 330 for communicating with external device, carries out data interaction.
Memory 310 may include high-speed RAM memory, it is also possible to further include nonvolatile memory (non-
Volatile memory), a for example, at least magnetic disk storage.
If memory 310, processor 320 and the independent realization of communication interface 330, memory 310,320 and of processor
Communication interface 330 can be connected with each other by bus and complete mutual communication.The bus can be Industry Standard Architecture
Structure (ISA, Industry Standard Architecture) bus, external equipment interconnection (PCI, Peripheral
Component) bus or extended industry-standard architecture (EISA, Extended Industry Standard
Component) bus etc..The bus can be divided into address bus, data/address bus, controlling bus etc..For ease of representing, Fig. 6
In only represented with a thick line, it is not intended that an only bus or a type of bus.
Optionally, in specific implementation, if memory 310, processor 320 and communication interface 330 are integrated in one piece of core
On piece, then memory 310, processor 320 and communication interface 330 can complete mutual communication by internal interface.
In the description of this specification, reference term " one embodiment ", " example ", " is specifically shown " some embodiments "
The description of example " or " some examples " etc. means specific features, structure, material or the spy for combining the embodiment or example description
Point is contained at least one embodiment of the present invention or example.Moreover, particular features, structures, materials, or characteristics described
It may be combined in any suitable manner in any one or more of the embodiments or examples.In addition, without conflicting with each other, this
The technical staff in field can be by the different embodiments or examples described in this specification and the spy of different embodiments or examples
Sign is combined.
In addition, term " first ", " second " are only used for description purpose, and it is not intended that instruction or hint relative importance
Or the implicit quantity for indicating indicated technical characteristic." first " is defined as a result, the feature of " second " can be expressed or hidden
Include at least one this feature containing ground.In the description of the present invention, " multiple " are meant that two or more, unless otherwise
It is clearly specific to limit.
Any process described otherwise above or method description are construed as in flow chart or herein, represent to include
Module, segment or the portion of the code of the executable instruction of one or more the step of being used to implement specific logical function or process
Point, and the range of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discuss suitable
Sequence, including according to involved function by it is basic simultaneously in the way of or in the opposite order, to perform function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system, including the system of processor or other can be held from instruction
The system of row system, device or equipment instruction fetch and execute instruction) it uses or combines these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium " can any can be included, store, communicate, propagate or pass
Defeated program is for instruction execution system, device or equipment or the dress used with reference to these instruction execution systems, device or equipment
It puts.
Computer-readable medium described in the embodiment of the present invention can be that computer-readable signal media or computer can
Storage medium either the two is read arbitrarily to combine.The more specific example of computer readable storage medium is at least (non-poor
Property list to the greatest extent) including following:Electrical connection section (electronic device) with one or more wiring, portable computer diskette box (magnetic
Device), random access memory (RAM), read-only memory (ROM), erasable edit read-only storage (EPROM or flash
Memory), fiber device and portable read-only memory (CDROM).In addition, computer readable storage medium even can be with
It is the paper or other suitable media that can print described program on it, because can be for example by being carried out to paper or other media
Optical scanner is then handled described electronically to obtain into edlin, interpretation or when necessary with other suitable methods
Program is then stored in computer storage.
In embodiments of the present invention, computer-readable signal media can be included in a base band or as a carrier wave part
The data-signal of propagation, wherein carrying computer-readable program code.The data-signal of this propagation may be used a variety of
Form, including but not limited to electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media is also
Can be any computer-readable medium other than computer readable storage medium, which can send, pass
Either transmission is broadcast for instruction execution system, input method or device use or program in connection.Computer can
Reading the program code included on medium can be transmitted with any appropriate medium, including but not limited to:Wirelessly, electric wire, optical cable, penetrate
Frequently (Radio Frequency, RF) etc. or above-mentioned any appropriate combination.
It should be appreciated that each section of the present invention can be realized with hardware, software, firmware or combination thereof.Above-mentioned
In embodiment, software that multiple steps or method can in memory and by suitable instruction execution system be performed with storage
Or firmware is realized.If for example, with hardware come realize in another embodiment, can be under well known in the art
Any one of row technology or their combination are realized:With for the logic gates to data-signal realization logic function
Discrete logic, have suitable combinational logic gate circuit application-specific integrated circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Those skilled in the art are appreciated that realize all or part of step that above-described embodiment method carries
Suddenly it is that relevant hardware can be instructed to complete by program, the program can be stored in a kind of computer-readable storage medium
In matter, the program when being executed, one or a combination set of the step of including embodiment of the method.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing module, it can also
That each unit is individually physically present, can also two or more units be integrated in a module.Above-mentioned integrated mould
The form that hardware had both may be used in block is realized, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized in the form of software function module and is independent product sale or in use, can also be stored in a computer
In readable storage medium storing program for executing.The storage medium can be read-only memory, disk or CD etc..
In conclusion the embodiment of the present invention, which is based on container, builds big data service, pass through container shield bottom physical machine
Inconsistency, therefore service does not perceive physical machine, can facilitate and carry out resource expansion and management.Meanwhile it is different to also solve resource
Structure problem, can be by service arrangement beyond the clouds or in physical machine.In addition, multiple nodes, Mei Gejie are affixed one's name in the middle part of container cluster
Different service modules is disposed in point, on the one hand can use in order to multi-user, on the other hand different vessels can be arranged on
In one node, user only perceives and is served by, and will not directly perceive container resource.
The above description is merely a specific embodiment, but protection scope of the present invention is not limited thereto, any
Those familiar with the art in the technical scope disclosed by the present invention, can readily occur in its various change or replacement,
These should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be with the guarantor of the claim
It protects subject to range.
Claims (12)
1. a kind of big data platform builds system, which is characterized in that including:
Web layers, for receiving the service request of user;
Management level for receiving Web layers of service request, and generate service installation, deployment and administration order;
Container floor, including multiple containers cluster, for performing the order of management level and feedback command implementing result;
Resource layer, for providing carrier for the container floor.
2. big data platform according to claim 1 builds system, which is characterized in that described Web layers is interacted by user
Interface receives the service request of user.
3. big data platform according to claim 1 builds system, which is characterized in that the management level include:Management clothes
Be engaged in device, from node, scheduling of resource module, database and client-side interface;
The management server, for receiving Web layers of service request;
It is described from node, for the service request of asynchronous execution user, and send call signal to the scheduling of resource module and
Client-side interface;
For being managed collectively the resource information of each container cluster, resource is distributed for service for the scheduling of resource module;
The client-side interface for accessing the cluster of container floor, issues and services installation, deployment and the order managed to the appearance
In device cluster, and obtain command execution results;
The database, the information after the completion of information, service arrangement, container cluster and service resource for storage service request
Information.
4. big data platform according to claim 1 builds system, which is characterized in that the container cluster includes multiple sections
Point, each node include multiple service modules, and each service module includes multiple containers.
5. big data platform according to claim 1 builds system, which is characterized in that the resource layer includes high in the clouds and object
Reason machine.
6. a kind of big data platform building method, which is characterized in that include the following steps:
Pass through the service request of Web layers of reception user;
Web layers of service request is received by management level, and generates service installation, deployment and administration order;
Order and the feedback command implementing result of management level are performed by container floor, the container floor includes multiple containers cluster,
And it is deployed in resource layer.
7. big data platform building method according to claim 6, which is characterized in that described to pass through Web layers of reception user
Service request include:The service request of user is received by user interface.
8. big data platform building method according to claim 6, which is characterized in that described to receive Web by management level
The service request of layer, and generate the step of servicing installation, deployment and administration order and include:
Web layers of service request is received by management server;
By performing the service request of user from node asynchronous, and send call signal to scheduling of resource module and client and terminate
Mouthful;
The resource information of each container cluster is managed collectively by scheduling of resource module, resource is distributed for service;
The cluster of container floor is accessed by client-side interface, the order for issue service installation, disposing and managing to the sets of containers
In group, and obtain command execution results;
Pass through information, container cluster and the service resource information after the completion of the information of database purchase service request, service arrangement.
9. big data platform building method according to claim 6, which is characterized in that the container cluster includes multiple sections
Point, each node include multiple service modules, and each service module includes multiple containers.
10. big data platform building method according to claim 6, which is characterized in that the resource layer include high in the clouds and
Physical machine.
11. a kind of big data platform builds equipment, which is characterized in that the equipment includes:
One or more processors;
Storage device, for storing one or more programs;
When one or more of programs are performed by one or more of processors so that one or more of processors
Realize the big data platform building method as described in any in claim 6-10.
12. a kind of computer-readable medium, is stored with computer program, which is characterized in that when the program is executed by processor
Realize the big data platform building method as described in any in claim 6-10.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711406871.3A CN108173919A (en) | 2017-12-22 | 2017-12-22 | Big data platform builds system, method, equipment and computer-readable medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711406871.3A CN108173919A (en) | 2017-12-22 | 2017-12-22 | Big data platform builds system, method, equipment and computer-readable medium |
Publications (1)
Publication Number | Publication Date |
---|---|
CN108173919A true CN108173919A (en) | 2018-06-15 |
Family
ID=62523572
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201711406871.3A Pending CN108173919A (en) | 2017-12-22 | 2017-12-22 | Big data platform builds system, method, equipment and computer-readable medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108173919A (en) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109582451A (en) * | 2018-11-21 | 2019-04-05 | 金色熊猫有限公司 | Method for scheduling task, system, equipment and readable medium |
CN109683910A (en) * | 2018-12-21 | 2019-04-26 | 成都四方伟业软件股份有限公司 | Big data platform dispositions method and device |
CN110908774A (en) * | 2018-09-14 | 2020-03-24 | 阿里巴巴集团控股有限公司 | Resource scheduling method, device, system and storage medium |
CN111045791A (en) * | 2019-12-16 | 2020-04-21 | 武汉智领云科技有限公司 | Big data containerization central scheduling system and method |
CN111090823A (en) * | 2019-12-23 | 2020-05-01 | 广州市百果园信息技术有限公司 | Integration platform of page application and application access method, device and equipment |
CN111246397A (en) * | 2020-01-19 | 2020-06-05 | 阿里巴巴集团控股有限公司 | Cluster system, service access method, device and server |
CN111427949A (en) * | 2019-01-09 | 2020-07-17 | 杭州海康威视数字技术股份有限公司 | Method and device for creating big data service |
CN114679441A (en) * | 2022-03-03 | 2022-06-28 | 杭州玳数科技有限公司 | Big data task scheduling system based on VPC network and control method thereof |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106569895A (en) * | 2016-10-24 | 2017-04-19 | 华南理工大学 | Construction method of multi-tenant big data platform based on container |
CN106790483A (en) * | 2016-12-13 | 2017-05-31 | 武汉邮电科学研究院 | Hadoop group systems and fast construction method based on container technique |
CN106776960A (en) * | 2016-12-05 | 2017-05-31 | 公安部第三研究所 | Based on the big data cloud platform that micro- container is realized |
CN106850621A (en) * | 2017-02-07 | 2017-06-13 | 南京云创大数据科技股份有限公司 | A kind of method based on container cloud fast construction Hadoop clusters |
-
2017
- 2017-12-22 CN CN201711406871.3A patent/CN108173919A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106569895A (en) * | 2016-10-24 | 2017-04-19 | 华南理工大学 | Construction method of multi-tenant big data platform based on container |
CN106776960A (en) * | 2016-12-05 | 2017-05-31 | 公安部第三研究所 | Based on the big data cloud platform that micro- container is realized |
CN106790483A (en) * | 2016-12-13 | 2017-05-31 | 武汉邮电科学研究院 | Hadoop group systems and fast construction method based on container technique |
CN106850621A (en) * | 2017-02-07 | 2017-06-13 | 南京云创大数据科技股份有限公司 | A kind of method based on container cloud fast construction Hadoop clusters |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110908774A (en) * | 2018-09-14 | 2020-03-24 | 阿里巴巴集团控股有限公司 | Resource scheduling method, device, system and storage medium |
CN110908774B (en) * | 2018-09-14 | 2023-04-14 | 阿里巴巴集团控股有限公司 | Resource scheduling method, equipment, system and storage medium |
CN109582451A (en) * | 2018-11-21 | 2019-04-05 | 金色熊猫有限公司 | Method for scheduling task, system, equipment and readable medium |
CN109683910A (en) * | 2018-12-21 | 2019-04-26 | 成都四方伟业软件股份有限公司 | Big data platform dispositions method and device |
CN111427949A (en) * | 2019-01-09 | 2020-07-17 | 杭州海康威视数字技术股份有限公司 | Method and device for creating big data service |
CN111427949B (en) * | 2019-01-09 | 2023-10-20 | 杭州海康威视数字技术股份有限公司 | Method and device for creating big data service |
CN111045791A (en) * | 2019-12-16 | 2020-04-21 | 武汉智领云科技有限公司 | Big data containerization central scheduling system and method |
CN111090823A (en) * | 2019-12-23 | 2020-05-01 | 广州市百果园信息技术有限公司 | Integration platform of page application and application access method, device and equipment |
CN111246397A (en) * | 2020-01-19 | 2020-06-05 | 阿里巴巴集团控股有限公司 | Cluster system, service access method, device and server |
CN114679441A (en) * | 2022-03-03 | 2022-06-28 | 杭州玳数科技有限公司 | Big data task scheduling system based on VPC network and control method thereof |
CN114679441B (en) * | 2022-03-03 | 2024-04-12 | 杭州玳数科技有限公司 | Big data task scheduling system based on VPC network and control method thereof |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108173919A (en) | Big data platform builds system, method, equipment and computer-readable medium | |
CN109274731A (en) | Deployment, call method and the device of web services based on multi-tenant technology | |
CN107948305B (en) | Vulnerability scanning method, apparatus, equipment and computer-readable medium | |
CN109656706A (en) | Distributed task dispatching method, system, equipment and medium | |
US9459897B2 (en) | System and method for providing data analysis service in cloud environment | |
US10044837B2 (en) | Generation and distribution of named, definable, serialized tokens | |
CN109634609B (en) | Dynamic popup display method, system, equipment and storage medium | |
CN106301885A (en) | The method and system of uniform traffic management | |
CN108279882B (en) | Framework generation method, device, equipment and computer readable medium | |
CN109981322A (en) | The method and apparatus of cloud resource management based on label | |
CN107862352A (en) | A kind of Quick Response Code sharing method and Quick Response Code share equipment | |
CN109445841A (en) | Interface document management method, device, server and storage medium | |
CN109993470A (en) | A kind of inventory's dispatching method and device | |
CN108153877A (en) | Data dictionary methods of exhibiting, device, terminal device and storage medium | |
CN107506494A (en) | Document handling method, mobile terminal and computer-readable recording medium | |
CN111275450B (en) | Processing method and system of associated preferential information after commodity return | |
CN112817562A (en) | Service processing method and device | |
US20140019515A1 (en) | Adaptive business logic configurator | |
CN111275509A (en) | Method and device for processing article inventory | |
CN111782210A (en) | Page management method and device, electronic equipment and computer readable medium | |
CN108108392A (en) | Commodity data management method, device, computer equipment and storage medium | |
CN110515741A (en) | A kind of degradation processing method and device based on local task queue | |
CN109978486A (en) | Method, apparatus, system and medium for Row control | |
CN106815765A (en) | A kind of asset allocation method and apparatus | |
CN111127608A (en) | Rendering method, device and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180615 |