CN108173919A - Big data platform builds system, method, equipment and computer-readable medium - Google Patents

Big data platform builds system, method, equipment and computer-readable medium Download PDF

Info

Publication number
CN108173919A
CN108173919A CN201711406871.3A CN201711406871A CN108173919A CN 108173919 A CN108173919 A CN 108173919A CN 201711406871 A CN201711406871 A CN 201711406871A CN 108173919 A CN108173919 A CN 108173919A
Authority
CN
China
Prior art keywords
service
big data
resource
data platform
service request
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711406871.3A
Other languages
Chinese (zh)
Inventor
宋传园
呙昊甦
缪翎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Baidu Online Network Technology Beijing Co Ltd
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN201711406871.3A priority Critical patent/CN108173919A/en
Publication of CN108173919A publication Critical patent/CN108173919A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/51Discovery or management thereof, e.g. service location protocol [SLP] or web services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/60Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources

Abstract

The present invention proposes that a kind of big data platform builds system, including:Web layers, for receiving the service request of user;Management level for receiving Web layers of service request, and generate service installation, deployment and administration order;Container floor, including multiple containers cluster, for performing the order of management level and feedback command implementing result;Resource layer, for providing carrier for the container floor.The present invention is based on containers to build big data service, and by the inconsistency of container shield bottom physical machine, therefore service does not perceive physical machine, can facilitate and carry out resource expansion and management.Meanwhile resource Heterogeneity is also solved, it can be by service arrangement beyond the clouds or in physical machine.

Description

Big data platform builds system, method, equipment and computer-readable medium
Technical field
The present invention relates to big data technical field more particularly to a kind of big data platform build system and method, equipment and Computer-readable medium.
Background technology
At present, building the solution of big data platform has Cloudera, Ambari etc., however bottom is all based on physics Machine is gradually completing installing and deploying for various big data services, therefore must keep high consistency for physical machine.
Therefore, in the prior art there are still it is following the shortcomings that:
1st, the bottom of structure big data service at present is all based on physical machine, high to the coherence request of physical machine, and not The convenient extension and management that whole resource is carried out to platform.Meanwhile it is not easy to the cloudization deployment and management of service.
2nd, since current technology can only dispose a set of service in same cluster, it is not easy to multi-user's use.
3rd, existing container programming facility can determine how to be interacted between container, however can only solve Container Management Relevant Arrangement itself, and the Arrangement of the application based on container can not be solved.
Invention content
The embodiment of the present invention provides a kind of big data platform building method, device, equipment and computer-readable medium, with solution Certainly or alleviate one or more technical problems of the prior art.
In a first aspect, an embodiment of the present invention provides a kind of big data platforms to build system, including:
Web layers, for receiving the service request of user;
Management level for receiving Web layers of service request, and generate service installation, deployment and administration order;
Container floor, including multiple containers cluster, for performing the order of management level and feedback command implementing result;
Resource layer, for providing carrier for the container floor.
With reference to first aspect, in the first realization method of first aspect, described Web layers is interacted the present invention by user Interface receives the service request of user.
With reference to first aspect, in second of realization method of first aspect, the management level include the present invention:Management clothes Be engaged in device, database, from node, scheduling of resource module and client-side interface;
The management server, for receiving Web layers of service request;
It is described from node, for the service request of asynchronous execution user, and send call signal to the scheduling of resource mould Block and client-side interface;
For being managed collectively the resource information of each container cluster, resource is distributed for service for the scheduling of resource module;
The client-side interface for accessing the cluster of container floor, issues and services installation, deployment and the order managed to institute It states in container cluster, and obtains command execution results;
The database, information, container cluster and the service after the completion of information, service arrangement for storage service request Resource information..
With reference to first aspect, in the third realization method of first aspect, the container cluster includes multiple the present invention Node, each node include multiple service modules, and each service module includes multiple containers.
With reference to first aspect, the present invention in the 4th kind of realization method of first aspect, the resource layer include high in the clouds and Physical machine.
Second aspect, an embodiment of the present invention provides a kind of big data platform building methods, include the following steps:
Pass through the service request of Web layers of reception user;
Web layers of service request is received by management level, and generates service installation, deployment and administration order;
Order and the feedback command implementing result of management level are performed by container floor, the container floor includes multiple containers collection Group, and be deployed in resource layer.
With reference to second aspect, the present invention is described to pass through Web layers of reception user in the first realization method of second aspect Service request include:The service request of user is received by user interface.
With reference to second aspect, the present invention is described to receive Web by management level in second of realization method of second aspect The service request of layer, and generate the step of servicing installation, deployment and administration order and include:
Web layers of service request is received by management server;
By performing the service request of user from node asynchronous, and call signal is sent to the scheduling of resource module and visitor Family end interface;
The resource information of each container cluster is managed collectively by scheduling of resource module, resource is distributed for service;
The cluster of container floor is accessed by client-side interface, the order for issue service installation, disposing and managing to the appearance In device cluster, and obtain command execution results;
Pass through information, container cluster and the service resource after the completion of the information of database purchase service request, service arrangement Information.
With reference to second aspect, in the third realization method of second aspect, the container cluster includes multiple the present invention Node, each node include multiple service modules, and each service module includes multiple containers.
With reference to second aspect, the present invention in the 4th kind of realization method of second aspect, the resource layer include high in the clouds and Physical machine.
The function of the system by hardware can also be performed corresponding software and be realized by hardware realization.It is described Hardware or software include the one or more and corresponding module of above-mentioned function.
In a possible design, the structure that big data platform builds system includes processor and memory, described Memory supports big data platform to build the journey that system performs big data platform building method in above-mentioned second aspect for storing Sequence, the processor are configurable for performing the program stored in the memory.The big data platform builds system also It can include communication interface, system and other equipment or communication are built for big data platform.
The third aspect, an embodiment of the present invention provides a kind of computer-readable mediums, are built for storing big data platform Computer software instructions used in system, including for performing involved by the big data platform building method of above-mentioned second aspect Program.
A technical solution in above-mentioned technical proposal has the following advantages that or advantageous effect:The embodiment of the present invention is based on holding Device builds big data service, and by the inconsistency of container shield bottom physical machine, therefore service does not perceive physical machine, Ke Yifang Just resource expansion and management are carried out.Meanwhile resource Heterogeneity is also solved, it can be by service arrangement beyond the clouds or physical machine On.In addition, affixing one's name to multiple nodes in the middle part of container cluster, different service modules is disposed in each node, it on the one hand can be in order to Multi-user uses, and on the other hand can be arranged on different vessels in one node, user only perceives and is served by, Bu Huizhi It connects and perceives container resource.
Above-mentioned general introduction is merely to illustrate that the purpose of book, it is not intended to be limited in any way.Except foregoing description Schematical aspect, except embodiment and feature, by reference to attached drawing and the following detailed description, the present invention is further Aspect, embodiment and feature will be what is be readily apparent that.
Description of the drawings
In the accompanying drawings, unless specified otherwise herein, otherwise represent the same or similar through the identical reference numeral of multiple attached drawings Component or element.What these attached drawings were not necessarily to scale.It should be understood that these attached drawings are depicted only according to the present invention Some disclosed embodiments, and should not serve to limit the scope of the present invention.
Fig. 1 is that the big data platform of embodiment one builds the Organization Chart of system;
Fig. 2 is that the big data platform of embodiment one builds the signal transmission schematic diagram of system;
Fig. 3 is the schematic diagram of the container cluster of embodiment one;
Fig. 4 is the step flow chart of the big data platform building method of embodiment three;
Fig. 5 is the specific steps flow chart of the step S120 of embodiment three;
Fig. 6 is that the big data platform of embodiment five builds equipment connection block diagram.
Specific embodiment
Hereinafter, certain exemplary embodiments are simply just described.As one skilled in the art will recognize that Like that, without departing from the spirit or scope of the present invention, described embodiment can be changed by various different modes. Therefore, attached drawing and description are considered essentially illustrative rather than restrictive.
The embodiment of the present invention is aimed to solve the problem that or alleviated to be needed to be deployed in physical machine when big data platform in the prior art is built On, resource expansion and the Related Technical Issues of management are carried out to platform so as to inconvenient.The embodiment of the present invention mainly employs base In the technical solution of container structure big data service, so as to shield the inconsistency of bottom physical machine, to solve the prior art One or more technical problems.The expansion for carrying out technical solution by following embodiment separately below describes.
Embodiment one
It please refers to Fig.1 and Fig. 2, is respectively that the big data platform of the embodiment of the present invention one builds the Organization Chart and letter of system Number transmission schematic diagram.The present embodiment one provides a kind of big data platform and builds system, including:Web layers 110, management level 120, Container floor 130 and resource layer 140.
The Web layers 110, for receiving the service request of user.
Wherein, the Web layers 110 can interact the service request that (UI) interface 111 receives user by user.Work as Web After layer 110 receives the service request of user, request can be forwarded to by http modes in management level 120.
The management level 120 for receiving Web layers of service request, and generate service installation, deployment and administration order.
Specifically, the management level 120 include:Management server 121, from node (salve) 123, scheduling of resource module (resource-scheduler) 124, client-side interface 124 and database 125.
The management server 121, for receiving Web layers of service request.Specifically, in the present embodiment one, it is described Management server 121 can receive Web layers of service request by Rest-Api.
It is described from node 122, for the service request of asynchronous execution user, and send call signal to the scheduling of resource Module and client-side interface.
The scheduling of resource module 123, for being managed collectively the resource information of each container cluster, for service distribution money Source.
The client-side interface 124 for accessing the cluster of container floor, issues the order of service installation, deployment and management Into the container cluster, and obtain command execution results;
The database 125, the information for storage service request, the information after the completion of service arrangement, container cluster and Service Source information.
The container floor 130, including multiple containers cluster 131, for performing the order of management level and feedback command is held Row result.As shown in figure 3, the container cluster 131 includes multiple nodes (node), each node (node) includes multiple clothes Business module, each service module include multiple containers (container).
The resource layer 140, for providing carrier for the container floor.In the present embodiment one, the resource layer includes Physical machine.
The big data platform for introducing the present embodiment one in detail below builds systematic difference steps flow chart:
First, user can submit corresponding service request by Web layers 110.Then, by Web layers 110 by the use Family request is sent in management level 120, asks installation, deployment and the management of execution service according to user by management level 120.
Wherein, the unified service request for receiving user of management server 121 is first passed through, then writes request results and information Enter in database 125, finally again by seeking unity of action and handling from node 122.
It is described to pass through related service that scheduling of resource module 123 and client-side interface 124 is called to perform user from node 122 Request.Specifically, being managed collectively the resource information of each container cluster by scheduling of resource module 123, resource is distributed for service. Then, the container cluster 131 of container floor 130 then by client-side interface 124 is accessed, issues service installation, deployment and management It orders in the container cluster 131, and obtains command execution results.In the present embodiment one, the container floor 130 can portion Administration is in the physical machine of resource layer 140.
Embodiment two
The present embodiment two provides a kind of big data platform and builds system, identical with the basic framework of embodiment one, Difference lies in:The resource layer 140 of the present embodiment two includes high in the clouds and physical machine, and the container floor 130 can be deployed in cloud simultaneously On end and physical machine.Wherein, in the present embodiment two, the high in the clouds includes public cloud and private clound.User can be as needed, Big data platform is built in public cloud or private clound.
The overall architecture that the big data platform of the present embodiment two builds system is identical with embodiment one with operation logic, therefore not It repeats again.
Embodiment three
The present embodiment three corresponds to embodiment one, provides a kind of big data platform building method.Referring to Fig. 4, it is The step flow chart of the big data platform building method of the present embodiment three.
The big data platform building method of the present embodiment three, includes the following steps:
S110:Pass through the service request of Web layers of reception user.
In one embodiment, the service request of user can be received by user interface in this step S110.
S120:Web layers of service request is received by management level, and generates service installation, deployment and administration order.
As shown in figure 5, in this step S120, specifically include:
S121:Web layers of service request is received by management server.
S122:By performing the service request of user from node asynchronous, and call signal is sent to the scheduling of resource mould Block and client-side interface.
S123:The resource information of each container cluster is managed collectively by scheduling of resource module, resource is distributed for service.
S124:The cluster of container floor is accessed by client-side interface, the order for issue service installation, disposing and managing to institute It states in container cluster, and obtains command execution results.
S125:Pass through information, container cluster and the service after the completion of the information of database purchase service request, service arrangement Resource information.
S130:Order and the feedback command implementing result of management level are performed by container floor, the container floor includes multiple Container cluster, and be deployed in resource layer.In the present embodiment three, the resource layer includes physical machine, the container floor deployment In physical machine.The container cluster includes multiple nodes, and each node includes multiple service modules, each service module packet Include multiple containers.
The present embodiment three is identical with the principle of embodiment one, and so it will not be repeated.
Example IV
The present embodiment four provides a kind of big data platform building method, identical with the basic step of embodiment three, Difference lies in:The resource layer of the present embodiment four includes high in the clouds and physical machine, and the container floor can be disposed beyond the clouds and object simultaneously On reason machine.Wherein, in the present embodiment four, the high in the clouds includes public cloud and private clound.User can be as needed, will count greatly According to platform building in public cloud or private clound.
The application mode of the present embodiment four is identical with embodiment three with principle, and so it will not be repeated.
Embodiment five
The embodiment of the present invention five provides a kind of big data platform and builds equipment, as shown in fig. 6, the equipment includes:Memory 310 and processor 320,310 memory of memory contain the computer program that can be run on the processor 320.The processor 320 The big data platform building method in above-described embodiment is realized when performing the computer program.The memory 310 and processing The quantity of device 320 can be one or more.
The equipment further includes:
Communication interface 330 for communicating with external device, carries out data interaction.
Memory 310 may include high-speed RAM memory, it is also possible to further include nonvolatile memory (non- Volatile memory), a for example, at least magnetic disk storage.
If memory 310, processor 320 and the independent realization of communication interface 330, memory 310,320 and of processor Communication interface 330 can be connected with each other by bus and complete mutual communication.The bus can be Industry Standard Architecture Structure (ISA, Industry Standard Architecture) bus, external equipment interconnection (PCI, Peripheral Component) bus or extended industry-standard architecture (EISA, Extended Industry Standard Component) bus etc..The bus can be divided into address bus, data/address bus, controlling bus etc..For ease of representing, Fig. 6 In only represented with a thick line, it is not intended that an only bus or a type of bus.
Optionally, in specific implementation, if memory 310, processor 320 and communication interface 330 are integrated in one piece of core On piece, then memory 310, processor 320 and communication interface 330 can complete mutual communication by internal interface.
In the description of this specification, reference term " one embodiment ", " example ", " is specifically shown " some embodiments " The description of example " or " some examples " etc. means specific features, structure, material or the spy for combining the embodiment or example description Point is contained at least one embodiment of the present invention or example.Moreover, particular features, structures, materials, or characteristics described It may be combined in any suitable manner in any one or more of the embodiments or examples.In addition, without conflicting with each other, this The technical staff in field can be by the different embodiments or examples described in this specification and the spy of different embodiments or examples Sign is combined.
In addition, term " first ", " second " are only used for description purpose, and it is not intended that instruction or hint relative importance Or the implicit quantity for indicating indicated technical characteristic." first " is defined as a result, the feature of " second " can be expressed or hidden Include at least one this feature containing ground.In the description of the present invention, " multiple " are meant that two or more, unless otherwise It is clearly specific to limit.
Any process described otherwise above or method description are construed as in flow chart or herein, represent to include Module, segment or the portion of the code of the executable instruction of one or more the step of being used to implement specific logical function or process Point, and the range of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discuss suitable Sequence, including according to involved function by it is basic simultaneously in the way of or in the opposite order, to perform function, this should be of the invention Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for Instruction execution system, device or equipment (such as computer based system, including the system of processor or other can be held from instruction The system of row system, device or equipment instruction fetch and execute instruction) it uses or combines these instruction execution systems, device or set It is standby and use.For the purpose of this specification, " computer-readable medium " can any can be included, store, communicate, propagate or pass Defeated program is for instruction execution system, device or equipment or the dress used with reference to these instruction execution systems, device or equipment It puts.
Computer-readable medium described in the embodiment of the present invention can be that computer-readable signal media or computer can Storage medium either the two is read arbitrarily to combine.The more specific example of computer readable storage medium is at least (non-poor Property list to the greatest extent) including following:Electrical connection section (electronic device) with one or more wiring, portable computer diskette box (magnetic Device), random access memory (RAM), read-only memory (ROM), erasable edit read-only storage (EPROM or flash Memory), fiber device and portable read-only memory (CDROM).In addition, computer readable storage medium even can be with It is the paper or other suitable media that can print described program on it, because can be for example by being carried out to paper or other media Optical scanner is then handled described electronically to obtain into edlin, interpretation or when necessary with other suitable methods Program is then stored in computer storage.
In embodiments of the present invention, computer-readable signal media can be included in a base band or as a carrier wave part The data-signal of propagation, wherein carrying computer-readable program code.The data-signal of this propagation may be used a variety of Form, including but not limited to electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media is also Can be any computer-readable medium other than computer readable storage medium, which can send, pass Either transmission is broadcast for instruction execution system, input method or device use or program in connection.Computer can Reading the program code included on medium can be transmitted with any appropriate medium, including but not limited to:Wirelessly, electric wire, optical cable, penetrate Frequently (Radio Frequency, RF) etc. or above-mentioned any appropriate combination.
It should be appreciated that each section of the present invention can be realized with hardware, software, firmware or combination thereof.Above-mentioned In embodiment, software that multiple steps or method can in memory and by suitable instruction execution system be performed with storage Or firmware is realized.If for example, with hardware come realize in another embodiment, can be under well known in the art Any one of row technology or their combination are realized:With for the logic gates to data-signal realization logic function Discrete logic, have suitable combinational logic gate circuit application-specific integrated circuit, programmable gate array (PGA), scene Programmable gate array (FPGA) etc..
Those skilled in the art are appreciated that realize all or part of step that above-described embodiment method carries Suddenly it is that relevant hardware can be instructed to complete by program, the program can be stored in a kind of computer-readable storage medium In matter, the program when being executed, one or a combination set of the step of including embodiment of the method.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing module, it can also That each unit is individually physically present, can also two or more units be integrated in a module.Above-mentioned integrated mould The form that hardware had both may be used in block is realized, can also be realized in the form of software function module.The integrated module is such as Fruit is realized in the form of software function module and is independent product sale or in use, can also be stored in a computer In readable storage medium storing program for executing.The storage medium can be read-only memory, disk or CD etc..
In conclusion the embodiment of the present invention, which is based on container, builds big data service, pass through container shield bottom physical machine Inconsistency, therefore service does not perceive physical machine, can facilitate and carry out resource expansion and management.Meanwhile it is different to also solve resource Structure problem, can be by service arrangement beyond the clouds or in physical machine.In addition, multiple nodes, Mei Gejie are affixed one's name in the middle part of container cluster Different service modules is disposed in point, on the one hand can use in order to multi-user, on the other hand different vessels can be arranged on In one node, user only perceives and is served by, and will not directly perceive container resource.
The above description is merely a specific embodiment, but protection scope of the present invention is not limited thereto, any Those familiar with the art in the technical scope disclosed by the present invention, can readily occur in its various change or replacement, These should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be with the guarantor of the claim It protects subject to range.

Claims (12)

1. a kind of big data platform builds system, which is characterized in that including:
Web layers, for receiving the service request of user;
Management level for receiving Web layers of service request, and generate service installation, deployment and administration order;
Container floor, including multiple containers cluster, for performing the order of management level and feedback command implementing result;
Resource layer, for providing carrier for the container floor.
2. big data platform according to claim 1 builds system, which is characterized in that described Web layers is interacted by user Interface receives the service request of user.
3. big data platform according to claim 1 builds system, which is characterized in that the management level include:Management clothes Be engaged in device, from node, scheduling of resource module, database and client-side interface;
The management server, for receiving Web layers of service request;
It is described from node, for the service request of asynchronous execution user, and send call signal to the scheduling of resource module and Client-side interface;
For being managed collectively the resource information of each container cluster, resource is distributed for service for the scheduling of resource module;
The client-side interface for accessing the cluster of container floor, issues and services installation, deployment and the order managed to the appearance In device cluster, and obtain command execution results;
The database, the information after the completion of information, service arrangement, container cluster and service resource for storage service request Information.
4. big data platform according to claim 1 builds system, which is characterized in that the container cluster includes multiple sections Point, each node include multiple service modules, and each service module includes multiple containers.
5. big data platform according to claim 1 builds system, which is characterized in that the resource layer includes high in the clouds and object Reason machine.
6. a kind of big data platform building method, which is characterized in that include the following steps:
Pass through the service request of Web layers of reception user;
Web layers of service request is received by management level, and generates service installation, deployment and administration order;
Order and the feedback command implementing result of management level are performed by container floor, the container floor includes multiple containers cluster, And it is deployed in resource layer.
7. big data platform building method according to claim 6, which is characterized in that described to pass through Web layers of reception user Service request include:The service request of user is received by user interface.
8. big data platform building method according to claim 6, which is characterized in that described to receive Web by management level The service request of layer, and generate the step of servicing installation, deployment and administration order and include:
Web layers of service request is received by management server;
By performing the service request of user from node asynchronous, and send call signal to scheduling of resource module and client and terminate Mouthful;
The resource information of each container cluster is managed collectively by scheduling of resource module, resource is distributed for service;
The cluster of container floor is accessed by client-side interface, the order for issue service installation, disposing and managing to the sets of containers In group, and obtain command execution results;
Pass through information, container cluster and the service resource information after the completion of the information of database purchase service request, service arrangement.
9. big data platform building method according to claim 6, which is characterized in that the container cluster includes multiple sections Point, each node include multiple service modules, and each service module includes multiple containers.
10. big data platform building method according to claim 6, which is characterized in that the resource layer include high in the clouds and Physical machine.
11. a kind of big data platform builds equipment, which is characterized in that the equipment includes:
One or more processors;
Storage device, for storing one or more programs;
When one or more of programs are performed by one or more of processors so that one or more of processors Realize the big data platform building method as described in any in claim 6-10.
12. a kind of computer-readable medium, is stored with computer program, which is characterized in that when the program is executed by processor Realize the big data platform building method as described in any in claim 6-10.
CN201711406871.3A 2017-12-22 2017-12-22 Big data platform builds system, method, equipment and computer-readable medium Pending CN108173919A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711406871.3A CN108173919A (en) 2017-12-22 2017-12-22 Big data platform builds system, method, equipment and computer-readable medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711406871.3A CN108173919A (en) 2017-12-22 2017-12-22 Big data platform builds system, method, equipment and computer-readable medium

Publications (1)

Publication Number Publication Date
CN108173919A true CN108173919A (en) 2018-06-15

Family

ID=62523572

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711406871.3A Pending CN108173919A (en) 2017-12-22 2017-12-22 Big data platform builds system, method, equipment and computer-readable medium

Country Status (1)

Country Link
CN (1) CN108173919A (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109582451A (en) * 2018-11-21 2019-04-05 金色熊猫有限公司 Method for scheduling task, system, equipment and readable medium
CN109683910A (en) * 2018-12-21 2019-04-26 成都四方伟业软件股份有限公司 Big data platform dispositions method and device
CN110908774A (en) * 2018-09-14 2020-03-24 阿里巴巴集团控股有限公司 Resource scheduling method, device, system and storage medium
CN111045791A (en) * 2019-12-16 2020-04-21 武汉智领云科技有限公司 Big data containerization central scheduling system and method
CN111090823A (en) * 2019-12-23 2020-05-01 广州市百果园信息技术有限公司 Integration platform of page application and application access method, device and equipment
CN111246397A (en) * 2020-01-19 2020-06-05 阿里巴巴集团控股有限公司 Cluster system, service access method, device and server
CN111427949A (en) * 2019-01-09 2020-07-17 杭州海康威视数字技术股份有限公司 Method and device for creating big data service
CN114679441A (en) * 2022-03-03 2022-06-28 杭州玳数科技有限公司 Big data task scheduling system based on VPC network and control method thereof

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106569895A (en) * 2016-10-24 2017-04-19 华南理工大学 Construction method of multi-tenant big data platform based on container
CN106790483A (en) * 2016-12-13 2017-05-31 武汉邮电科学研究院 Hadoop group systems and fast construction method based on container technique
CN106776960A (en) * 2016-12-05 2017-05-31 公安部第三研究所 Based on the big data cloud platform that micro- container is realized
CN106850621A (en) * 2017-02-07 2017-06-13 南京云创大数据科技股份有限公司 A kind of method based on container cloud fast construction Hadoop clusters

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106569895A (en) * 2016-10-24 2017-04-19 华南理工大学 Construction method of multi-tenant big data platform based on container
CN106776960A (en) * 2016-12-05 2017-05-31 公安部第三研究所 Based on the big data cloud platform that micro- container is realized
CN106790483A (en) * 2016-12-13 2017-05-31 武汉邮电科学研究院 Hadoop group systems and fast construction method based on container technique
CN106850621A (en) * 2017-02-07 2017-06-13 南京云创大数据科技股份有限公司 A kind of method based on container cloud fast construction Hadoop clusters

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110908774A (en) * 2018-09-14 2020-03-24 阿里巴巴集团控股有限公司 Resource scheduling method, device, system and storage medium
CN110908774B (en) * 2018-09-14 2023-04-14 阿里巴巴集团控股有限公司 Resource scheduling method, equipment, system and storage medium
CN109582451A (en) * 2018-11-21 2019-04-05 金色熊猫有限公司 Method for scheduling task, system, equipment and readable medium
CN109683910A (en) * 2018-12-21 2019-04-26 成都四方伟业软件股份有限公司 Big data platform dispositions method and device
CN111427949A (en) * 2019-01-09 2020-07-17 杭州海康威视数字技术股份有限公司 Method and device for creating big data service
CN111427949B (en) * 2019-01-09 2023-10-20 杭州海康威视数字技术股份有限公司 Method and device for creating big data service
CN111045791A (en) * 2019-12-16 2020-04-21 武汉智领云科技有限公司 Big data containerization central scheduling system and method
CN111090823A (en) * 2019-12-23 2020-05-01 广州市百果园信息技术有限公司 Integration platform of page application and application access method, device and equipment
CN111246397A (en) * 2020-01-19 2020-06-05 阿里巴巴集团控股有限公司 Cluster system, service access method, device and server
CN114679441A (en) * 2022-03-03 2022-06-28 杭州玳数科技有限公司 Big data task scheduling system based on VPC network and control method thereof
CN114679441B (en) * 2022-03-03 2024-04-12 杭州玳数科技有限公司 Big data task scheduling system based on VPC network and control method thereof

Similar Documents

Publication Publication Date Title
CN108173919A (en) Big data platform builds system, method, equipment and computer-readable medium
CN109274731A (en) Deployment, call method and the device of web services based on multi-tenant technology
CN107948305B (en) Vulnerability scanning method, apparatus, equipment and computer-readable medium
CN109656706A (en) Distributed task dispatching method, system, equipment and medium
US9459897B2 (en) System and method for providing data analysis service in cloud environment
US10044837B2 (en) Generation and distribution of named, definable, serialized tokens
CN109634609B (en) Dynamic popup display method, system, equipment and storage medium
CN106301885A (en) The method and system of uniform traffic management
CN108279882B (en) Framework generation method, device, equipment and computer readable medium
CN109981322A (en) The method and apparatus of cloud resource management based on label
CN107862352A (en) A kind of Quick Response Code sharing method and Quick Response Code share equipment
CN109445841A (en) Interface document management method, device, server and storage medium
CN109993470A (en) A kind of inventory's dispatching method and device
CN108153877A (en) Data dictionary methods of exhibiting, device, terminal device and storage medium
CN107506494A (en) Document handling method, mobile terminal and computer-readable recording medium
CN111275450B (en) Processing method and system of associated preferential information after commodity return
CN112817562A (en) Service processing method and device
US20140019515A1 (en) Adaptive business logic configurator
CN111275509A (en) Method and device for processing article inventory
CN111782210A (en) Page management method and device, electronic equipment and computer readable medium
CN108108392A (en) Commodity data management method, device, computer equipment and storage medium
CN110515741A (en) A kind of degradation processing method and device based on local task queue
CN109978486A (en) Method, apparatus, system and medium for Row control
CN106815765A (en) A kind of asset allocation method and apparatus
CN111127608A (en) Rendering method, device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20180615