CN104572236A - Fast building method for Taurus project - Google Patents
Fast building method for Taurus project Download PDFInfo
- Publication number
- CN104572236A CN104572236A CN201510007610.9A CN201510007610A CN104572236A CN 104572236 A CN104572236 A CN 104572236A CN 201510007610 A CN201510007610 A CN 201510007610A CN 104572236 A CN104572236 A CN 104572236A
- Authority
- CN
- China
- Prior art keywords
- taurus
- server
- project
- privately owned
- building method
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Stored Programmes (AREA)
Abstract
The invention discloses a fast building method for a Taurus project and belongs to the field of big data platform management. The fast building method for the Taurus project includes steps that (1) constructing a local Maven dependency server, deploying a private server, downloading the private server, and configuring through a web page part after finishing mounting; (2) correcting a Pom.xml file in the Taurus according to requirements of Maven, and pointing the correction to the private server deployed in the step (1); (3) Taurus building, to be specific, continuing to finish the Taurus building compiling according to prompts through the deployment of the private server and the correction of the Pom.xml file in the Taurus. The fast building method for the Taurus project realizes to quickly build and correct Taurus, and the final Taurus compiling time is reduced to tens of minutes from the original several hours even tens of hours.
Description
Technical field
The present invention discloses a kind of Taurus project fast construction building method, belongs to large data platform management domain.
Background technology
Taurus is a large data platform management system based on open source projects Ambari, is dispatching system, by Time Dependent and Task Dependent, and the execution of triggering tasks, and by the dependence management between task, task groups is made into workflow; Task in support Hadoop/Hive Job, Spring container and the scheduling/monitoring of general task.The host node of Taurus is called Master, and Web interface is together with Master.User is on Web interface after creation task, and write MySQL does persistent storage, when Master judges that the condition that task triggers meets, then from MySQL, reads mission bit stream, write ZooKeeper; Agent is deployed on the machine of user, observes the change on ZooKeeper, obtains mission bit stream, initiating task.At present a lot of user, wishes that dispatching system not only can dispatch Hadoop task, also can dispatch set task, and the task even in Spring container, just needs to use Taurus, but in Taurus performance history, needs constantly to compile source code, debug.The time of compiling according to hour to calculate, if network environment is undesirable, will will reach a few hours.By also finding the observation of each module compiles time because Taurus is a relatively large project, so other the large data packages relied on are a lot of also very large, so each compiling is downloaded very time-consuming, especially project team everyone test compiling in need distally server download, more time-consuming.The invention provides a kind of Taurus project fast construction building method, adopt Maven(http: //maven.apache.org/) carry out project management.
Summary of the invention
The present invention is directed to Taurus is a relatively large project, rely on other large data packages a lot of also very large, so each compiling is downloaded very time-consuming, especially project team everyone test compiling in need distally server download, more time-consuming problem, a kind of Taurus project fast construction building method is provided, realization utilizes the inventive method fast construction and amendment Taurus, by last for the Taurus compilation process time by original several hours even tens of hours, reduce to several tens minutes.
The concrete scheme that the present invention proposes is:
A kind of Taurus project fast construction building method, concrete steps are:
1. test Taurus project compilation time, the time recording mechanism utilizing Linux to provide, repeatedly test the time of Taurus source code compiling, and by compilation time segmentation, the time of each compiling section is averaged, checks the compiling section that holding time is maximum;
2. build local Maven reliance server, privately owned server is disposed, download privately owned server, be configured by web page portions after installation;
3. modified by the Pom.xml file in Taurus according to the requirement of Maven, according to the step compiling section that 1. holding time is maximum, the module of amendment has server and agent collector;
The project of amendment is needed to have <repositories> <repository> privately owned server address configuration item </repository> </repositories>;
<pluginRepositories> <pluginRepository> privately owned server address configuration item </pluginRepository> </pluginRepositories>;
Above-mentioned amendment is pointed to the step 2. middle privately owned server disposed;
4. Taurus builds, and by the amendment of the Pom.xml file in the deployment of above-mentioned privately owned server and Taurus, continues to have operated Taurus according to prompting and builds and compile.
The described step 2. middle privately owned server disposed is Nexus or Archiva or Artifactory.
Described step 2. in the privately owned server disposed when being Nexus, have two kinds of mounting meanss, one carries jetty container, and another kind is not with jetty container; When being installed as the Nexus not with jetty container, needing the war of download bag to be put in server, when being installed as the Nexus with jetty server, directly can run startup.
Described step 3. in also comprise amendment mirror image and point to and revise <mirrors><mirror > private and take address configuration item </mirror></mirro rs>.
Usefulness of the present invention is: the invention provides a kind of Taurus project fast construction building method, a relatively large project for Taurus, rely on other large data packages a lot of also very large, so each compiling is downloaded very time-consuming, especially project team everyone test compiling in need distally server download, more time-consuming problem, set up the privately owned server warehouse of corresponding Maven, search and to revise in Taurus source code most holding time and rely on the partial code downloaded, and it is repaired, change into and point to the download of privately owned server warehouse, thus make Taurus build compilation time significantly to shorten, accelerate the speed of building compiling, be conducive to increasing work efficiency.
Accompanying drawing explanation
Former the building of Fig. 1 Taurus relies on acquisition schematic diagram;
Fig. 2 Taurus of the present invention builds to rely on and obtains schematic diagram.
Embodiment
By reference to the accompanying drawings, concrete elaboration is done to the present invention.
Resource acquisition when original Taurus compiles is shown referring to Fig. 1.
Required environment is:
JDK1.6.0 and more than;
Apache Maven3.0.5；
Python2.6, can be installed by order sh setuptools-0.6c11-py2.6.egg;
Rpmbuild, Taurus compiling is called that RPM wraps;
G++, (gcc-c++ wraps, the c++ compiler of gcc;
NodeJS, tests whether successful installation by two order node and npm;
Brunch 1.7.13；
Before guarantee after required environment, the compiling of Taurus project can be carried out below:
tar xfvz Taurus-1.0.tar.gz
cd Taurus1.0
mvn versions:set -DnewVersion=1.5.1
mvn -B clean install package rpm:rpm -DnewVersion=1.5.1 -DskipTests -Dpython.ver = "python >= 2.6"
If more than run errorless, you will obtain a RPM installation kit of Taurus, can dispose accordingly.Only compile according to above step, time of compiling will according to hour to calculate, and very time-consuming, when test compiling, all distally server is downloaded, more time-consuming.
The selected privately owned server construction software that will use is needed in the present invention.There are three kinds for Maven storehouse management: the Archiva of Apache foundation; The Nexus of Artifactory and Sonatype of JFrog.Wherein, Archiva increases income, and the core of Artifactory and Nexus is also increased income.Referring to Fig. 2, in the drawings privately owned server warehouse is taken warehouse referred to as private, for the privately owned server warehouse of Nexus, a kind of Taurus project of the present invention fast construction building method, concrete steps are:
1. test Taurus project compilation time, the time recording mechanism utilizing Linux to provide, repeatedly test the time of Taurus source code compiling, and by compilation time segmentation, the time of each compiling section is averaged, checks the compiling section that holding time is maximum;
2. build local Maven reliance server, dispose privately owned server, download, have two kinds of mounting meanss, one carries jetty container, and another kind is not with jetty container; When being installed as the Nexus not with jetty container, needing the war of download bag to be put in server, when being installed as the Nexus with jetty server, directly can run startup; The privately owned server of Nexus, is configured by web page portions after installation;
3. modified by the Pom.xml file in Taurus according to the requirement of Maven, according to the step compiling section that 1. holding time is maximum, the module of amendment has server and agent collector;
The project of amendment is needed to have <repositories> <repository> privately owned server address configuration item </repository> </repositories>;
<pluginRepositories> <pluginRepository> privately owned server address configuration item </pluginRepository> </pluginRepositories>;
The sensing of amendment mirror image is revised <mirrors><mirror > private and is taken address configuration item </mirror></mirro rs>;
Above-mentioned amendment is pointed to the step 2. middle privately owned server disposed;
4. Taurus builds, and by the amendment of the Pom.xml file in the deployment of above-mentioned privately owned server and Taurus, continues to have operated Taurus according to prompting and builds and compile.
Contrast from Fig. 1, Fig. 2 and can find out, the process that Taurus builds compiling has been transferred to from the download of privately owned server warehouse from remote warehouse download, and avoid the Taurus source code part that holding time is longer, the speed making Taurus build compiling is accelerated.
Claims (4)
1. a Taurus project fast construction building method, is characterized in that concrete steps are:
1. test Taurus project compilation time, the time recording mechanism utilizing Linux to provide, repeatedly test the time of Taurus source code compiling, and by compilation time segmentation, the time of each compiling section is averaged, checks the compiling section that holding time is maximum;
2. build local Maven reliance server, privately owned server is disposed, download privately owned server, be configured by web page portions after installation;
3. modified by the Pom.xml file in Taurus according to the requirement of Maven, according to the step compiling section that 1. holding time is maximum, the module of amendment has server and agent collector;
The project of amendment is needed to have <repositories> <repository> privately owned server address configuration item </repository> </repositories>;
<pluginRepositories> <pluginRepository> privately owned server address configuration item </pluginRepository> </pluginRepositories>;
Above-mentioned amendment is pointed to the step 2. middle privately owned server disposed;
4. Taurus builds, and by the amendment of the Pom.xml file in the deployment of above-mentioned privately owned server and Taurus, continues to have operated Taurus according to prompting and builds and compile.
2. a kind of Taurus project fast construction building method according to claim 1, is characterized in that the privately owned server disposed during described step is 2. Nexus or Archiva or Artifactory.
3. a kind of Taurus project fast construction building method according to claim 2, when it is characterized in that during described step is 2., the privately owned server of deployment is Nexus, have two kinds of mounting meanss, one carries jetty container, and another kind is not with jetty container; When being installed as the Nexus not with jetty container, needing the war of download bag to be put in server, when being installed as the Nexus with jetty server, directly can run startup.
4. a kind of Taurus project fast construction building method according to any one of claim 1-3, is characterized in that also comprising during described step 3. amendment mirror image and points to and revise <mirrors><mirror > private and take address configuration item </mirror></mirro rs>.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510007610.9A CN104572236B (en) | 2015-01-07 | 2015-01-07 | A kind of Taurus projects fast construction building method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510007610.9A CN104572236B (en) | 2015-01-07 | 2015-01-07 | A kind of Taurus projects fast construction building method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104572236A true CN104572236A (en) | 2015-04-29 |
| CN104572236B CN104572236B (en) | 2017-08-04 |
Family
ID=53088393
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510007610.9A Active CN104572236B (en) | 2015-01-07 | 2015-01-07 | A kind of Taurus projects fast construction building method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104572236B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106777299A (en) * | 2016-12-30 | 2017-05-31 | 深圳市彬讯科技有限公司 | The project dependence solution of operation management instrument and static data warehouse |
| CN107707625A (en) * | 2017-09-05 | 2018-02-16 | 江苏电力信息技术有限公司 | Foreground resource based on Maven is packed and carries out version management and the method used |
| CN110457022A (en) * | 2019-07-19 | 2019-11-15 | 上海易点时空网络有限公司 | Non-intrusion type project implementation method and system based on nodejs, storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102393845A (en) * | 2011-06-30 | 2012-03-28 | 北京新媒传信科技有限公司 | Shared library management method and system |
| CN103500087A (en) * | 2013-09-17 | 2014-01-08 | 福建亿榕信息技术有限公司 | Code generation method and device based on maven plug-in and freemarker template |
| CN104142825A (en) * | 2014-07-08 | 2014-11-12 | 北京彩云动力教育科技有限公司 | Method and system for modularization development of products |
-
2015
- 2015-01-07 CN CN201510007610.9A patent/CN104572236B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102393845A (en) * | 2011-06-30 | 2012-03-28 | 北京新媒传信科技有限公司 | Shared library management method and system |
| CN103500087A (en) * | 2013-09-17 | 2014-01-08 | 福建亿榕信息技术有限公司 | Code generation method and device based on maven plug-in and freemarker template |
| CN104142825A (en) * | 2014-07-08 | 2014-11-12 | 北京彩云动力教育科技有限公司 | Method and system for modularization development of products |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106777299A (en) * | 2016-12-30 | 2017-05-31 | 深圳市彬讯科技有限公司 | The project dependence solution of operation management instrument and static data warehouse |
| CN106777299B (en) * | 2016-12-30 | 2020-10-09 | 深圳市彬讯科技有限公司 | Project dependency relationship solution method using management tool and static data warehouse |
| CN107707625A (en) * | 2017-09-05 | 2018-02-16 | 江苏电力信息技术有限公司 | Foreground resource based on Maven is packed and carries out version management and the method used |
| CN110457022A (en) * | 2019-07-19 | 2019-11-15 | 上海易点时空网络有限公司 | Non-intrusion type project implementation method and system based on nodejs, storage medium |
| CN110457022B (en) * | 2019-07-19 | 2023-04-18 | 上海易点时空网络有限公司 | Nodejs-based non-intrusive project execution method and system and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104572236B (en) | 2017-08-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107615239B (en) | Infrastructure for hosting and publishing software packages | |
| US8533676B2 (en) | Single development test environment | |
| US8745585B2 (en) | Meta-data for single development test environment | |
| KR101963912B1 (en) | Application compatibility with library operating systems | |
| Binz et al. | CMotion: A Framework for Migration of Applications into and between Clouds | |
| CN111066304A (en) | Edge device and associated network utilizing microservices | |
| US20160098263A1 (en) | Release lifecycle management system for multi-node application | |
| US9348582B2 (en) | Systems and methods for software dependency management | |
| US20130174124A1 (en) | Version numbering in single development and test environment | |
| US9823909B1 (en) | Program code conversion for cross-platform compatibility | |
| CN105446712B (en) | Application program defect repairing method and device | |
| CN104793946A (en) | Application deployment method and system based on cloud computing platform | |
| EP2805233B1 (en) | Installation engine and package format for parallelizable, reliable installations | |
| AU2012201749B2 (en) | Single development test environment | |
| US20160335069A1 (en) | Dependency handling for software extensions | |
| US20200104120A1 (en) | Application release using integration into unified code system | |
| EP2891070A1 (en) | Global feature library useable with continuous delivery | |
| CN104572236A (en) | Fast building method for Taurus project | |
| US8769520B2 (en) | Calendar aware adaptive patching of a computer program | |
| US9760364B2 (en) | Checks for software extensions | |
| US20210019169A1 (en) | Container-based virtualization system | |
| Boyer et al. | Architecture-based automated updates of distributed microservices | |
| Zhen-hai et al. | Automatic updating method based on Maven | |
| EP2503450A2 (en) | Version numbering in single development and test environment | |
| US9477447B1 (en) | Semantic representations of software extensions |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |