CN104572236B - A kind of Taurus projects fast construction building method - Google Patents
A kind of Taurus projects fast construction building method Download PDFInfo
- Publication number
- CN104572236B CN104572236B CN201510007610.9A CN201510007610A CN104572236B CN 104572236 B CN104572236 B CN 104572236B CN 201510007610 A CN201510007610 A CN 201510007610A CN 104572236 B CN104572236 B CN 104572236B
- Authority
- CN
- China
- Prior art keywords
- taurus
- privately owned
- server
- owned server
- modification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 19
- 238000010276 construction Methods 0.000 title claims abstract description 14
- 238000012986 modification Methods 0.000 claims abstract description 18
- 230000004048 modification Effects 0.000 claims abstract description 18
- 238000009434 installation Methods 0.000 claims abstract description 4
- 238000012360 testing method Methods 0.000 description 6
- 238000007726 management method Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 2
- 241000196324 Embryophyta Species 0.000 description 1
- 240000000797 Hibiscus cannabinus Species 0.000 description 1
- 235000002905 Rumex vesicarius Nutrition 0.000 description 1
- 235000021162 brunch Nutrition 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000002688 persistence Effects 0.000 description 1
Abstract
The present invention discloses a kind of Taurus projects fast construction building method, belongs to big data platform management field, concretely comprises the following steps：1. local Maven reliance servers are built, privately owned server is disposed, privately owned server is downloaded, is configured after installation by web page portions；2. the Pom.xml files in Taurus are modified according to Maven requirement, above-mentioned modification is pointed to the privately owned server of step 1. middle deployment；3. Taurus is built, by the modification of the Pom.xml files in the deployment and Taurus of above-mentioned privately owned server, continues to build compiling according to prompting operation completion Taurus；Fast construction and modification Taurus are realized using the inventive method, by the Taurus last compilation process times by original a few houres even tens of hours, dozens of minutes are reduced to.
Description
Technical field
The present invention discloses a kind of Taurus projects fast construction building method, belongs to big data platform management field.
Background technology
Taurus is a big data platform management system based on open source projects Ambari, is scheduling system, by when
Between rely on and relied on task, trigger the execution of task, and by dependence between task management by taskings into workflow；Support
Scheduling/monitoring of task and general task in Hadoop/Hive Job, Spring containers.Taurus host node is referred to as
Master, Web interface are together with Master.User is on web interface after establishment task, and write-in MySQL does persistence and deposited
Storage, when Master judges that the condition of task triggering is met, then reads mission bit stream from MySQL, writes ZooKeeper；
Agent is deployed on the machine of user, the change on observation ZooKeeper, is obtained mission bit stream, is started task.It is many at present
User, it is desirable to which Hadoop tasks can not only be dispatched by dispatching system, can also be in dispatch set task, or even Spring containers
Task, it is necessary to use in Taurus, but Taurus development processes, it is necessary to be constantly compiled to source code, debugging.Compiling
Time will be calculated according to hour, if network environment is undesirable, it will reach a few hours.During by being compiled to each module
Between observation it has also been found that because Taurus is the larger project that compares, other big data components relied on are a lot
It is very big, thus every time compiling download it is time consuming, especially project team everyone be required for when compiling is tested from distal end
Server is downloaded, more time-consuming.The present invention provides a kind of Taurus projects fast construction building method, using Maven
（http://maven.apache.org/）Carry out project management.
The content of the invention
The present invention is the larger project that compares for Taurus, and it is many also very big to rely on other big data components,
So every time compiling download it is time consuming, especially project team everyone test compiling when be required for from far-end server
Download, there is provided a kind of Taurus projects fast construction building method the problem of more time-consuming, realize quick using the inventive method
Taurus is built and changed, by the Taurus last compilation process times by original a few houres even tens of hours, number is reduced to
Ten minutes.
Concrete scheme proposed by the present invention is：
A kind of Taurus projects fast construction building method, is concretely comprised the following steps：
1. Taurus project compilation times are tested, the time recording mechanism provided using Linux repeatedly tests Taurus sources
The time of code compiling, and compilation time is segmented, the time of each compiling section is averaged, the volume of holding time at most is checked
Translate section；
2. local Maven reliance servers are built, privately owned server is disposed, privately owned server is downloaded, installs
Configured into rear by web page portions；
3. the Pom.xml files in Taurus are modified according to Maven requirement, according to step, 1. holding time is most
Many compiling sections, the module of modification has server and agent collectors；
Needing the project of modification has<repositories><repository>Privately owned server address configuration item</
repository></repositories>；
<pluginRepositories><pluginRepository>Privately owned server address configuration item</
pluginRepository></pluginRepositories>；
Above-mentioned modification is pointed to the privately owned server of step 2. middle deployment；
4. Taurus is built, by the modification of the Pom.xml files in the deployment and Taurus of above-mentioned privately owned server, after
It is continuous to build compiling according to prompting operation completion Taurus.
The privately owned server of described step 2. middle deployment is Nexus or Archiva or Artifactory.
When the privately owned server of described step 2. middle deployment is Nexus, there are two kinds of mounting means, one kind is to carry
Jetty servers, it is another without jetty servers；When being installed as Nexus without jetty servers, it is necessary to by download
War bags are put into server, when being installed as the Nexus with jetty servers, can directly run startup.
Described step 3. in also include modification mirror image and point to change<mirrors><mirror>Private takes address configuration
</mirror></mirrors>。
Usefulness of the present invention is：The present invention provides a kind of Taurus projects fast construction building method, for
Taurus is the larger project that compares, and it is many also very big to rely on other big data components, so compiling is downloaded very every time
It is time-consuming, especially project team everyone test compiling when be required for from far-end server download, more time-consuming asks
Topic, sets up the privately owned server warehouses of corresponding Maven, searches and changes in Taurus source codes most holding time and rely on download
Partial code, and it is repaired, is changed to point to privately owned server warehouse and downloads, so that Taurus builds compilation time
It is greatly shortened, accelerates the speed for building compiling, is conducive to improving operating efficiency.
Brief description of the drawings
Fig. 1 Taurus originals build dependence and obtain schematic diagram；
Fig. 2 Taurus of the present invention build dependence and obtain schematic diagram.
Embodiment
With reference to accompanying drawing, specific elaboration is done to the present invention.
Resource acquisition during original Taurus compilings is shown referring to Fig. 1.
Required environment is：
JDK1.6.0 and more than；
Apache Maven3.0.5；
Python2.6, by ordering sh setuptools- 0.6c11-py2.6.egg to be installed；
Rpmbuild, Taurus compiling are referred to as RPM bags；
G++, (gcc-c++ bags, gcc c++ compilers；
NodeJS, tests whether to install successfully by two order node and npm；
Brunch 1.7.13；
After required environment before guarantee, the compiling of Taurus projects can be carried out below：
tar xfvz Taurus-1.0.tar.gz
cd Taurus1.0
mvn versions:set -DnewVersion=1.5.1
mvn -B clean install package rpm:rpm -DnewVersion=1.5.1 -DskipTests -
Dpython.ver = "python >= 2.6"
If operate above it is errorless if, you will obtain a Taurus RPM installation kit, you can carry out corresponding portion
Administration.It is compiled only according to above step, the time of compiling will be calculated according to hour, very time-consuming, test compiling
When all from far-end server download, it is more time-consuming.
The selected privately owned server construction software to be used is needed in the present invention.There are three kinds to be used for Maven storehouse managements：
The Archiva of Apache foundations；JFrog Artifactory and Sonatype Nexus.Wherein, Archiva is to increase income
, Artifactory and Nexus core are also what is increased income.Referring to Fig. 2, privately owned server warehouse is referred to as private in figure
Warehouse is taken, by taking the privately owned server warehouses of Nexus as an example, a kind of Taurus projects fast construction building method of the invention, specific step
Suddenly it is：
1. Taurus project compilation times are tested, the time recording mechanism provided using Linux repeatedly tests Taurus sources
The time of code compiling, and compilation time is segmented, the time of each compiling section is averaged, the volume of holding time at most is checked
Translate section；
2. local Maven reliance servers are built, privately owned server is disposed, downloads, there is two kinds of mounting means, one
It is to carry jetty servers to plant, another without jetty servers；When being installed as Nexus without jetty servers, it is necessary to
The war bags of download are put into server, when being installed as the Nexus with jetty servers, startup can be directly run；Nexus
Privately owned server, is configured after installation by web page portions；
3. the Pom.xml files in Taurus are modified according to Maven requirement, according to step, 1. holding time is most
Many compiling sections, the module of modification has server and agent collectors；
Needing the project of modification has<repositories><repository>Privately owned server address configuration item</
repository></repositories>；
<pluginRepositories><pluginRepository>Privately owned server address configuration item</
pluginRepository></pluginRepositories>；
Modification mirror image points to change<mirrors><mirror>Private takes address configuration</mirror></mirrors>；
Above-mentioned modification is pointed to the privately owned server of step 2. middle deployment；
4. Taurus is built, by the modification of the Pom.xml files in the deployment and Taurus of above-mentioned privately owned server, after
It is continuous to build compiling according to prompting operation completion Taurus.
Contrast and can be seen that from Fig. 1, Fig. 2, the process that Taurus builds compiling has been transferred to from private from remote warehouse download
There is the download of server warehouse, avoid the longer Taurus source codes part of holding time, obtain the speed that Taurus builds compiling
To accelerate.
Claims (4)
1. a kind of Taurus projects fast construction building method, it is characterized in that concretely comprising the following steps：
1. Taurus project compilation times are tested, the time recording mechanism provided using Linux is repeatedly tested Taurus source codes and compiled
The time translated, and compilation time is segmented, the time of each compiling section is averaged, the compiling of holding time at most is checked
Section；
2. local Maven reliance servers are built, privately owned server is disposed, privately owned server are downloaded, after installation
Configured by web page portions；
3. the Pom.xml files in Taurus are modified according to Maven requirement, according to step, 1. holding time is most
Section is compiled, the module of modification there are server and agent collectors；
Needing the project of modification has<repositories><repository>Privately owned server address configuration item</
repository></repositories>；
<pluginRepositories><pluginRepository>Privately owned server address configuration item</
pluginRepository></pluginRepositories>；
Above-mentioned modification is pointed to the privately owned server of step 2. middle deployment；
4. Taurus is built, and by the modification of the Pom.xml files in the deployment and Taurus of above-mentioned privately owned server, continues to press
Taurus, which is completed, according to prompting operation builds compiling.
2. a kind of Taurus projects fast construction building method according to claim 1, it is characterized in that described step is 2.
The privately owned server of middle deployment is Nexus or Archiva or Artifactory.
3. a kind of Taurus projects fast construction building method according to claim 2, it is characterized in that described step is 2.
When the privately owned server of middle deployment is Nexus, there is two kinds of mounting means, one kind is to carry jetty servers, it is another without
Jetty servers；When being installed as the Nexus without jetty servers, it is necessary to which the war bags of download are put into server, work as peace
Fill as the Nexus with jetty servers, can directly run startup.
4. a kind of Taurus projects fast construction building method according to claim any one of 1-3, it is characterized in that described
The step of 3. in also include modification mirror image and point to change<mirrors><mirror>Private takes address configuration</mirror></
mirrors>。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510007610.9A CN104572236B (en) | 2015-01-07 | 2015-01-07 | A kind of Taurus projects fast construction building method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510007610.9A CN104572236B (en) | 2015-01-07 | 2015-01-07 | A kind of Taurus projects fast construction building method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104572236A CN104572236A (en) | 2015-04-29 |
| CN104572236B true CN104572236B (en) | 2017-08-04 |
Family
ID=53088393
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510007610.9A Active CN104572236B (en) | 2015-01-07 | 2015-01-07 | A kind of Taurus projects fast construction building method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104572236B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106777299B (en) * | 2016-12-30 | 2020-10-09 | 深圳市彬讯科技有限公司 | Project dependency relationship solution method using management tool and static data warehouse |
| CN107707625A (en) * | 2017-09-05 | 2018-02-16 | 江苏电力信息技术有限公司 | Foreground resource based on Maven is packed and carries out version management and the method used |
| CN110457022B (en) * | 2019-07-19 | 2023-04-18 | 上海易点时空网络有限公司 | Nodejs-based non-intrusive project execution method and system and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102393845A (en) * | 2011-06-30 | 2012-03-28 | 北京新媒传信科技有限公司 | Shared library management method and system |
| CN103500087A (en) * | 2013-09-17 | 2014-01-08 | 福建亿榕信息技术有限公司 | Code generation method and device based on maven plug-in and freemarker template |
| CN104142825A (en) * | 2014-07-08 | 2014-11-12 | 北京彩云动力教育科技有限公司 | Method and system for modularization development of products |
-
2015
- 2015-01-07 CN CN201510007610.9A patent/CN104572236B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102393845A (en) * | 2011-06-30 | 2012-03-28 | 北京新媒传信科技有限公司 | Shared library management method and system |
| CN103500087A (en) * | 2013-09-17 | 2014-01-08 | 福建亿榕信息技术有限公司 | Code generation method and device based on maven plug-in and freemarker template |
| CN104142825A (en) * | 2014-07-08 | 2014-11-12 | 北京彩云动力教育科技有限公司 | Method and system for modularization development of products |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104572236A (en) | 2015-04-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110532189B (en) | Continuous integration system, method and device | |
| US8533676B2 (en) | Single development test environment | |
| US8745585B2 (en) | Meta-data for single development test environment | |
| CN108196915B (en) | Code processing method and device based on application container engine and storage medium | |
| US8522207B1 (en) | Systems and methods for automated centralized build/merge management | |
| US8091066B2 (en) | Automated multi-platform build and test environment for software application development | |
| US20130174124A1 (en) | Version numbering in single development and test environment | |
| US9286191B2 (en) | Logging code generation and distribution | |
| CN111580832A (en) | Application release system and method applied to heterogeneous multi-cloud environment | |
| CN111066304A (en) | Edge device and associated network utilizing microservices | |
| CN108170448B (en) | System for automatically and efficiently releasing software update version | |
| CN112083948B (en) | Automatic construction and deployment method and tool based on data configuration | |
| AU2012201749B2 (en) | Single development test environment | |
| CN104572236B (en) | A kind of Taurus projects fast construction building method | |
| US20160335069A1 (en) | Dependency handling for software extensions | |
| CN115098156B (en) | Network mode management system and management method | |
| US9760364B2 (en) | Checks for software extensions | |
| CN102768628A (en) | Method and device for preinstallation of third party application | |
| US7437705B1 (en) | System and method for building an application on a computing device which includes an environment-controlling process | |
| US20190012161A1 (en) | Distributed and self-deleting apparatus for fast software deployment and upgrade in a network | |
| CN102486736B (en) | Method for automatically upgrading program and generating device for upgrading program | |
| US7921417B2 (en) | Method and computer system for activation of source files | |
| EP2503450A2 (en) | Version numbering in single development and test environment | |
| CN114489704A (en) | Version compiling and deploying method and device based on strategy | |
| CN112783653A (en) | Resource scheduling method and device based on containerization |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |