Skip to content
This repository has been archived by the owner on Nov 18, 2020. It is now read-only.

Semi-automation of running everything after vagrant's up #4

Open
wants to merge 2 commits into
base: master
Choose a base branch
from
Open

Semi-automation of running everything after vagrant's up #4

wants to merge 2 commits into from

Conversation

iinegve
Copy link

@iinegve iinegve commented Dec 22, 2014

Automation of running hdfs format, hadoop namenode, datanodes, yarn manager,
proxy server, spark master.

Hadoop, spark, jdk versions update.

Eugene Morozov and others added 2 commits December 22, 2014 15:30
Automation of running hdfs format, hadoop namenode, datanodes, yarn manager,
proxy server, spark master.

Hadoop, spark, jdk versions update.
@jwtodd
Copy link

jwtodd commented May 7, 2015

i'd like to see this pull request committed.

master fails. this update works with one hack i did to scripts/common.sh:

sed -i '' -e "s#http://www.apache.org/dyn/closer.cgi/spark/spark-1.1.1#http://mirrors.ibiblio.org/apache/spark/spark-1.1.1#" ./scripts/common.sh 2>/dev/null

@iinegve
Copy link
Author

iinegve commented May 7, 2015

jwtodd, this project seems abandoned. At least this pull request lives here more than half of year.
You can commit it to my fork: fathersson/vagrant-hadoop-2.4.1-spark-1.0.1

@jwtodd
Copy link

jwtodd commented May 7, 2015

+1 @fathersson

totally concur!

@vangj
Copy link
Owner

vangj commented May 7, 2015

sorry guys, been busy as of late...

i created a branch recently of of master (see link below). this branch
installs hadoop 2.6.0 with spark 1.3.0. after the vm is provisioned, all
services are run automatically. you no longer have to do things like format
the namenode or manually bring up the services. thanks for your interest in
the project and help. also, in this branch, there's some data-mining
related scala/spark code, if you guys are interested. cheers.

https://github.com/vangj/vagrant-hadoop-2.4.1-spark-1.0.1/tree/hadoop-2.6.0-spark-1.3.0

On Thu, May 7, 2015 at 3:58 PM, James Todd [email protected] wrote:

+1 @fathersson https://github.com/fathersson

totally concur!


Reply to this email directly or view it on GitHub
#4 (comment)
.

Jee Vang, Ph.D.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants