SparkSQL_Demo

Spark+IntelliJ+JAVA+MAVEN windows development settings[With code]

1. Windows

• mvn compile
• mvn package

2. Operation on Spark Environment

• start master
  • ./sbin/start-master.sh
• start worker
  • ./bin/spark-class org.apache.spark.deploy.worker.Worker spark://Hadoop04:7077
• submit work
  • ./bin/spark-submit --master spark://Hadoop04:7077 --class Operate /home/test-libs/sparksql-1.0-SNAPSHOT.jar