-
Notifications
You must be signed in to change notification settings - Fork 263
Description
Hi all,
I'm new to Spark, Pyspark and all its concepts. As a requirement for out Project, we have defided to go forward with Graphframes in our use case. I started on a naked system and did the following steps:
pip install pyspark==2.1.2 [Install Pyspark & Hence Spark]
SPARK_HOME=/root/anaconda3/envs/Py3.6/lib/python3.6/site-packages/pyspark
wget https://github.com/graphframes/graphframes/archive/release-0.5.0.zip [Download Graphframes in /opt/Downloads/ directory]
cd /opt/Downloads/
unzip release-0.5.0.zip [Unzipping]
cd graphframes-release-0.5.0/
build/sbt assembly.
I get the following error on running build [Copied on paste.org at this Link for easy readability]
I thought this is because I've slf4j dependency missing. I added the same for version 1.7.7 to my pom.xml and did mvn clean package.
Now, I've a .pom file as mentioned in traceback at the file specified, but it doesn't seem to be able to read it.
Is there anythin I'm doing wrong?
Thanks.