Skip to content

sbt.ResolveException: unresolved dependency while building Graphframes #261

@debasishdebs

Description

@debasishdebs

Hi all,
I'm new to Spark, Pyspark and all its concepts. As a requirement for out Project, we have defided to go forward with Graphframes in our use case. I started on a naked system and did the following steps:

pip install pyspark==2.1.2 [Install Pyspark & Hence Spark]
SPARK_HOME=/root/anaconda3/envs/Py3.6/lib/python3.6/site-packages/pyspark
wget https://github.com/graphframes/graphframes/archive/release-0.5.0.zip [Download Graphframes in /opt/Downloads/ directory]
cd /opt/Downloads/
unzip release-0.5.0.zip [Unzipping]
cd graphframes-release-0.5.0/
build/sbt assembly.

I get the following error on running build [Copied on paste.org at this Link for easy readability]

I thought this is because I've slf4j dependency missing. I added the same for version 1.7.7 to my pom.xml and did mvn clean package.

Now, I've a .pom file as mentioned in traceback at the file specified, but it doesn't seem to be able to read it.

Is there anythin I'm doing wrong?

Thanks.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions