SeaweedFS is a distributed object store and file system to store and serve billions of files fast! Object store has O(1) disk seek, transparent cloud integration. Filer supports cross-cluster active-active replication, Kubernetes, POSIX, S3 API, encryption, Erasure Coding for warm storage, FUSE mount, Hadoop, WebDAV.

MorphL Community Edition uses big data and machine learning to predict user behaviors in digital products and services with the end goal of increasing KPIs (click-through rates, conversion rates, etc.) through personalization

A tool for scale and performance testing of HDFS with a specific focus on the NameNode.

Learn how to use Spark SQL and HSpark connector package to create / query data tables that reside in HBase region servers

Toy Hadoop cluster combining various SQL-on-Hadoop variants

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

A Java Hdfs client example and full Kerberos example for call hadoop commands directly in java code or on your local machine.

Big data projects implemented by Maniram yadav

Marathon on yarn

Twitter + Flume + Hadoop (HDFS, MapReduce) + Neo4j + Pyhton

HokStack - Run Hadoop Stack on Kubernetes

Neat and Handy Place for all Hadoop codes

Analysis of YouTube Data using Hadoop Mapreduce framework in Java.

Install Hadoop, HDFS, Yarn and Spark on 3 Ubuntu 18.04 Machines

Vehicle Fuel Hadoop MapReduce

Python scripts to assist setting up Hadoop v1 in Linux and starting a NameNode, DataNodes and Client.

Python scripts for automating the hadoop dfs setup

Instructions on setting up Hadoop, HDFS, java, sbt, kafka, scala, spark and flume on Ubuntu 18.04

Projects using S3, Amazon SageMaker, AWS Lambda Function, Amazon Forecast; Projects related to SQL, Hadoop, Flink (Java), and Google Map API (Jun 2019 - Jul 2019)

🐘Yet another Hadoop playground

API to interact with HDFS

EMR 5.25.0 cluster single node Hadoop docker image. With Amazon Linux, Hadoop 2.8.5 and Hive 2.3.5

Machine Learning for Forest Fire Prediction using Hadoop ecosystems and Spark Tools (Pyspark)

In this project we will fetch tweets using Apache Flume. We will also use the memory channel to buffer these tweets and HDFS sink to push these tweets into the HDFS.

Java API操作HDFS文件、基于MapReduce的词频统计程序及其重构、MapReduce编程之Combiner、Partitioner组件应用

Python automation in linux

ES Hadoop数据双向读写 share data between es and hadoop base on ES-Hadoop

Bootcamp ministrado pela IGTI com o objetivo de abordar de forma intensiva conceitos e práticas da análise de dados, habilitando o aluno para atuar profissionalmente na área.