SeaweedFS is a simple and highly scalable distributed file system to store and serve billions of files fast! SeaweedFS object store has O(1) disk seek, transparent cloud integration, and SeaweedFS Filer supports Kubernetes, POSIX, S3 API, encryption, Erasure Coding for warm storage, FUSE mount, Hadoop, WebDAV.

MorphL Community Edition uses big data and machine learning to predict user behaviors in digital products and services with the end goal of increasing KPIs (click-through rates, conversion rates, etc.) through personalization

A tool for scale and performance testing of HDFS with a specific focus on the NameNode.

Learn how to use Spark SQL and HSpark connector package to create / query data tables that reside in HBase region servers

Toy Hadoop cluster combining various SQL-on-Hadoop variants

A Java Hdfs client example and full Kerberos example for call hadoop commands directly in java code or on your local machine.

Big data projects implemented by Maniram yadav

Twitter + Flume + Hadoop (HDFS, MapReduce) + Neo4j + Pyhton

Install Hadoop, HDFS, Yarn and Spark on 3 Ubuntu 18.04 Machines

Neat and Handy Place for all Hadoop codes

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Analysis of YouTube Data using Hadoop Mapreduce framework in Java.

Vehicle Fuel Hadoop MapReduce

HokStack - Run Hadoop Stack on Kubernetes

Python scripts to assist setting up Hadoop v1 in Linux and starting a NameNode, DataNodes and Client.

Python scripts for automating the hadoop dfs setup

Instructions on setting up Hadoop, HDFS, java, sbt, kafka, scala, spark and flume on Ubuntu 18.04

🐘Yet another Hadoop playground

API to interact with HDFS

Machine Learning for Forest Fire Prediction using Hadoop ecosystems and Spark Tools (Pyspark)

Projects using S3, Amazon SageMaker, AWS Lambda Function, Amazon Forecast; Projects related to SQL, Hadoop, Flink (Java), and Google Map API

In this project we will fetch tweets using Apache Flume. We will also use the memory channel to buffer these tweets and HDFS sink to push these tweets into the HDFS.

Java API操作HDFS文件、基于MapReduce的词频统计程序及其重构、MapReduce编程之Combiner、Partitioner组件应用

Twitter data analysis using hadoop (hdfs), flume, map-reduce and hive. Sentiment Analysis is also done using affin dictionary for tweets related to Indian election.

ES Hadoop数据双向读写 share data between es and hadoop base on ES-Hadoop

Bootcamp ministrado pela IGTI com o objetivo de abordar de forma intensiva conceitos e práticas da análise de dados, habilitando o aluno para atuar profissionalmente na área.

EMR 5.25.0 cluster single node Hadoop docker image. With Amazon Linux, Hadoop 2.8.5 and Hive 2.3.5

Setting up of a cluster and performing analysis of Aadhar Dataset using Apache Hive

mastering spark