SeaweedFS is a simple and highly scalable distributed file system to store and serve billions of files fast! SeaweedFS object store has O(1) disk seek, transparent cloud integration, and SeaweedFS Filer supports Kubernetes, POSIX, S3 API, encryption, Erasure Coding for warm storage, FUSE mount, Hadoop, WebDAV.

大数据入门指南 ⭐

大数据面试题，大数据成神之路开启...Flink/Spark/Hadoop/Hbase/Hive...

Utils for streaming large files (S3, HDFS, gzip, bz2...)

A pandas-like deferred expression system, with first-class SQL support

A native go client for HDFS

The Universal Storage Engine

A pure python HDFS client

Real Time Analytics and Data Pipelines based on Spark Streaming

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

💎🔥大数据学习笔记

Kafka Connect HDFS connector

Web tool for Kafka Connect |

80+ DevOps & Data CLI Tools - AWS, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, Ambari, Blueprints, CloudFormation, Elasticsearch, Solr, Pig, IPython - Python / Jython Tools

Divolte Collector

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

API and command line interface for HDFS

DC/OS SDK is a collection of tools, libraries, and documentation for easy integration of technologies such as Kafka, Cassandra, HDFS, Spark, and TensorFlow with DC/OS.

HDFS compress tar zip snappy gzip uncompress untar codec hadoop spark

weather radar data processing - python package

A tool for scale and performance testing of HDFS with a specific focus on the NameNode.

A tool and library for easily deploying applications on Apache YARN

Fundamentals of Spark with Python (using PySpark), code examples

基于wifi抓取信息的大数据查询分析系统

HDFS Shell is a HDFS manipulation tool to work with functions integrated in Hadoop DFS

Big Data Ecosystem Docker

NameNodeAnalytics is a self-help utility for scouting and maintaining the namespace of an HDFS instance.

Kafka Connect FileSystem Connector

Euphoria is an open source Java API for creating unified big-data processing flows. It provides an engine independent programming model which can express both batch and stream transformations.

Mirror of Linkedin's Camus