A collection of ready-to-use Docker development environments for multiple Linux distributions (Ubuntu, Debian, Alpine, Arch, Kali). Includes shared configurations, utility scripts, and comprehensive documentation for reproducible development setups across teams and CI/CD pipelines.

Large Tech Knowledge Base from 20 years in DevOps, Linux, Cloud, Big Data, AWS, GCP and international Consulting including extensive Travel Tips around the world

1000+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Docker, CI/CD, APIs, SQL, PostgreSQL, MySQL, Hive, Impala, Kafka, Hadoop, Jenkins, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, tmux..

Distributed big data analytics using Hadoop MapReduce on 22 years of US flight data (118.9M records, 11.66 GB). Achieved 2.73x speedup with horizontal scaling and sub-linear data scaling performance.

Docker image with Hadoop cluster

Hadoop and Hive fundamental commands

Hadoop on Kubernetes on Docker Desktop.

A fully-functional Hadoop Yarn cluster as docker-compose deployment.

A ready-to-run Spark + Hadoop + Hive container for local development and testing your spark applications. Includes spark with HDFS , Hive in a single container

Apache Fluo Yarn

🐘 Dockerized Hadoop cluster for local development and testing with HDFS and YARN

Hadoop-ecosystem-example-project

50+ DockerHub public images for Docker & Kubernetes - DevOps, CI/CD, GitHub Actions, CircleCI, Jenkins, TeamCity, Alpine, CentOS, Debian, Fedora, Ubuntu, Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak

80+ HAProxy Configs for Hadoop, Big Data, NoSQL, Docker, Kubernetes, Elasticsearch, SolrCloud, HBase, MySQL, PostgreSQL, Apache Drill, Hive, Presto, Impala, Hue, ZooKeeper, SSH, RabbitMQ, Redis, Riak, Cloudera, OpenTSDB, InfluxDB, Prometheus, Kibana, Graphite, Rancher etc.

Use virtualbox to quickly build a big data test environment

Haddoop: Exemple Spring-boot avec Apache Hive

apache-ozone-guide

L'objectif du projet est de créer un cluster Docker donnant accès à Hadoop, HDFS, Hive, PySpark, Sqoop, Airflow, Kafka, Flume, Postgres, Cassandra, Hue, Zeppelin, Kadmin, Kafka Control Center et pgAdmin. Ce cluster est exclusivement destiné à un usage en développement. Ne pas l'utiliser en production.

Docker Images, config files and scripts to create a big data cluster

大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。