• Martin Fowler on Data Lake

• Big Data Landscape
  • http://mattturck.com/bigdata2017/
  • http://mattturck.com/wp-content/uploads/2017/05/Matt-Turck-FirstMark-2017-Big-Data-Landscape.png
• Distributions: https://wiki.apache.org/hadoop/Distributions%20and%20Commercial%20Support
• Eco system: https://hadoopecosystemtable.github.io/

• Apache Hadoop
  • Apache HDFS
  • Apache MapReduce
  • Apache Parquet
  • Apache Sentry
• Apache Sqoop
• Apache Hive
• Cloudera Impala
• Cloudera Hue
• Apache Spark with Python, Scala, R
• Apache Kafka
• Grafana
• ELK stack
  • Elasticsearch
  • Logstash
  • Kibana
• Apache Flink
• Apache Storm
• Apache Beam

Hadoop: https://wiki.apache.org/hadoop/HowToSetupYourDevelopmentEnvironment

Spark:

• http://spark.apache.org/docs/latest/spark-standalone.html#installing-spark-standalone-to-a-cluster
• https://spark.apache.org/developer-tools.html