big-data-analytics

This is an old revision of the document!

Big Data Analytics

Fundamentals

Character encodings
- ASCII
- ISO 8859-1
- Unicode
- UTF-8
- UTF-16
- UTF-32
- EBCDIC
File formats
- CSV
- XML and XSD
- JSON
Databases
- SQL
- JDBC
Network
- IPv4 and network mask
- IPv6
- Routing and Router
- Gateway
- Firewall
- NAT
Unix: users, groups, ACL
SSH: key authentication, tunneling, SCP

Concepts

Eco system

Technologies

Apache Hadoop
- Apache HDFS
- Apache MapReduce
- Apache Parquet
- Apache Sentry
Apache Oozie: Worklow scheduling system
Apache Sqoop
Apache Hive
Cloudera Impala
Cloudera Hue
Apache Spark with Python, Scala, R
Apache Kafka
Grafana
ELK stack
- Elasticsearch
- Logstash
- Kibana
Apache Flink
Apache Storm
Apache Beam

Development

Hadoop: How to set up your development environment
Spark
- Installing Spark standalone to a cluster
- Spark developer tools

Open Data

RIPE Atlas Result Streams

big-data-analytics.1531743009.txt.gz · Last modified: 2020-10-11 16:27 (external edit)