Flink泛技术栈
MQ & CDC:
Kafka & Confluent
Pulsar & StreamNative
Mysql CDC
PostgreSQL CDC
RocketMQ & MetaQ & MQ
RabbitMQ
Google Pub-Sub
Azure EventHub
AWS kinesis data stream
Alibaba Datahub
DTS
调度:
Airflow
Azkaban
Oozie
Auth:
Ranger
KerberOS
Alibaba ASCM
RAM
IAM
Format:
Avro
ORC
Parquet
Delta Lake
Hudi
Iceberg
Canal
Debezium
Maxwell
日志采集:
Alibaba SLS
Flume
Logstash
数据集成:
Sqoop
DataX
Gobblin
Azure DataFactory
AWS Glue
datapipeline
存储:
HDFS
OSS
AWS S3
JindoFS
juiceFS
Alluxio
CEPH
离线&实时数仓:
Hive
Alibaba MaxCompute
Snowflake
Huawei GaussDB(DWS)
Cloudera CDW
AWS redshift
Azure Synapse
Search:
ElasticSearch
Solr
Splunk
OLAP & 交互式分析:
Google BigQuery
Greenplum & Pivotal
Clickhouse
Hologres
ADB Mysql 3.0
ADB PG
Doris & DorisDB(starrocks)
Pinot
Druid
Kylin & Kyligence
AWS Athena
数据库:
Kudu
Redis
MySQL
PostgreSQL
HBase
Lindorm
MongoDBOracle
Oracle TimesTen
Cassandra & DataStax
TiDB & PingCAP
PolarDB
OceanBase
TDDL
Google Spanner & F1
Azure Cosmos
AWS Aurora
AWS DynamoDB
SAP HANA
TiDB
元数据
DLF
Linkedin Datahub(wherehows)
计算引擎:
MapReduce
Tez
Spark & Databricks
Presto & Teradata & Starburst & Trino
Impala
Hadoop发行版:
Cloudera CDH
Cloudera CDP
MapR
流计算引擎:
Storm
Trident
Samza
Flink & Ververica
KsqlDB
Beam
Google Cloud Dataflow
AWS kinesis stream analytics
Azure Stream Analytics
Tencent Oceanus
Huawei CS
Huawei DLI
Cloudera CDF
星环 SlipStream
Lindorm stream
RocketMQ Stream
Kafka Stream
K-V:
LevelDB(LSM)
RocksDB
TiKV
调度:
K8s
Yarn
Helix
可靠性保证
ZK(ZAB & Paxos)
ETCD(raft)
容器和编排:
Docker
Pouch
K8s
ACK
ASI
ECI
Monitoring:
Grafana
Influxdb
prometheus
prometheus pushgateway
VM & 硬件:
OpenStack
ECS & 神龙
raid
LVM
Open-Local(YODA)
操作系统 与运行环境:
Linux
Ali OS
Ali JDK
规则引擎:
Drools
中间件:
Nginx
gRPC
Spring Cloud
EDAS & HSF