云猿生数据：KubeBlocks把所有数据库运行到K8s上

KubeBlocks: 把所有数据库都运行到 K8sRun Any Database on K8s演讲人：曹伟演讲者：曹伟前 阿 里 云 数 据 库 总 经 理 / 研 究 员 ， 云 原 生 数 据 库PolarDB 创始人。中国计算机学会数据库专委会、开源专委会执行专委，获得 2020 年中国电子学会科技进步一等奖，在 SIGMOD、VLDB、ICDE、FAST、USENIX ATC 等数据库与存储国际顶级学术会议发表论文 20 余篇。K8s is eating the worldGKEEKSACKAKSOpenShift Rancher阿里云AWSGCPAzure物理机PODservicePVC/PVsecretconfigmapTaintTolerationAffinityAnti-AffinityeventAppInternal Developer Platform / 平台工程DatabaseWorkflow业务开发SchemaEndpointK8sACLK8s is eating the worldYAML is the programming language of DevOps传统data infra control plane——烟囱式架构•体验不一致•系统预期行为不一致引 擎运 维 操 作环 境•业务引入新引擎成本高•Conway's LawDBPaaS API & PortalMySQL管控PG管控MongoDB管控Redis管控OLAP管控ES,Kafka,ClickHouse,……HA备份恢复迁移监控报警　审计扩缩容容灾资源调度云（虚拟机）物理机容器存储网络升级账号授权安全企业对云原生的data infra control plane的需求§学习曲线类似§支持 IaC 实践§提供声明式 APIK8s APIAutomation§支持新业务扩展新引擎通过抽象和扩展API实现对多种数据库的统一管理K8s APIkbcliKubeBlocks Cloud领域模型YAML低代码扩展PodSchedulerCSI……生命周期高可用配置管理备份还原账号管理监控日志MySQL CRRedis CRPG CRMongoDB CRKafka CRPulsar CR StarRocks CROceanBase CR……K8s容器编排声明式 APIOpenAPI人工操作IaC自动化扩展APIKubeBlocks API对分布式数据库的拓扑进行抽象Cluster & ClusterDefinitionComponent & ComponentDefinitionInstanceSetInstanceK8s 抽象PodPVCConfigmapServiceTolerationAffinity……抽象把KubeBlocks API映射到数据库 – MySQLCluster: MySQLComponent:MySQLInstanceSetInstanceInstancePodPVCService抽象InstanceComponent:OrchestratorInstanceSetInstanceInstancePodInstanceComponent:ProxyInstanceSetInstanceInstancePodServiceService把KubeBlocks API映射到数据库 – OceanBaseCluster: Oceanbase-paxosComponent:OceanbaseInstanceSetInstanceInstancePodPVCService抽象Instance把KubeBlocks API映射到数据库 – OceanBase主备Cluster: Oceanbase-masterslaveComponent:Oceanbase-replComponent:Oceanbase-replInstanceSetInstanceInstanceSetInstancePodPVCServicePodPVCService抽象把KubeBlocks API映射到数据库 – MogDBCluster: MogDB-masterslaveComponent:mogdbInstanceSet抽象InstanceInstancePodPVCService把KubeBlocks API映射到数据库 – Redis主备Cluster: Redis-masterslaveComponent: RedisComponent:SentinelInstanceSetInstanceSetInstanceInstanceInstancePodPVCService抽象InstanceInstancePodPVCService把KubeBlocks API映射到数据库 – Redis ClusterCluster: Redis-clusterComponent: redisComponent: redisComponent:redisComponent:redisComponent:redisInstanceSetInstanceSetInstanceSetInstanceSetInstanceSet抽象InstanceInstancePodPVCServiceInstanceInstancePodPVCServiceInstanceInstancePodPVCServiceInstanceInstancePodPVCServiceInstanceInstancePodPVCService把KubeBlocks API映射到数据库 – KafkaCluster: kafkaComponent: brokerComponent:controllerComponent:exporterInstanceSetInstanceSetInstanceSetInstanceInstanceInstanceInstanceInstancePodPVCService抽象InstanceInstanceInstancePodPVCServiceInstancePod把KubeBlocks API映射到数据库 – PulsarCluster: pulsarComponent: pulsar-brokerComponent: pulsar-proxyComponent:bookiesComponent:zookeeperInstanceSetInstanceSetInstanceSetInstanceSetInstanceInstanceInstanceInstanceInstancePodPVCServiceInstanceInstanceInstancePodPVCService抽象InstanceInstanceInstanceInstanceInstancePodPVCServiceInstanceInstanceInstanceInstanceInstancePodPVCService不同层次KubeBlocks API的不同用途分层Cluster & ClusterDefinitionComponent