Regression & Chaos Testing
Narwhal's core maintainability is driven by codifying real-world failure post-mortems into automated regression tests.
Three-Tier Verification Suite
- Cluster Verification (120+ Checks):
- Node kernel parameters, VIP responsiveness, CNI forwarding, DNS, and storage mount validation
- SSO & IAM Verification (49 Checks):
- Keycloak OIDC issuance, OAuth2 Proxy cookie validation, and RBAC boundary testing
- CI Regression Suite (51 Checks):
- 51 specialized checks derived from 263 incident root causes and discriminators
Chaos Engineering with Chaos Mesh
- Network Partition Injections: Verifying etcd quorum resilience during master node drops
- Pod Failure Experiments: Validating zero-downtime traffic ingress during APISIX pod crashes