Terraform AWS MSK Kafka Cluster

MSK clusters with broker configuration, encryption in transit and at rest, client authentication, logging, VPC networking, and cluster policies for streaming workloads.

Quick start

module "msk-kafka-cluster" {
  source  = "cfrpart11.compliance.tf/terraform-aws-modules/msk-kafka-cluster/aws"
  version = "~> 3.3"

  # ... your arguments here
}

module "msk-kafka-cluster" {
  source  = "eugmpannex11.compliance.tf/terraform-aws-modules/msk-kafka-cluster/aws"
  version = "~> 3.3"

  # ... your arguments here
}

module "msk-kafka-cluster" {
  source  = "iso27001.compliance.tf/terraform-aws-modules/msk-kafka-cluster/aws"
  version = "~> 3.3"

  # ... your arguments here
}

module "msk-kafka-cluster" {
  source  = "nistcsf.compliance.tf/terraform-aws-modules/msk-kafka-cluster/aws"
  version = "~> 3.3"

  # ... your arguments here
}

module "msk-kafka-cluster" {
  source  = "pcidss.compliance.tf/terraform-aws-modules/msk-kafka-cluster/aws"
  version = "~> 3.3"

  # ... your arguments here
}

module "msk-kafka-cluster" {
  source  = "soc2.compliance.tf/terraform-aws-modules/msk-kafka-cluster/aws"
  version = "~> 3.3"

  # ... your arguments here
}

module "msk-kafka-cluster" {
  source  = "awswellarchitected.compliance.tf/terraform-aws-modules/msk-kafka-cluster/aws"
  version = "~> 3.3"

  # ... your arguments here
}

module "msk-kafka-cluster" {
  source  = "fedramplow.compliance.tf/terraform-aws-modules/msk-kafka-cluster/aws"
  version = "~> 3.3"

  # ... your arguments here
}

This module on the compliance.tf registry lists its versions, inputs and outputs. The Get Started guide and Registry Endpoints cover authentication and how to customize the module for your requirements.

Migration from upstream

Already using terraform-aws-modules? Change only the source URL:

module "msk-kafka-cluster" {
  source  = "terraform-aws-modules/msk-kafka-cluster/aws"
  version = "~> 3.3"
}

module "msk-kafka-cluster" {
  source  = "soc2.compliance.tf/terraform-aws-modules/msk-kafka-cluster/aws"
  version = "~> 3.3"
}

Same arguments. Same outputs. Controls are checked at terraform plan. The Migration Guide has the step-by-step version.

Reversibility

No lock-in. Switch back by reverting the source URL:

module "msk-kafka-cluster" {
  source  = "terraform-aws-modules/msk-kafka-cluster/aws"
}

Run terraform init -upgrade. Terraform state is unchanged: same resource addresses, same provider, no compliance.tf-specific resources. Controls you already applied remain in AWS.

Controls enforced

Up to 5 controls are checked at terraform plan when this module comes from a compliance.tf endpoint. Which ones are active depends on the endpoint; see Framework coverage.

Control	Retrofit effort
CloudWatch log groups should have retention period of at least 365 days	Low
Log groups should have encryption at rest enabled	Low
MSK clusters should require TLS for client-broker connections	Low
MSK clusters should have public access disabled	Low
MSK clusters should disable unauthenticated access	Low

Mapped compliance frameworks

Clause	Controls from this module
11.10(c) Protection of records to enable their accurate and ready retrieval throughout the records retention period	CloudWatch log groups should have retention period of at least 365 days
11.10(d) Limiting system access to authorized individuals	MSK clusters should have public access disabled MSK clusters should disable unauthenticated access
11.10(e) Use of secure, computer-generated, time-stamped audit trails to independently record the date and time of operator entries and actions that create, modify, or delete electronic records	CloudWatch log groups should have retention period of at least 365 days
11.30 Controls for open systems	Log groups should have encryption at rest enabled

Clause	Controls from this module
12.1 Security	MSK clusters should have public access disabled MSK clusters should disable unauthenticated access
17 Archiving	CloudWatch log groups should have retention period of at least 365 days
7.1 Data Storage - Damage Protection	Log groups should have encryption at rest enabled

Clause	Controls from this module
A.8.12 Data leakage prevention	MSK clusters should require TLS for client-broker connections
A.8.15 Logging	CloudWatch log groups should have retention period of at least 365 days Log groups should have encryption at rest enabled
A.8.16 Monitoring activities	CloudWatch log groups should have retention period of at least 365 days Log groups should have encryption at rest enabled
A.8.24 Use of cryptography	Log groups should have encryption at rest enabled MSK clusters should require TLS for client-broker connections

Clause	Controls from this module
PR.DS-1	Log groups should have encryption at rest enabled
PR.DS-2	MSK clusters should require TLS for client-broker connections
PR.DS-5	Log groups should have encryption at rest enabled
RC.RP-06	CloudWatch log groups should have retention period of at least 365 days

Clause	Controls from this module
10.3.2: Audit logs are protected from destruction and unauthorized modifications.	Log groups should have encryption at rest enabled
10.3.3: Audit log files, including those for externalfacing technologies, are promptly backed up to a secure, central, internal log server(s) or other media that is difficult to modify	Log groups should have encryption at rest enabled
10.3.4: File integrity monitoring or change-detection mechanisms is used on audit logs to ensure that existing log data cannot be changed without generating alerts	Log groups should have encryption at rest enabled
10.5.1: Retain audit log history for at least 12 months, with at least the most recent three months immediately available for analysis	CloudWatch log groups should have retention period of at least 365 days
2.2.7: System components are configured and managed securely.	MSK clusters should require TLS for client-broker connections
3.2.1: Storage of account data is kept to a minimum.	CloudWatch log groups should have retention period of at least 365 days
3.3.1.1: Sensitive authentication data (SAD) is not stored after authorization.	CloudWatch log groups should have retention period of at least 365 days
3.3.1.3: Sensitive authentication data (SAD) is not stored after authorization.	CloudWatch log groups should have retention period of at least 365 days
3.3.2: Sensitive authentication data (SAD) is not stored after authorization.	CloudWatch log groups should have retention period of at least 365 days
3.3.3: Sensitive authentication data (SAD) is not stored after authorization.	CloudWatch log groups should have retention period of at least 365 days
3.5.1: Primary account number (PAN) is secured wherever it is stored.	Log groups should have encryption at rest enabled
4.2.1.1: An inventory of the entity's trusted keys and certificates used to protect PAN during transmission is maintained	MSK clusters should require TLS for client-broker connections
4.2.1: PAN is protected with strong cryptography during transmission.	MSK clusters should require TLS for client-broker connections
5.3.4: Anti-malware mechanisms and processes are active, maintained, and monitored.	CloudWatch log groups should have retention period of at least 365 days
8.3.2: Strong cryptography is used to render all authentication factors unreadable during transmission and storage on all system components	Log groups should have encryption at rest enabled MSK clusters should require TLS for client-broker connections
A1.2.3: Processes or mechanisms are implemented for reporting and addressing suspected or confirmed security incidents and vulnerabilities	Log groups should have encryption at rest enabled

Clause	Controls from this module
C1.2 The entity disposes of confidential information to meet the entity's objectives related to confidentiality	CloudWatch log groups should have retention period of at least 365 days
CC6.7 The entity restricts the transmission, movement, and removal of information to authorized internal and external users and processes, and protects it during transmission, movement, or removal to meet the entity's objectives	MSK clusters should require TLS for client-broker connections
CC7.2: The entity monitors system components and the operation of those components for anomalies that are indicative of malicious acts, natural disasters, and errors affecting the entity's ability to meet its objectives; anomalies are analyzed to determine whether they represent security events.	CloudWatch log groups should have retention period of at least 365 days
CC7.3 The entity evaluates security events to determine whether they could or have resulted in a failure of the entity to meet its objectives (security incidents) and, if so, takes actions to prevent or address such failures	CloudWatch log groups should have retention period of at least 365 days Log groups should have encryption at rest enabled
P4.2 The entity retains personal information consistent with the entity's objectives related to privacy	CloudWatch log groups should have retention period of at least 365 days
PI1.4 System outputs are complete, accurate, distributed only to intended parties, and retained to meet the entity's processing integrity commitments and system requirements	Log groups should have encryption at rest enabled

Clause	Controls from this module
Data protection	Log groups should have encryption at rest enabled
Identity and access management	CloudWatch log groups should have retention period of at least 365 days

Clause	Controls from this module
Audit Record Retention (AU-11)	CloudWatch log groups should have retention period of at least 365 days
Protection of Audit Information (AU-9)	Log groups should have encryption at rest enabled

Framework coverage

Which controls from this module are active under each framework endpoint. Your framework preferences choose the columns.

Control	PCI DSS v4.0	SOC 2
CloudWatch log groups should have retention period of at least 365 days	Enforced	Enforced
Log groups should have encryption at rest enabled	Enforced	Enforced
MSK clusters should require TLS for client-broker connections	Enforced	Enforced
MSK clusters should have public access disabled	Not active	Not active
MSK clusters should disable unauthenticated access	Not active	Not active

5 controls enforced with a source URL change.

Start free trial Get started