Skip to content

[Enhancement]: aws_glue_catalog_table_optimizer to supports vpc configuration for glue connection #44869

@vwightman

Description

@vwightman

Description

AWS added glue table optimization through the Amazon VPC in Nov 2024.

https://aws.amazon.com/blogs/big-data/aws-glue-data-catalog-supports-automatic-optimization-of-apache-iceberg-tables-through-your-amazon-vpc/

This adds the ability for glue table optimization work to take place within a customer's VPC

The aws cli reference for glue create-table-optimizer link is:
https://docs.aws.amazon.com/cli/latest/reference/glue/create-table-optimizer.html

See vpcConfiguration glueConnectionName

{
  "roleArn": "string",
  "enabled": true|false,
  "vpcConfiguration": {
    "glueConnectionName": "string"
  }
}

Thank you!

Affected Resource(s) or Data Source(s)

*aws_glue_catalog_table_optimizer

Potential Terraform Configuration

resource "aws_glue_catalog_table_optimizer" "example" {
  catalog_id    = "123456789012"
  database_name = "example_database"
  table_name    = "example_table"

  configuration {
    role_arn = "arn:aws:iam::123456789012:role/example-role"
    enabled  = true
   
    vpc_configuration {
        glue_connection_name = "my_glue_connection"
    }
  }

  type = "compaction"
}

References

The "TableOptimizerConfiguration" exists in terraform as "Configuration". Add VPC Configuration to this

The aws cli reference for glue create-table-optimizer link is:
https://docs.aws.amazon.com/cli/latest/reference/glue/create-table-optimizer.html

--table-optimizer-configuration (structure) [required]

A TableOptimizerConfiguration object representing the configuration of a table optimizer.

Whether table optimization is enabled.
vpcConfiguration -> (tagged union structure)

A TableOptimizerVpcConfiguration object representing the VPC configuration for a table optimizer.

This configuration is necessary to perform optimization on tables that are in a customer VPC.

Note
This is a Tagged Union structure. Only one of the following top level keys can be set: glueConnectionName.
glueConnectionName -> (string)

The name of the Glue connection used for the VPC for the table optimizer.

Constraints:

min: 1

Would you like to implement the enhancement?

No

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementRequests to existing resources that expand the functionality or scope.service/glueIssues and PRs that pertain to the glue service.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions