Application

emrserverless.services.k8s.aws/v1alpha1

TypeLink
GoDocemrserverless-controller/apis/v1alpha1#Application

Metadata

PropertyValue
ScopeNamespaced
KindApplication
ListKindApplicationList
Pluralapplications
Singularapplication

Information about an application. Amazon EMR Serverless uses applications to run jobs.

Spec

architecture: string
autoStartConfiguration: 
  enabled: boolean
autoStopConfiguration: 
  enabled: boolean
  idleTimeoutMinutes: integer
diskEncryptionConfiguration: 
  encryptionContext: {}
  encryptionKeyARN: string
  encryptionKeyRef: 
    from: 
      name: string
      namespace: string
identityCenterConfiguration: 
  identityCenterInstanceARN: string
  userBackgroundSessionsEnabled: boolean
imageConfiguration: 
  imageURI: string
initialCapacity: {}
interactiveConfiguration: 
  livyEndpointEnabled: boolean
  studioEnabled: boolean
jobLevelCostAllocationConfiguration: 
  enabled: boolean
maximumCapacity: 
  cpu: string
  disk: string
  memory: string
monitoringConfiguration: 
  cloudWatchLoggingConfiguration: 
    enabled: boolean
    encryptionKeyARN: string
    encryptionKeyRef: 
      from: 
        name: string
        namespace: string
    logGroupName: string
    logStreamNamePrefix: string
    logTypes: {}
  managedPersistenceMonitoringConfiguration: 
    enabled: boolean
    encryptionKeyARN: string
    encryptionKeyRef: 
      from: 
        name: string
        namespace: string
  prometheusMonitoringConfiguration: 
    remoteWriteURL: string
  s3MonitoringConfiguration: 
    encryptionKeyARN: string
    encryptionKeyRef: 
      from: 
        name: string
        namespace: string
    logURI: string
name: string
networkConfiguration: 
  securityGroupIDs:
  - string
  securityGroupRefs:
    from: 
      name: string
      namespace: string
  subnetIDs:
  - string
  subnetRefs:
    from: 
      name: string
      namespace: string
releaseLabel: string
runtimeConfiguration:
- classification: string
  properties: {}
schedulerConfiguration: 
  maxConcurrentRuns: integer
  queueTimeoutMinutes: integer
tags: {}
type: string
workerTypeSpecifications: {}
FieldDescription
architecture
Optional
string
The CPU architecture of an application.
autoStartConfiguration
Optional
object
The configuration for an application to automatically start on job submission.
autoStartConfiguration.enabled
Optional
boolean
autoStopConfiguration
Optional
object
The configuration for an application to automatically stop after a certain
amount of time being idle.
autoStopConfiguration.enabled
Optional
boolean
autoStopConfiguration.idleTimeoutMinutes
Optional
integer
diskEncryptionConfiguration
Optional
object
The configuration object that allows encrypting local disks.
diskEncryptionConfiguration.encryptionContext
Optional
object
diskEncryptionConfiguration.encryptionKeyARN
Optional
string
diskEncryptionConfiguration.encryptionKeyRef
Optional
object
Reference field for EncryptionKeyARN
diskEncryptionConfiguration.encryptionKeyRef.from
Optional
object
AWSResourceReference provides all the values necessary to reference another
k8s resource for finding the identifier(Id/ARN/Name)
diskEncryptionConfiguration.encryptionKeyRef.from.name
Optional
string
diskEncryptionConfiguration.encryptionKeyRef.from.namespace
Optional
string
identityCenterConfiguration
Optional
object
The IAM Identity Center Configuration accepts the Identity Center instance
parameter required to enable trusted identity propagation. This configuration
allows identity propagation between integrated services and the Identity
Center instance.
identityCenterConfiguration.identityCenterInstanceARN
Optional
string
identityCenterConfiguration.userBackgroundSessionsEnabled
Optional
boolean
imageConfiguration
Optional
object
The image configuration for all worker types. You can either set this parameter
or imageConfiguration for each worker type in workerTypeSpecifications.
imageConfiguration.imageURI
Optional
string
initialCapacity
Optional
object
The capacity to initialize when the application is created.
interactiveConfiguration
Optional
object
The interactive configuration object that enables the interactive use cases
to use when running an application.
interactiveConfiguration.livyEndpointEnabled
Optional
boolean
interactiveConfiguration.studioEnabled
Optional
boolean
jobLevelCostAllocationConfiguration
Optional
object
The configuration object that enables job level cost allocation.
jobLevelCostAllocationConfiguration.enabled
Optional
boolean
maximumCapacity
Optional
object
The maximum capacity to allocate when the application is created. This is
cumulative across all workers at any given point in time, not just when an
application is created. No new resources will be created once any one of
the defined limits is hit.
maximumCapacity.cpu
Optional
string
maximumCapacity.disk
Optional
string
maximumCapacity.memory
Optional
string
monitoringConfiguration
Optional
object
The configuration setting for monitoring.
monitoringConfiguration.cloudWatchLoggingConfiguration
Optional
object
The Amazon CloudWatch configuration for monitoring logs. You can configure
your jobs to send log information to CloudWatch.
monitoringConfiguration.cloudWatchLoggingConfiguration.enabled
Optional
boolean
monitoringConfiguration.cloudWatchLoggingConfiguration.encryptionKeyARN
Optional
string
monitoringConfiguration.cloudWatchLoggingConfiguration.encryptionKeyRef
Optional
object
Reference field for EncryptionKeyARN
monitoringConfiguration.cloudWatchLoggingConfiguration.encryptionKeyRef.from
Optional
object
AWSResourceReference provides all the values necessary to reference another
k8s resource for finding the identifier(Id/ARN/Name)
monitoringConfiguration.cloudWatchLoggingConfiguration.encryptionKeyRef.from.name
Optional
string
monitoringConfiguration.cloudWatchLoggingConfiguration.encryptionKeyRef.from.namespace
Optional
string
monitoringConfiguration.cloudWatchLoggingConfiguration.logGroupName
Optional
string
monitoringConfiguration.cloudWatchLoggingConfiguration.logStreamNamePrefix
Optional
string
monitoringConfiguration.cloudWatchLoggingConfiguration.logTypes
Optional
object
monitoringConfiguration.managedPersistenceMonitoringConfiguration
Optional
object
The managed log persistence configuration for a job run.
monitoringConfiguration.managedPersistenceMonitoringConfiguration.enabled
Optional
boolean
monitoringConfiguration.managedPersistenceMonitoringConfiguration.encryptionKeyARN
Optional
string
monitoringConfiguration.managedPersistenceMonitoringConfiguration.encryptionKeyRef
Optional
object
Reference field for EncryptionKeyARN
monitoringConfiguration.managedPersistenceMonitoringConfiguration.encryptionKeyRef.from
Optional
object
AWSResourceReference provides all the values necessary to reference another
k8s resource for finding the identifier(Id/ARN/Name)
monitoringConfiguration.managedPersistenceMonitoringConfiguration.encryptionKeyRef.from.name
Optional
string
monitoringConfiguration.managedPersistenceMonitoringConfiguration.encryptionKeyRef.from.namespace
Optional
string
monitoringConfiguration.prometheusMonitoringConfiguration
Optional
object
The monitoring configuration object you can configure to send metrics to
Amazon Managed Service for Prometheus for a job run.
monitoringConfiguration.prometheusMonitoringConfiguration.remoteWriteURL
Optional
string
monitoringConfiguration.s3MonitoringConfiguration
Optional
object
The Amazon S3 configuration for monitoring log publishing. You can configure
your jobs to send log information to Amazon S3.
monitoringConfiguration.s3MonitoringConfiguration.encryptionKeyARN
Optional
string
monitoringConfiguration.s3MonitoringConfiguration.encryptionKeyRef
Optional
object
Reference field for EncryptionKeyARN
monitoringConfiguration.s3MonitoringConfiguration.encryptionKeyRef.from
Optional
object
AWSResourceReference provides all the values necessary to reference another
k8s resource for finding the identifier(Id/ARN/Name)
monitoringConfiguration.s3MonitoringConfiguration.encryptionKeyRef.from.name
Optional
string
monitoringConfiguration.s3MonitoringConfiguration.encryptionKeyRef.from.namespace
Optional
string
monitoringConfiguration.s3MonitoringConfiguration.logURI
Optional
string
name
Optional
string
The name of the application.

Regex Pattern: ^[A-Za-z0-9._/#-]+$
networkConfiguration
Optional
object
The network configuration for customer VPC connectivity.
networkConfiguration.securityGroupIDs
Optional
array
networkConfiguration.securityGroupIDs.[]
Required
string
networkConfiguration.securityGroupRefs.[]
Required
object
AWSResourceReferenceWrapper provides a wrapper around *AWSResourceReference
type to provide more user friendly syntax for references using ‘from’ field
Ex:
APIIDRef:
from:
  name: my-api || **networkConfiguration.securityGroupRefs.[].from**<br/>Optional | **object**<br/>AWSResourceReference provides all the values necessary to reference another<br/>k8s resource for finding the identifier(Id/ARN/Name) |

| networkConfiguration.securityGroupRefs.[].from.name
Optional | string
| | networkConfiguration.securityGroupRefs.[].from.namespace
Optional | string
| | networkConfiguration.subnetIDs
Optional | array
| | networkConfiguration.subnetIDs.[]
Required | string
|| networkConfiguration.subnetRefs
Optional | array
Reference field for SubnetIDs | | networkConfiguration.subnetRefs.[]
Required | object
AWSResourceReferenceWrapper provides a wrapper around *AWSResourceReference type to provide more user friendly syntax for references using ‘from’ field Ex: APIIDRef:

from:
  name: my-api || **networkConfiguration.subnetRefs.[].from**<br/>Optional | **object**<br/>AWSResourceReference provides all the values necessary to reference another<br/>k8s resource for finding the identifier(Id/ARN/Name) |

| networkConfiguration.subnetRefs.[].from.name
Optional | string
| | networkConfiguration.subnetRefs.[].from.namespace
Optional | string
| | releaseLabel
Required | string
The Amazon EMR release associated with the application.

Regex Pattern: ^[A-Za-z0-9._/-]+$ | | runtimeConfiguration
Optional | array
The Configuration (https://docs.aws.amazon.com/emr-serverless/latest/APIReference/API_Configuration.html)
specifications to use when creating an application. Each configuration consists
of a classification and properties. This configuration is applied to all
the job runs submitted under the application. | | runtimeConfiguration.[]
Required | object
A configuration specification to be used when provisioning an application. A configuration consists of a classification, properties, and optional nested configurations. A classification refers to an application-specific configuration file. Properties are the settings you want to change in that file. || runtimeConfiguration.[].classification
Optional | string
| | runtimeConfiguration.[].properties
Optional | object
| | schedulerConfiguration
Optional | object
The scheduler configuration for batch and streaming jobs running on this
application. Supported with release labels emr-7.0.0 and above. | | schedulerConfiguration.maxConcurrentRuns
Optional | integer
| | schedulerConfiguration.queueTimeoutMinutes
Optional | integer
| | tags
Optional | object
The tags assigned to the application. | | type
Required | string
The type of application you want to start, such as Spark or Hive. | | workerTypeSpecifications
Optional | object
The specification applied to each worker type. |

Status

ackResourceMetadata: 
  arn: string
  ownerAccountID: string
  partition: string
  region: string
conditions:
- lastTransitionTime: string
  message: string
  reason: string
  status: string
  type: string
createdAt: string
id: string
identityCenterApplicationARN: string
resolvedImageDigest: string
state: string
stateDetails: string
updatedAt: string
FieldDescription
ackResourceMetadata
Optional
object
All CRs managed by ACK have a common Status.ACKResourceMetadata member
that is used to contain resource sync state, account ownership,
constructed ARN for the resource
ackResourceMetadata.arn
Optional
string
ARN is the Amazon Resource Name for the resource. This is a
globally-unique identifier and is set only by the ACK service controller
once the controller has orchestrated the creation of the resource OR
when it has verified that an “adopted” resource (a resource where the
ARN annotation was set by the Kubernetes user on the CR) exists and
matches the supplied CR’s Spec field values.
https://github.com/aws/aws-controllers-k8s/issues/270
ackResourceMetadata.ownerAccountID
Required
string
OwnerAccountID is the AWS Account ID of the account that owns the
backend AWS service API resource.
ackResourceMetadata.partition
Optional
string
Partition is the AWS partition in which the resource exists or will exist
ackResourceMetadata.region
Required
string
Region is the AWS region in which the resource exists or will exist.
conditions
Optional
array
All CRs managed by ACK have a common Status.Conditions member that
contains a collection of ackv1alpha1.Condition objects that describe
the various terminal states of the CR and its backend AWS service API
resource
conditions.[]
Required
object
Condition is the common struct used by all CRDs managed by ACK service
controllers to indicate terminal states of the CR and its backend AWS
service API resource
conditions.[].message
Optional
string
A human readable message indicating details about the transition.
conditions.[].reason
Optional
string
The reason for the condition’s last transition.
conditions.[].status
Optional
string
Status of the condition, one of True, False, Unknown.
conditions.[].type
Optional
string
Type is the type of the Condition
createdAt
Optional
string
The date and time when the application run was created.
id
Optional
string
The output contains the application ID.

Regex Pattern: ^[0-9a-z]+$
identityCenterApplicationARN
Optional
string
The ARN of the EMR Serverless created IAM Identity Center Application that
provides trusted-identity propagation.

Regex Pattern: ^arn:(aws[a-zA-Z0-9-]*):sso::\d{12}:application/(sso)?ins-[a-zA-Z0-9-.]{16}/apl-[a-zA-Z0-9]{16}$
resolvedImageDigest
Optional
string
The SHA256 digest of the image URI. This indicates which specific image the
application is configured for. The image digest doesn’t exist until an application
has started.

Regex Pattern: ^sha256:[0-9a-f]{64}$
state
Optional
string
The state of the application.
stateDetails
Optional
string
The state details of the application.

Regex Pattern: .*\S.*
updatedAt
Optional
string
The date and time when the application run was last updated.