Application
emrserverless.services.k8s.aws/v1alpha1
| Type | Link |
|---|---|
| GoDoc | emrserverless-controller/apis/v1alpha1#Application |
Metadata
| Property | Value |
|---|---|
| Scope | Namespaced |
| Kind | Application |
| ListKind | ApplicationList |
| Plural | applications |
| Singular | application |
Information about an application. Amazon EMR Serverless uses applications to run jobs.
Spec
architecture: string
autoStartConfiguration:
enabled: boolean
autoStopConfiguration:
enabled: boolean
idleTimeoutMinutes: integer
diskEncryptionConfiguration:
encryptionContext: {}
encryptionKeyARN: string
encryptionKeyRef:
from:
name: string
namespace: string
identityCenterConfiguration:
identityCenterInstanceARN: string
userBackgroundSessionsEnabled: boolean
imageConfiguration:
imageURI: string
initialCapacity: {}
interactiveConfiguration:
livyEndpointEnabled: boolean
studioEnabled: boolean
jobLevelCostAllocationConfiguration:
enabled: boolean
maximumCapacity:
cpu: string
disk: string
memory: string
monitoringConfiguration:
cloudWatchLoggingConfiguration:
enabled: boolean
encryptionKeyARN: string
encryptionKeyRef:
from:
name: string
namespace: string
logGroupName: string
logStreamNamePrefix: string
logTypes: {}
managedPersistenceMonitoringConfiguration:
enabled: boolean
encryptionKeyARN: string
encryptionKeyRef:
from:
name: string
namespace: string
prometheusMonitoringConfiguration:
remoteWriteURL: string
s3MonitoringConfiguration:
encryptionKeyARN: string
encryptionKeyRef:
from:
name: string
namespace: string
logURI: string
name: string
networkConfiguration:
securityGroupIDs:
- string
securityGroupRefs:
from:
name: string
namespace: string
subnetIDs:
- string
subnetRefs:
from:
name: string
namespace: string
releaseLabel: string
runtimeConfiguration:
- classification: string
properties: {}
schedulerConfiguration:
maxConcurrentRuns: integer
queueTimeoutMinutes: integer
tags: {}
type: string
workerTypeSpecifications: {}
| Field | Description |
|---|---|
| architecture Optional | string The CPU architecture of an application. |
| autoStartConfiguration Optional | object The configuration for an application to automatically start on job submission. |
| autoStartConfiguration.enabled Optional | boolean |
| autoStopConfiguration Optional | object The configuration for an application to automatically stop after a certain amount of time being idle. |
| autoStopConfiguration.enabled Optional | boolean |
| autoStopConfiguration.idleTimeoutMinutes Optional | integer |
| diskEncryptionConfiguration Optional | object The configuration object that allows encrypting local disks. |
| diskEncryptionConfiguration.encryptionContext Optional | object |
| diskEncryptionConfiguration.encryptionKeyARN Optional | string |
| diskEncryptionConfiguration.encryptionKeyRef Optional | object Reference field for EncryptionKeyARN |
| diskEncryptionConfiguration.encryptionKeyRef.from Optional | object AWSResourceReference provides all the values necessary to reference another k8s resource for finding the identifier(Id/ARN/Name) |
| diskEncryptionConfiguration.encryptionKeyRef.from.name Optional | string |
| diskEncryptionConfiguration.encryptionKeyRef.from.namespace Optional | string |
| identityCenterConfiguration Optional | object The IAM Identity Center Configuration accepts the Identity Center instance parameter required to enable trusted identity propagation. This configuration allows identity propagation between integrated services and the Identity Center instance. |
| identityCenterConfiguration.identityCenterInstanceARN Optional | string |
| identityCenterConfiguration.userBackgroundSessionsEnabled Optional | boolean |
| imageConfiguration Optional | object The image configuration for all worker types. You can either set this parameter or imageConfiguration for each worker type in workerTypeSpecifications. |
| imageConfiguration.imageURI Optional | string |
| initialCapacity Optional | object The capacity to initialize when the application is created. |
| interactiveConfiguration Optional | object The interactive configuration object that enables the interactive use cases to use when running an application. |
| interactiveConfiguration.livyEndpointEnabled Optional | boolean |
| interactiveConfiguration.studioEnabled Optional | boolean |
| jobLevelCostAllocationConfiguration Optional | object The configuration object that enables job level cost allocation. |
| jobLevelCostAllocationConfiguration.enabled Optional | boolean |
| maximumCapacity Optional | object The maximum capacity to allocate when the application is created. This is cumulative across all workers at any given point in time, not just when an application is created. No new resources will be created once any one of the defined limits is hit. |
| maximumCapacity.cpu Optional | string |
| maximumCapacity.disk Optional | string |
| maximumCapacity.memory Optional | string |
| monitoringConfiguration Optional | object The configuration setting for monitoring. |
| monitoringConfiguration.cloudWatchLoggingConfiguration Optional | object The Amazon CloudWatch configuration for monitoring logs. You can configure your jobs to send log information to CloudWatch. |
| monitoringConfiguration.cloudWatchLoggingConfiguration.enabled Optional | boolean |
| monitoringConfiguration.cloudWatchLoggingConfiguration.encryptionKeyARN Optional | string |
| monitoringConfiguration.cloudWatchLoggingConfiguration.encryptionKeyRef Optional | object Reference field for EncryptionKeyARN |
| monitoringConfiguration.cloudWatchLoggingConfiguration.encryptionKeyRef.from Optional | object AWSResourceReference provides all the values necessary to reference another k8s resource for finding the identifier(Id/ARN/Name) |
| monitoringConfiguration.cloudWatchLoggingConfiguration.encryptionKeyRef.from.name Optional | string |
| monitoringConfiguration.cloudWatchLoggingConfiguration.encryptionKeyRef.from.namespace Optional | string |
| monitoringConfiguration.cloudWatchLoggingConfiguration.logGroupName Optional | string |
| monitoringConfiguration.cloudWatchLoggingConfiguration.logStreamNamePrefix Optional | string |
| monitoringConfiguration.cloudWatchLoggingConfiguration.logTypes Optional | object |
| monitoringConfiguration.managedPersistenceMonitoringConfiguration Optional | object The managed log persistence configuration for a job run. |
| monitoringConfiguration.managedPersistenceMonitoringConfiguration.enabled Optional | boolean |
| monitoringConfiguration.managedPersistenceMonitoringConfiguration.encryptionKeyARN Optional | string |
| monitoringConfiguration.managedPersistenceMonitoringConfiguration.encryptionKeyRef Optional | object Reference field for EncryptionKeyARN |
| monitoringConfiguration.managedPersistenceMonitoringConfiguration.encryptionKeyRef.from Optional | object AWSResourceReference provides all the values necessary to reference another k8s resource for finding the identifier(Id/ARN/Name) |
| monitoringConfiguration.managedPersistenceMonitoringConfiguration.encryptionKeyRef.from.name Optional | string |
| monitoringConfiguration.managedPersistenceMonitoringConfiguration.encryptionKeyRef.from.namespace Optional | string |
| monitoringConfiguration.prometheusMonitoringConfiguration Optional | object The monitoring configuration object you can configure to send metrics to Amazon Managed Service for Prometheus for a job run. |
| monitoringConfiguration.prometheusMonitoringConfiguration.remoteWriteURL Optional | string |
| monitoringConfiguration.s3MonitoringConfiguration Optional | object The Amazon S3 configuration for monitoring log publishing. You can configure your jobs to send log information to Amazon S3. |
| monitoringConfiguration.s3MonitoringConfiguration.encryptionKeyARN Optional | string |
| monitoringConfiguration.s3MonitoringConfiguration.encryptionKeyRef Optional | object Reference field for EncryptionKeyARN |
| monitoringConfiguration.s3MonitoringConfiguration.encryptionKeyRef.from Optional | object AWSResourceReference provides all the values necessary to reference another k8s resource for finding the identifier(Id/ARN/Name) |
| monitoringConfiguration.s3MonitoringConfiguration.encryptionKeyRef.from.name Optional | string |
| monitoringConfiguration.s3MonitoringConfiguration.encryptionKeyRef.from.namespace Optional | string |
| monitoringConfiguration.s3MonitoringConfiguration.logURI Optional | string |
| name Optional | string The name of the application. Regex Pattern: ^[A-Za-z0-9._/#-]+$ |
| networkConfiguration Optional | object The network configuration for customer VPC connectivity. |
| networkConfiguration.securityGroupIDs Optional | array |
| networkConfiguration.securityGroupIDs.[] Required | string |
| networkConfiguration.securityGroupRefs.[] Required | object AWSResourceReferenceWrapper provides a wrapper around *AWSResourceReference |
| type to provide more user friendly syntax for references using ‘from’ field | |
| Ex: | |
| APIIDRef: |
from:
name: my-api || **networkConfiguration.securityGroupRefs.[].from**<br/>Optional | **object**<br/>AWSResourceReference provides all the values necessary to reference another<br/>k8s resource for finding the identifier(Id/ARN/Name) |
| networkConfiguration.securityGroupRefs.[].from.name
Optional | string
|
| networkConfiguration.securityGroupRefs.[].from.namespace
Optional | string
|
| networkConfiguration.subnetIDs
Optional | array
|
| networkConfiguration.subnetIDs.[]
Required | string
|| networkConfiguration.subnetRefs
Optional | array
Reference field for SubnetIDs |
| networkConfiguration.subnetRefs.[]
Required | object
AWSResourceReferenceWrapper provides a wrapper around *AWSResourceReference
type to provide more user friendly syntax for references using ‘from’ field
Ex:
APIIDRef:
from:
name: my-api || **networkConfiguration.subnetRefs.[].from**<br/>Optional | **object**<br/>AWSResourceReference provides all the values necessary to reference another<br/>k8s resource for finding the identifier(Id/ARN/Name) |
| networkConfiguration.subnetRefs.[].from.name
Optional | string
|
| networkConfiguration.subnetRefs.[].from.namespace
Optional | string
|
| releaseLabel
Required | string
The Amazon EMR release associated with the application.
Regex Pattern: ^[A-Za-z0-9._/-]+$ |
| runtimeConfiguration
Optional | array
The Configuration (https://docs.aws.amazon.com/emr-serverless/latest/APIReference/API_Configuration.html)
specifications to use when creating an application. Each configuration consists
of a classification and properties. This configuration is applied to all
the job runs submitted under the application. |
| runtimeConfiguration.[]
Required | object
A configuration specification to be used when provisioning an application.
A configuration consists of a classification, properties, and optional nested
configurations. A classification refers to an application-specific configuration
file. Properties are the settings you want to change in that file. || runtimeConfiguration.[].classification
Optional | string
|
| runtimeConfiguration.[].properties
Optional | object
|
| schedulerConfiguration
Optional | object
The scheduler configuration for batch and streaming jobs running on this
application. Supported with release labels emr-7.0.0 and above. |
| schedulerConfiguration.maxConcurrentRuns
Optional | integer
|
| schedulerConfiguration.queueTimeoutMinutes
Optional | integer
|
| tags
Optional | object
The tags assigned to the application. |
| type
Required | string
The type of application you want to start, such as Spark or Hive. |
| workerTypeSpecifications
Optional | object
The specification applied to each worker type. |
Status
ackResourceMetadata:
arn: string
ownerAccountID: string
partition: string
region: string
conditions:
- lastTransitionTime: string
message: string
reason: string
status: string
type: string
createdAt: string
id: string
identityCenterApplicationARN: string
resolvedImageDigest: string
state: string
stateDetails: string
updatedAt: string
| Field | Description |
|---|---|
| ackResourceMetadata Optional | object All CRs managed by ACK have a common Status.ACKResourceMetadata memberthat is used to contain resource sync state, account ownership, constructed ARN for the resource |
| ackResourceMetadata.arn Optional | string ARN is the Amazon Resource Name for the resource. This is a globally-unique identifier and is set only by the ACK service controller once the controller has orchestrated the creation of the resource OR when it has verified that an “adopted” resource (a resource where the ARN annotation was set by the Kubernetes user on the CR) exists and matches the supplied CR’s Spec field values. https://github.com/aws/aws-controllers-k8s/issues/270 |
| ackResourceMetadata.ownerAccountID Required | string OwnerAccountID is the AWS Account ID of the account that owns the backend AWS service API resource. |
| ackResourceMetadata.partition Optional | string Partition is the AWS partition in which the resource exists or will exist |
| ackResourceMetadata.region Required | string Region is the AWS region in which the resource exists or will exist. |
| conditions Optional | array All CRs managed by ACK have a common Status.Conditions member thatcontains a collection of ackv1alpha1.Condition objects that describethe various terminal states of the CR and its backend AWS service API resource |
| conditions.[] Required | object Condition is the common struct used by all CRDs managed by ACK service |
| controllers to indicate terminal states of the CR and its backend AWS | |
| service API resource | |
| conditions.[].message Optional | string A human readable message indicating details about the transition. |
| conditions.[].reason Optional | string The reason for the condition’s last transition. |
| conditions.[].status Optional | string Status of the condition, one of True, False, Unknown. |
| conditions.[].type Optional | string Type is the type of the Condition |
| createdAt Optional | string The date and time when the application run was created. |
| id Optional | string The output contains the application ID. Regex Pattern: ^[0-9a-z]+$ |
| identityCenterApplicationARN Optional | string The ARN of the EMR Serverless created IAM Identity Center Application that provides trusted-identity propagation. Regex Pattern: ^arn:(aws[a-zA-Z0-9-]*):sso::\d{12}:application/(sso)?ins-[a-zA-Z0-9-.]{16}/apl-[a-zA-Z0-9]{16}$ |
| resolvedImageDigest Optional | string The SHA256 digest of the image URI. This indicates which specific image the application is configured for. The image digest doesn’t exist until an application has started. Regex Pattern: ^sha256:[0-9a-f]{64}$ |
| state Optional | string The state of the application. |
| stateDetails Optional | string The state details of the application. Regex Pattern: .*\S.* |
| updatedAt Optional | string The date and time when the application run was last updated. |