Continuous Efficiency FAQs

Updated 6 days ago by Archana Singh

This article addresses some frequently asked questions about Harness Continuous Efficiency (CE).

Setup

AWS

What types of access do you need for my AWS master account? 
  • CE doesn't need access to your master account. CE only needs access to the cost and usage report (CUR) stored in your S3 bucket in the master/payer account.
    • If you don't have access to your master account to create a CUR in the S3 bucket, contact your IT or security teams to get the required permissions. In doing so, we get read-only access to the cost data along with a list of all the member (or linked) accounts. CE does not get access to any other privileges. 
    • If you have a consolidated billing setup, this is the only way for CE to get access to your billing data.
  • If you would like to limit access to specific accounts from a cost visibility standpoint, you can deselect specific member accounts (or whitelist linked/member accounts). Contact the Harness Support team to whitelist or blacklist the accounts for which you want to limit visibility. This functionality will be available via UI soon.
  • See Connect to Your AWS Master Account.
Can I provide you access to a CUR report in my linked account instead? 

CUR report has data for all the linked accounts. It is a limitation on the AWS side to selectively whitelist/blacklist accounts in the report. 

What types of access do you get to my accounts? 

CE gets read-only access to the cost data along with a list of all the member (or linked) accounts. CE does not get access to any other privileges. 

Can I restrict access to specific accounts? 

S3 Bucket and CUR report need to be set up in the master payer account. Accounts can be selectively whitelisted/blacklisted from Harness' side. Please contact Harness with the list of accounts you would like to limit visibility to. This functionality will be available via UI soon.

Do you import the data into your account? 

The CUR reports are imported into our account. CE stores them securely with read-only access. 

Do I need a Harness Delegate to get started with AWS? 

No. You need Harness Delegate only when connecting to a Kubernetes cluster, such as an EKS cluster.

GCP

Do you import the data into your BigQuery account? 

Yes. 

What is the typical hierarchy of GCP cost organizations?

Do I need a Harness Delegate to get started connecting to GCP? 

No. You need Harness Delegate only when connecting to a Kubernetes cluster, such as GKE.

Kubernetes

Do I need a Harness Delegate to get started with the Kubernetes cluster? 

Yes. Delegate is necessary for the Kubernetes cluster.

You can choose to use a single Delegate for accessing multiple Kubernetes clusters. See Enable Continuous Efficiency.

What prerequisites do I need to be aware of? I understand these are part of the installation checks you make, but I’d like to be prepared before I begin.

Check if you have installed the Kubernetes Metrics Server and provided permissions to the Delegate to access your cluster.

Do I need to ensure the Metrics Server is installed for EKS? 

Yes. Metrics Server is installed by default on GKE and AKS clusters. 

Do I need 8GB of memory for my Delegate? Can I do it with 3GB? 

You could do with 3GB if you intend to use the Delegate just for CE. 

Status

How frequently do you process cost data for the Kubernetes cluster, AWS, and GCP?
How long do I need to wait before data appears for the Kubernetes cluster?

It would take between 2-3 hours.

How long do I need to wait before data appears for AWS? Why?

AWS billing data is synced once every 24 hours. You will see up to 24 hours delay for data to show up for AWS.

How long do I need to wait before data appears for GCP? Why?

GCP billing data is synced once every 24 hours. You will see up to 24 hours delay for data to show up for GCP.

How often is data processed overall in CE? 
  • For clusters, billing data is generated hourly.
  • Recommendations are generated daily.
  • For AWS and GCP, data is synced daily.
Why can’t I see my data in the past 2 hours? 

Kubernetes events are collected continuously. The jobs to convert these events to cost data run every hour with 1-hour latency.

Why is my cluster data showing events last collected since <x days/hours> ago? 

Delegates running in Kubernetes clusters are regularly sending us cluster events as they happen. This message indicates the last time an event is received from the cluster. This is useful for health information. An event in the last 20 minutes indicates a healthy state.

Efficiency Score 

Is the efficiency score configurable? Why not?

Efficiency score is not configurable at the moment. The efficiency score objectively represents how well your cluster resources are utilized.

5% buffer of the total cost is allowed while computing the unallocated resources and 30% for idle resources. A baseline of 65% is defined for utilized resources. So your utilization need not be at the capacity to get a perfect score. See Efficiency Score.

Does the efficiency score take into account overall cloud costs? How is it computed?

It takes only the cluster resources into account and not the overall cloud costs. Efficiency score is derived from the total and idle (and or unallocated) spend of your resources. 

Idle Cost

What specific actions can I take to bring my idle costs down? 

Idle costs are when pods are utilizing more resources than they actually need.

  1. Identify the namespaces/workloads having higher idle costs.
  2. Drill down into their usage.
  3. Optimize Kubernetes cluster costs with resource recommendations.

Unallocated Cost

What specific actions can I take to bring my unallocated costs down? 

Unallocated costs are when a Kubernetes cluster has excessive resources allocated than needed by the workloads.

  1. Check if cluster autoscaler is enabled. If not, please talk to Harness and enable it.
  2. If autoscaler is enabled on GKE it can be tweaked to scale down.
  3. Look into unallocated costs by nodes. See if there are nodes that are disproportionately bigger and causing most of the unallocated cost and can be downsized.

Recommendations

Are the recommendations configurable? 

Currently, not. Harness is working on providing this functionality.

How do the recommendations compare to Vertical Pod Autoscaler (VPA)?

The algorithm is similar. Both should provide similar recommendations as of now. This might change in the future as the recommendations algorithm is modified based on the learnings.

What are the key differences between burstable and guaranteed? When do I need to apply which? 

The key difference between the burstable and guaranteed recommendations is in the tradeoff between predictable performance and cost. If you choose a burstable recommendation, more pods can fit on the same node so there is a cost-saving. But if there is any resource pressure on the underlying node, there will be throttling or eviction to free up resources. If you need more predictable performance, use guaranteed recommendations. See Optimize Kubernetes Cluster Costs With Resource Recommendations.

Can you automate how it is applied? 

Currently, it cannot be automated.

Seasonality is not taken into account in recommendations.

What about Horizontal Pod Autoscaler (HPA)?

HPA on CPU/memory is not recommended along with workload recommendations. HPA on other custom metrics is ok.

Cost Events

What types of events does CE handle today? 
  • Changes to well-known Kubernetes workload types:
    • Deployment
    • StatefulSet
    • DaemonSet
    • CronJob
    • Job
    • ReplicaSet
  • Service deployments that were triggered through Harness.
How are these relevant to help me cut costs? 

Every event is associated with an estimated cost change. By correlating the cost trend graph with the events that occurred at the same time, it can be deduced what events might have contributed to a particular change in cost trend. See Perform Root Cost Analysis.

Node Optimization

How can I optimize my nodes based on the information I get from CE?

You can check the unallocated costs for a cluster. If the number is very high, you may consider reducing the size of the cluster. See Root Cost Analysis for Nodes.

Do I get a spot or on-demand recommendations today? 

Not at the moment. They are available out-of-the-box (OOTB) for free from the AWS cost explorer.

Non-cluster

AWS

Does CE tie cost data back into the savings plan in AWS? 

No.

Does CE tie cost data to make Reserved Instance (RI) recommendations?

No. They are available OOTB for free from the AWS cost explorer. 

Does CE take into account my RI purchases and discounts? 

Yes, the data from your CUR is read which is the source of truth on how you are billed monthly. 

GCP

Does CE take into account Committed Usage Discounts (CUDs), Sustained Use Discounts (SUDs)?

Yes. Once you connect your GCP account, the data is read from your GCP billing API and the discounts are also applied as per your eligibility. The true costs with the discounts can be viewed on the Cost Explorer page. See Analyze Discounts.

Does CE take into account custom discounts or rewards? 

Yes, if they are part of your billing. 

What about some services I purchased via the marketplace? 

They show up in the Cost Explorer.

Reporting/Scheduling and Cost Governance

Do you support custom reporting to our finance teams? 

Yes. You can get a weekly report or subscribe to your finance team or any member in your organization to get a cost report. See Manage CE Communication Strategy.

Do you support custom dashboard creation? What if I want to share configurable dashboards on a scheduled basis to my business users? 

Yes, you can use Views to create your own customized explorer view. See Custom Views. You can add a report sharing schedule to share the custom view with your business users. See Add a Report Sharing Schedule.

On-premise and Other Clouds

Does CE support on-prem workloads? What about the other types of infra? OpenShift, VMware, etc.?

CE supports:

  • OpenShift on AWS and GCP
  • KOPS-managed clusters 
  • On-prem Kubernetes clusters with custom pricing (manual input) and
  • Rancher with custom pricing

See CE Coverage and Supported Kubernetes Management Platform.

Can I manually enter cost data or upload a rate card?

Yes, but please reach out to Harness as this requires a back-end manual entry. This functionality will be available via UI shortly.

What about other clouds? IBM, Oracle, etc.? Do you support the Kubernetes cluster running on these clouds?

Kubernetes cluster running on infrastructure outside of AWS, GCP, or Azure is not supported.

APIs

Can we export CE data? 

Data can be exported via Graph QL APIs. You can export data using these APIs and combine them with other financial reporting data. See Use Cost Explorer APIs.

General

What is the typical hierarchy of AWS/GCP/Azure?

AWS

GCP

Azure

Hierarchy

Linked Accounts

Folders/Projects

Subscriptions

Key/ Value Pairs

Tags

Labels

Tags

Tags Applied

Most services resources and accounts

Most services resources and projects

Most services resources and Azure resource groups


How did we do?