<p>These are presumably proprietary tools for EC2 and GCE respectively. The need for predictive VM autoscaling is pretty strong for Virtual Machines since provisioning time can be measured in the 10's of minutes depending on the configuration.</p>
<p>Conversely, application spin-up time in Kubernetes is typically measured in seconds. Predictive scaling for the Kubernetes HPA might have limited practical benefit.</p>
<p>Now using cloud provider predictive autoscaling to scale out the VMs running a Kubernetes cluster based upon ML could be pretty interesting.</p>

CC BY-SA 4.0
2021-05-26T06:55:26.777Z
But is it possible to have VMs scale on a K8s? How does the prediction of load work in the AWS & GCP?
Hubert Bratek
CC BY-SA 4.0
2021-06-01T02:08:04.923Z
@Ajris https://github.com/kubernetes/autoscaler. That scales out VMs in the cluster, however there's no prediction for the standard cluster autoscaler.
Jon W
CC BY-SA 4.0
2021-06-05T16:52:53.093Z
But it is no prediction based using any ML techniques. It's just pure verifying whether the threshold has been reached.
Hubert Bratek
CC BY-SA 4.0
2021-06-28T17:14:46.403Z
Yep that's correct
Jon W
CC BY-SA 4.0
2021-05-26T01:55:56.943Z
2021-05-26T01:55:56.943Z
Jon W
<p>I am learning about using Machine Learning for provisioning proactive resources on the Kubernetes and I have found some of the interesting articles about it on the internet(for instance for Thoth or Microscaler). I have also read about predictive autoscaling in AWS and GCP however only for VM's, not to use in the K8s clusters.</p>
<p><a href="https://docs.aws.amazon.com/autoscaling/plans/userguide/how-it-works.html" rel="nofollow noreferrer">https://docs.aws.amazon.com/autoscaling/plans/userguide/how-it-works.html</a>
<a href="https://cloud.google.com/compute/docs/autoscaler/predictive-autoscaling#how_predictive_autoscaling_works" rel="nofollow noreferrer">https://cloud.google.com/compute/docs/autoscaler/predictive-autoscaling#how_predictive_autoscaling_works</a></p>
<p>However I would like to understand more in-depth about the above solutions - how do they work internally and what is the possibility of moving that solutions to the K8s. Do You know where can I find informations about it? Or if that is even possible to find those information or they are hidden internally in those companies? Do You have any other scientific articles or solutions which are now available?</p>
<p>Thanks</p>

<kubernetes><amazon-web-services><gcp>
Predictive autoscaling on K8s
Hubert Bratek
# Predictive autoscaling on K8s

(Asked by: username_0 on 2021-05-23)

I am learning about using Machine Learning for provisioning proactive resources on the Kubernetes and I have found some of the interesting articles about it on the internet(for instance for Thoth or Microscaler). I have also read about predictive autoscaling in AWS and GCP however only for VM's, not to use in the K8s clusters.

<https://docs.aws.amazon.com/autoscaling/plans/userguide/how-it-works.html>
<https://cloud.google.com/compute/docs/autoscaler/predictive-autoscaling#how_predictive_autoscaling_works>

However I would like to understand more in-depth about the above solutions - how do they work internally and what is the possibility of moving that solutions to the K8s. Do You know where can I find informations about it? Or if that is even possible to find those information or they are hidden internally in those companies? Do You have any other scientific articles or solutions which are now available?

Thanks

**Tags:** kubernetes, amazon-web-services, gcp


---

## 1 answers

### Answer by username_1 on 2021-05-26. Score: 1

These are presumably proprietary tools for EC2 and GCE respectively. The need for predictive VM autoscaling is pretty strong for Virtual Machines since provisioning time can be measured in the 10's of minutes depending on the configuration.

Conversely, application spin-up time in Kubernetes is typically measured in seconds. Predictive scaling for the Kubernetes HPA might have limited practical benefit.

Now using cloud provider predictive autoscaling to scale out the VMs running a Kubernetes cluster based upon ML could be pretty interesting.

> **Comments:**
> **username_0**: But is it possible to have VMs scale on a K8s? How does the prediction of load work in the AWS & GCP?  
> **username_1**: @Ajris https://github.com/kubernetes/autoscaler. That scales out VMs in the cluster, however there's no prediction for the standard cluster autoscaler.  
> **username_0**: But it is no prediction based using any ML techniques. It's just pure verifying whether the threshold has been reached.  
> **username_1**: Yep that's correct  

---

