How Companies Are Saving Millions by Migrating Away from AWS to Bare Metal Servers?

Many startups initially launch on AWS or other public clouds because it allows rapid scaling without upfront investments. But as these companies grow, the operating costs steadily rise.

Migrating Away from AWS to Bare Metal Servers
Image is subject to copyright.

These two Companies OneUptime and Prerender are finding that migrating from Amazon Web Services (AWS) to bare metal servers hosted in colocation data centres can lead to substantial cost savings. They have cut costs by over 50% by taking control of their infrastructure while maintaining performance and reliability.

  • OneUptime was spending $456K+ annually on a 28-node AWS Kubernetes cluster.
  • Prerender projected over $1M per year on AWS services and data transfer.

πŸ“ˆ The Hidden Costs of Cloud

For many startups and tech companies, AWS seems like an easy choice. It allows you to spin up servers and scale rapidly without investing in your hardware upfront. But as these companies grow, the operating costs on AWS start to add up:

  • Monthly bills for instances, storage, data transfer, load balancing services, etc. can exceed $100,000+
  • Data transfer costs in particular can be astronomical - $0.08+/GB in some regions
  • No control over hardware - "noisy neighbour" problems can affect performance
  • Vendor lock-in reduces infrastructure flexibility

πŸ“Ÿ Why Does Bare Metal Make Sense?

Bare metal servers refer to physical servers that are dedicated to a single tenant. In contrast, virtual machines (VMs) are virtualized compute instances that run on shared hardware.

βž• Benefits of Bare Metal Servers

  • Cost - Bare metal eliminates the hidden fees and unpredictable billing associated with the cloud. You pay for the resources you use, with no additional charges for things like egress traffic or API calls.
  • Performance - Bare metal allows full access to resources for more consistent high workload performance like high I/O requirements
  • Control - Bare metal provides granular hardware control and customization
  • Isolation - Dedicated single-tenant resources, so no "noisy neighbour" problems
  • Scalability - VMs allow fast automated scaling, bare metal has more limited flexibility
System Pros Cons
Bare Metal
  • Maximum performance and consistency
  • High IOPS for intensive workloads
  • Hardware customization and control
  • Better security and isolation
  • Higher upfront costs
  • Manual server management
  • Limited flexibility for scaling
Virtual Machines
  • Rapid deployment and scaling
  • Pay only for resources used
  • Hardware abstraction and flexibility
  • "Noisy neighbour" performance issues
  • Limited performance and IOPS
  • Hardware abstraction overhead
Bare Metal vs Virtual Machines vs Containers: The Differences
When deploying a modern application stack, how do we decide which one to use? Bare Metal, VMs or Containers?

πŸ”œ Migration to Bare Metal Infrastructure

To slash costs, both companies planned and executed systematic migrations from AWS onto the bare metal servers in colocation facilities and both companies have direct access to hardware instead of virtualized instances.

🚴 OneUptime's Phased Migration

Prerender chose to use JavaScript everywhere to build expertise in solving the issues caused by JavaScript rendering. They also took advantage of CloudFlare’s distributed system for fast response and global scalability, while their uptime guarantees were supported by Digital Ocean’s cloud platform.

  1. Set up and tested MicroK8s Kubernetes on bare metal for a subset of traffic
  2. Gradually shifted more workloads onto new servers over weeks
  3. Carefully monitored performance and made adjustments
  4. Once stable, routed all traffic to the bare metal cluster
  5. Reduced annual costs by 55%+ (saving over $230,000 per year)

πŸͺœPrerender's Step-by-Step Process

  1. Provisioned bare metal servers and benchmarked performance
  2. Moved caching and storage services (S3) from AWS services
  3. Systematically redirected traffic and shut down AWS resources
  4. Continually stress-tested environment for robustness
  5. Cut monthly infrastructure costs by 80% (saving $800K+ per year)
πŸ’΅
Substantial cost savings resulted from careful migrations, as OneUptime achieved an annual cost reduction exceeding 55% (saving over $230K), while Prerender significantly reduced infrastructure costs by 80% (saving over $800K annually).
Top 50+ AWS Services That You Should Know in 2023
Amazon Web Services (AWS) started back in 2006 with just a few basic services. Since then, it has grown into a massive cloud computing platform with over 200 services.

πŸ‘¨πŸ»β€πŸ’» Which Technologies Have Been Used for the Migration from AWS Cloud to Bare Metal Servers?

Technologies like Kubernetes, Docker, Docker and Helm enabled frictionless migrations off AWS by providing:

  • Kubernetes - automated container deployment & scaling
  • Docker - portable, containerized applications
  • Helm - simplified Kubernetes application packaging

Together, these enabled flexibility beyond the public cloud vendors.

Kubernetes for Noobs
Kubernetes is an open-source system that helps with deploying, scaling, and managing containerized applications.

πŸ› οΈ So, What Are the Tradeoffs of Moving Away from the AWS or Public Cloud?

Managing your bare metal servers requires significant investments in skilled staff compared to leveraging AWS's services. Transitioning to bare metal means you now need specialized DevOps engineers to handle it.

  • Server provisioning, setup, and management
  • Network architecture and storage configuration
  • Containerization and orchestration
  • Migration execution and testing
  • Security hardening and access controls

This likely requires adding several additional experienced engineers with skillsets like Kubernetes, Docker, database admin, storage/SAN management etc.

At average salaries of $120-160K per engineer, those human resource costs add up rapidly. Plus server hardware expenses. Plus the loss of integrated AWS services like S3, Cognito, and many others accelerated development.

So you need to hire more backend developers to replicate all that useful functionality you're losing from the cloud provider. Adding 4-6 or more engineers can mean $500K+ in additional annual developer salaries.

In total, you might be spending an extra $2M+ per year in human resources to match what AWS provides out of the box. That's in addition to physical server costs in the range of $200K+.

So while bare metal hosting fees are lower, the human labor tradeoff is real. The efficiency and integrated services of the public cloud should not be discounted when comparing the total cost of ownership. Relying on AWS or any public cloud means less specialized in-house staff is needed. The male labour costs can rapidly diminish potential bare metal shavings.

DevOps vs SRE vs Platform Engineering - Explained
At small companies, engineers often wear multiple hats, juggling a mix of responsibilities. Large companies have specialized teams with clearly defined roles in DevOps, SRE, and Platform Engineering.

✴️ Takeaway β€” Re-evaluate Public Cloud Costs

For fast-scaling startups, public clouds can end up being far more expensive than bare metal hosting in the long term. The journeys of Prerender and OneUptime highlight how companies can realize major cost savings by moving off AWS onto their bare metal servers.

Their systematic and careful transitions to owned bare metal servers enabled over 50% expense reductions without performance sacrifices or major client impacts. This showcases that while AWS provides power and flexibility, it doesn't always fit every business' needs or long-term budgets. Their experiences prove that companies should continually reassess if public cloud services align with their changing business requirements over time.


In the last I want to ask you, Does managing your own infrastructure make sense from a technical and financial perspective? Why or why not?

Based on the Following Resources:

  1. How moving from AWS to Bare-Metal saved us $230,000 /yr
  2. How we reduced our annual server costs by 80% β€” from $1M to $200k β€” by moving away from AWS
  3. Shocking Cloud Costs: How AWS Charged $800,000 for Egress Data Transfer in a Single Month