Tuesday, September 29, 2020
From AWS to Google Cloud, the major cloud providers offer different options to run a relational database on the cloud. You can spin up virtual machines and configure your own cluster or rely on managed services. But the new trend is serverless (relational) databases that offer both traditional interfaces and HTTP API access.
This talk is personal journey on AWS moving from a managed MySQL to a serverless Aurora. Can serverless really be the future for the enterprise databases?
Event Driven paradigm is one of the most popular micro services architecture. Many enterprises are levering this architecture in their digital journeys. With the promise to make enterprises more reactive to changing business needs. As part of this talk, I will talk about my experience of building enterprise event driven systems and at the same time elaborating the fallacies of building and adopting such systems.
Serverless - Devs love it as it enables them to move much faster, but Ops tend to be suspicious towards it as it entails “loss of control” over your infrastructure. When making the DevOps transformation, these worlds seem to collide. But serverless is actually a great fit with the DevOps culture, and it can even help you make the transformation.
As Intuit moves to a cloud hosting architecture that includes containers, and serverless applications, the company is on an “observability” journey to transform the way it monitors its applications' health. Observability requires correlating logs, metrics, distributed traces, etc., which becomes complex as systems become more distributed. In this session, the company discusses leveraging tools such as OpenTelemetry instrumentation , collectors pipeline, scaling Amazon Elasticsearch Service (Amazon ES), Amazon Kinesis, and Jaeger to build an observability solution, and the benefits this solution provides by giving visibility across the platform, from containers to serverless applications. We will also discuss how Intuit sees observability evolving in coming years.
Serverless has been widely accepted as a mechanism to deploy and run software easily. However, the cost of running production scale workloads on Serverless can be surprisingly high. Wouldn't it be great if we could get the benefits of running workloads on serverless without the hassle of worrying about costs ?
Enter Knative, an open standard allowing you to run serverless workloads on your own Kubernetes clusters. In this talk, we will walk through a real world example of how we used Google CloudFunctions (FaaS) at WP Engine to deploy a serverless data pipeline, and then transitioned that workload to using Cloud Run (built upon Knative) and Kubernetes to achieve the same results at a greatly reduced cost. We will dive deep into how we achieved the cost savings, handling fault tolerance, concurrency and auto-scaling
Now our developers can focus on code instead of the plumbing of managing infrastructure, while delivering customer and business value quickly and easily.