PinnedJohn CherianWhat version of Apache Spark would you like to use on AWS?In terms on easy to work and granular control with then it follows the sequence Amazon EMR on EKS, EMR on EC2 , EMR serverless and then…3 min read·Sep 7, 2022----
John CherianAmazon Bedrock learning seriesAre you ready to dive into the world of Generative AI and transform your career? With the evolving landscape of technology, the demand for…3 min read·Jan 4, 2024----
John CherianAmazon Bedrock: The AWS Lambda of the Generative AI WorldAmazon Bedrock emerges as a fully managed service, designed to simplify the development and deployment of generative AI applications…2 min read·Oct 10, 2023----
John CherianHosting GPTJ-6B on AWS SageMaker: Unleashing the Power of Large Language ModelsIntroduction4 min read·May 10, 2023----
John CherianSpark Runtime for AWS Lambda“Outpacing Spark with Pen and Paper: A Data Processing Dilemma." Have you heard customers claim that manually inserting 10 rows of data is…6 min read·Apr 4, 2023----
John CherianPerformance Benchmarking for Pandas On AWS lambda for CSV filesIn this blog, we want to explore the data size limit for CSV format files on AWS S3 for the combination of AWS Wrangler and Pandas on AWS…4 min read·Apr 27, 2022----
John CherianRunning data processing containers on AWS LambdaAWS Lambda supports Docker Container as a Function(CaaF). This adds other dimensions to AWS Lambda, portability ,dependency handling and…4 min read·Apr 15, 2022----
John CherianAWS SAM(Serverless Application Model)is an open source framework that enables AWS users to build…It provides an environment where you can test AWS Lambda locally and fix bugs, saving cost and time. It integrates well with AWS Code…5 min read·Apr 13, 2022----
John CherianFaster Java UDF in PysparkUsing UDFs(User Defined Functions) in spark is probably the last resort for build column based data processing logic on spark. The Spark…4 min read·Feb 11, 2022----
John CherianComparing SerDe Modules in PythonSerDe(serialization and deserialization) is a process in the programming world where convert object into byte stream format, so that…3 min read·Nov 11, 2021----