Shows / AWS Big Data Blog
Episodes
- AWS Big Data Blog
How Alight Solutions achieved 55% cost savings with Amazon OpenSearch Service
In this post, we share how Alight Solutions migrated from self-managed Elasticsearch to Amazon OpenSearch Service. The migration achieved a 55% cost reduction…
- AWS Big Data Blog
Govern Amazon Redshift Data Warehouses Data Across Accounts using Amazon SageMaker Unified Studio
In this post, we show you how to use Amazon SageMaker Unified Studio to implement cross-account data sharing in Amazon Redshift using data mesh principles. We…
- AWS Big Data Blog
Migrate from Apache Solr to Amazon OpenSearch Serverless
In this post, you will learn why now is the time to take advantage of the ease of operations and native AI capabilities of OpenSearch Serverless, and migrate…
- AWS Big Data Blog
High-performance Remote Shuffle Service on Amazon EMR with Apache Celeborn
In this post, we show how Apache Celeborn resolves this trade-off for Amazon EMR on EKS and Amazon EMR on EC2, improving job reliability while unlocking…
- AWS Big Data Blog
Zero Copy access to Apache Iceberg tables in Amazon S3 from Salesforce Data 360 using the Iceberg REST endpoint from AWS Glue Data Catalog
In this post, we demonstrate how AWS and Salesforce customers can access their enterprise data lakes on AWS from Salesforce Data 360 using zero-copy file…
- AWS Big Data Blog
Patch perfect: Automating Amazon Redshift patch testing
In this post, we demonstrate an automated test suite that validates your Amazon Redshift cluster automatically after any patch, reboot, or modification. It…
- AWS Big Data Blog
Multi-cloud lakehouse architecture on AWS for Agentic AI, Part 1: Architecture and best practices
This post focuses on explaining the architecture approach to build the open lakehouse architecture on AWS, unifying the metadata catalog across providers for…
- AWS Big Data Blog
How Razorpay Built Real-Time Anomaly Detection with Amazon MSK
In this post, we explore Razorpay’s anomaly detection and alerting platform (ADA) architecture using Amazon Managed Streaming for Apache Kafka (Amazon MSK) and…
- AWS Big Data Blog
Cut costs and simplify operations with writable warm storage in Amazon OpenSearch Service
In this post, I show you how writable warm storage removes the costly migration cycle. You can reduce your infrastructure costs by up to 48 percent and update…
- AWS Big Data Blog
Introducing Apache Spark Connect support in AWS Glue interactive sessions
Apache Spark Connect bridges the gap between these two worlds: you develop in local Python, but execute on AWS Glue against actual data. Today, AWS Glue…
- AWS Big Data Blog
How BigBasket uses the Iceberg based lakehouse architecture on AWS to power lightning-fast grocery delivery across India
In this post, we demonstrate how BigBasket implemented the lakehouse architecture on AWS, including their architecture decisions, implementation approach, and…
- AWS Big Data Blog
Accelerating log analytics at scale with AWS Glue and Apache Iceberg materialized views
In this post, you learn how to build an application log pipeline for production use with Amazon CloudWatch Logs, AWS Lambda, Amazon Data Firehose, AWS Glue…
- AWS Big Data Blog
Serverless analytics pipelines using the Apache Spark engine in Amazon Athena
This post shows how developers, data engineers, and analysts can connect to a secure Spark Connect endpoint in Athena with Apache Spark. You can use your…
- AWS Big Data Blog
Deploy modern data platforms in minutes with MDAA
In this post, we explore how MDAA transforms data architecture development from months of manual coding to production-ready deployment through…
- AWS Big Data Blog
Amazon Redshift RG: Faster and lower cost, Graviton-powered
In this post, we describe the innovations that make RG instances so much faster. We also share benchmark results showing that RG delivers up to 4.2x better…
- AWS Big Data Blog
Run log analytics for a fraction of the cost with the new engine for Amazon OpenSearch Service
We’re introducing a purpose-built log analytics engine for Amazon OpenSearch Service. This new engine delivers up to 4x price performance, 2x faster data…
- AWS Big Data Blog
AI-powered performance recommendations for Amazon Redshift
In this post, you learn how to build an AI-powered solution that collects the telemetry, pre-computes performance signals, correlates them with CloudWatch, and…
- AWS Big Data Blog
Scale analytics with Amazon Redshift multi-warehouse enhancements
In this post, we introduce new capabilities of Amazon Redshift that enhance our multi-warehouse and scaling capabilities: remote materialized view (MV)…
- AWS Big Data Blog
Amazon Redshift delivers faster performance for BI dashboards and real-time analytics
Today, we’re excited to announce a new performance optimization in Amazon Redshift that improves the response times of low-latency SQL queries, such as those…
- AWS Big Data Blog
Optimize your Tableau integration with Amazon Redshift Serverless
In this post, we provide a guide to help you use Tableau’s Relationships and Amazon Redshift Serverless architecture to deliver sub-second insights while…
- AWS Big Data Blog
Implement multi-tenant search with Amazon OpenSearch Serverless next generation
In this post, we show how the next-generation OpenSearch Serverless architecture makes the collection-per-tenant model practical for multi-tenant search.
- AWS Big Data Blog
Multi-Region identity-based access to Amazon Redshift and S3 Tables
In Part 1 of this series, we showed how to simplify enterprise data access using the Amazon Redshift integration with Amazon S3 Access Grants. In this post, we…