Automate MSK Topics to S3 Data Lake: New AWS Delivery Service

Automate AWS MSK Kafka topics from MSK into your S3 Data Lake. AWS announced a new managed delivery service from MSK to your S3 data lake on Oct. 27 2023. This new managed service can pull topics from Kafka and dump them into S3 buckets via Kinesis Firehouse. There are no additional pipes, functions or code required. (source) Are you tired of building pipes and serverless functions to move data around? AWS's new fully managed delivery stream will handle the pipes from your topics into your S3 data lake via Kinesis. You don't have to write and manage additional code. There are also no additional costs for this managed pipeline as it is built into the output of your MSK cluster. The new feature is designed to ease data flow from MSK to S3 Data Lake, leveraging Amazon Kinesis Data Firehose for the Extract, Transform, Load (ETL) tasks. This noteworthy…

read more

PHP & AWS S3: Store and Retrieve Data to the Cloud Tutorial

I love using S3 to help me scale any PHP application. I recommend switching to S3 to store and retrieve your data to the cloud as one of the first steps as you begin to scale your application. Check out this article as I help walk you through the entire process. Steps to Store and Retrieve Data to the Cloud in PHP with AWS S3 Create an Amazon Web Service Account (AWS). Create an S3 Bucket via IaaC, CLI, or PHP Install AWS SDK for PHP. Upload your data to S3 using the putObject function from the AWS SDK for PHP. List all the file contents of your S3 Bucket using the listObjects function from AWS SDK. Download your data from S3 using the getObject function from the PHP AWS SDK. Store and Retrieve Data to the Cloud Code Snippet Here are all the functions accumulated from this article for…

read more

Install the PHP AWS SDK Fast with Code Examples in 2023

How to Install AWS SDK for PHP The article demonstrates how to install AWS SDK for PHP. If you’re unfamiliar with AWS SDK, it is recommended to read the complete article. Here’s a breakdown of this walkthrough. Getting Started Install AWS SDK for PHP Setup Credentials for Authentication Basic Usage Getting Started | AWS SDK for PHP  AWS Software Development Kit (SDK) is an open-source library for PHP which helps integrate AWS into your PHP applications. You can programmatically access AWS services and resources using AWS SDK. The article is a walkthrough of installing AWS SDK for PHP Version 3. It is recommended to follow thoroughly.   Prerequisites AWS SDK for PHP Version 3 requires. PHP version 5.5.0 or later. SimpleXML PHP extension enabled. (Enabled by default) Note: Some Linux distributions don’t have the SimpleXML extension enabled by default. Run sudo apt-get install php-xml to get started. Recommendations In addition to…

read more