Table of Contents What is Apache Kafka? Understanding Event data streams Structure of Apache Kafka Record Structure Topics and Partitions Cluster Brokers Producer — Consumer Topic Replication Zookeeper Conclusion What is an Apache Kafka? Apache Kafka is a distributed data streaming platform that can publish, subscribe to, store, and process streams of records in real-time. …

At Ideas2IT, we love getting our hands dirty to explore tech stacks and what we could do with them. Think of it as internal PoCs that we do all the time for fun! Very recently, we caught ourselves wondering if Paper.JS could be used for plotting graphs. …

Pre-Requisites Install NodeJS Install Visual Studio Code Step 1: Create a New Folder Navigate to desired drive on your computer and create a new folder for Playwright (ex: PlaywrightFramework). Step 2: Open the newly created folder in Visual Studio Code ID From Visual Studio Code, Navigate to File> Open > Choose the newly created folder (PlaywrightFramework). Step 3: Create a package.json file The package.json file helps to keep track of all node modules installed and…

What is a fillable PDF? Fillable PDF forms work the same as any other online form. You may enter information, select items from drop-down boxes, and also check fields as needed. …

Often AWS engineers find themselves in a situation where they need to achieve something, but AWS does not have the required feature. We recently found ourselves in one. We were already using a glue job to insert a large number of records in MongoDB. …

Introduction Spring Cloud Config is a feature provided by the Spring framework to maintain all the configurations of your Spring applications in a central place. It provides client and server-side support for an externalized configuration. We can store the configuration in Git version control or in the file system as well…

Exposed AWS Access keys are one of the very common use-cases that you will find across many organizations. There are certain steps that AWS recommends in such a scenario i) Determine the access associated with those keys ii) Invalidating the credentials iii) Invalidating any temporary credentials issued with the exposed keys iv) Restore the access with new credentials v) Review your…

With the recent release of the Java 17 LTS release, many new language features have been added to JDK. Let’s explore each of these new features in JDK17 in brief. Sealed Classes — JDK 17 JEP 409 Added as a preview in JDK16, sealed classes and interfaces restrict which other classes need to implement or extend them…

In today’s data-driven business landscape, unlocking insights from data is critical for an enterprise’s success. To achieve this, the data engineering team would need to allow data scientists, developers, project managers, and others to access datasets. These data sets are typically used to develop and train machine learning models, AI…