AWS | GCP | Data Engineer | Solutions Architect.
AWS – Difference between Containers (Kubernetes) and Serverless (Lambda) Comparisons: Serverless vs Containers (Lambda vs Kubernetes). How to choose? Serverless and containers have some high-level similarities. They eliminate complexity and make it easier to deploy and scale applications. Serverless works well if you need to perform relatively simple processing of events without maintaining underlying infrastructure.… Continue reading
How to import .backpac file in AWS RDS MSSQL To import .backpac file into AWS RDS we need to convert bacpac file to .bak file, Please follow below steps to convert .backpac to .bak Step 1- Converting bacpac file to .bak file Create an EC2 instance with SQL Server or if you already have an… Continue reading
How to Schedule AWS Lambda functions using EventBridge There are multiple rules from which you can choose to run AWS Lambda function on a schedule. This tutorial will help you in creating the rule with the help of AWS management console or the AWS CLI. You must install the AWS CLI on your system before… Continue reading
Roles & Responsibilities of Data Engineer In recent years, data management has gained recognition as a field that has undergone a paradigm shift. Data engineers lay the foundation for a database and its architecture. A focus had previously been on retrieving useful insights, but management has gained traction as a result. A robust architecture is… Continue reading
Top 3 Cloud Databases You Must Aware Data storage and computing time are commodified by cloud computing using standardized technologies, which makes cloud databases possible on cloud computing platforms like Salesforce, GoGrid, Rackspace, and Amazon EC2. It is possible to run cloud databases independently via virtual-machine images or through cloud database providers’ services – either… Continue reading
Top 10 Non SQL Database It is a non-tabular database that collects data differently than relational tables and is not SQL. NoSQL databases will be the most popular in 2022. As opposed to relational databases, these databases don’t require fixed set columns in tables, horizontal support scaling, and do not use JOINS. There are a… Continue reading
Top 10 Must Have Skills for a Data Engineer Data is transforming the way businesses are optimized. The management of data has become increasingly important over the past few decades. As long as the data is high quality and competent to perform complicated tasks, organizations can reap innumerable benefits. Extracting such huge quantities of data,… Continue reading
Top 3 Spoofing Software’s | Ethical Hacking Spoofing is a broad word for when a cyber-criminal poses as a trustworthy entity or device to trick you into doing something that benefits the hacker but is harmful to you. Spoofing occurs when an internet scammer assumes another person’s identity. Spoofing can be used on various communication… Continue reading
The top 3 javaScript frameworks JavaScript is one of the oldest programming languages, created in 1995. Despite this, it continues to be one of the most popular, competing with Python and C for the title of “most in-demand programming language.” The ubiquity of JavaScript explains its continued dominance in space. Most browsers support it, making… Continue reading
Top AWS services a data engineer should know. AWS, or Amazon Web Services, is a cloud service provider that provides on-demand cloud services to businesses and people. An Amazon division offers infrastructure, hardware, and distributed computing services. Infrastructure as a Service (IaaS), Platform as a Service (PaaS), Software as a Service (SaaS), and other enterprise-level… Continue reading
Top 5 Relational Databases Relational databases use a classic table format to store and manage data, with each piece of information grouped into a row and a column. Columns store a single kind or field data, such as a first name, an order number, or a product logo image link. Rows create the link between… Continue reading
Top 5 AWS Serverless services for Data Engineering From the well-known Elastic Compute Cloud (EC2) and Simple Storage Service (S3) to platform as a service (PaaS) offerings encompassing practically every facet of modern computing, Amazon Web Services (AWS) offers a bewildering number of cloud services. AWS’ sophisticated significant data architecture includes services that cover the… Continue reading
What is AWS Command Line Interface (AWS CLI) and How to install AWS CLI AWS Command Line Interface (AWS CLI) is a command-line tool that allows you to interact with AWS services from a script in your command-line shell. By simply configuring the AWS CLI, it enables you to run commands from your terminal program… Continue reading
How to Install AWS IAM Authenticator on Windows/Linux/MacOs The AWS IAM Authenticator for Kubernetes employed by Amazon EKS makes use of IAM to provide authentication to your Kubernetes cluster. Installing the AWS IAM Authenticator for Kubernetes and modifying kubectl’s configuration files to use it for authentication will allow you to configure the standard kubectl client… Continue reading
How to install eksctl on Windows/Linux/MacOS eksctl is a simple command-line utility that assists with the creation and management of Kubernetes clusters on Amazon EKS. It’s the fastest and most convenient method of creating a new cluster with nodes for Amazon EKS. For more information, please see https://eksctl.io/. The information in this topic provides instructions… Continue reading
How To create a Fargate profile into EKS The process for creating a Fargate account is as follows: You first need to create an IAM role and attach the required Amazon EKS IAM managed policy to this role. You need to call AWS APIs on your behalf when your cluster creates pods on Fargate infrastructure.… Continue reading
How to set up EKS Cluster from AWS Management Console Using the AWS Management Console and the AWS CLI, this tutorial shows you how to create all resources needed to get started with Amazon Elastic Kubernetes Service (Amazon EKS). All resources are created manually. You will be able to deploy applications to a running Amazon… Continue reading
How to Set up AWS CLI path on MacOS/Linux/Windows Operating system You should find that the AWS program is already present in your operating system’s PATH environment variable once you have installed the AWS CLI. You may not be able to add the AWS program if you installed it in a custom location or if… Continue reading
How do I use Kubernetes in Amazon Web Services(AWS)? It uses Amazon’s Elastic Kubernetes Service (Amazon EKS), which allows you to run Kubernetes on Amazon Web Services (AWS) without installing, administering, and maintaining your Kubernetes control plane or nodes. Amazon EKS is available as a subscription service. It is an open-source system for automating containerised… Continue reading
How to setup kubectl on Macos/linux/Windows Operating system Getting kubectl up and running The Cluster API server communicates with Kubernetes through kubectl, a command-line application. The kubectl binary is accessible in many operating system package managers, which is typically far more convenient than a manual download and installation process. To install Kubernetes, follow the instructions… Continue reading