Python Tips & Tricks : 1

Introduction to Azure Data Factory and Data bricks Azure Data Factory Azure Data Factory is an orchestration tool for Data Integration services to perform ETL processes and orchestrate data movements at scale. Azure Data bricks Whereas Azure Data bricks provides an unified collaborative platform for Data Engineers and Data Scientists to perform ETL as…

Image Source : Intellishore Create service principal for Azure Go to “Azure Active Directory”, then “App Registration” and then “New Registration Give your service principal a name and click “Register” Note down the tenet ID and client ID and a secret Go to “azure purview”, then “access control ( iam)”. Add the role “data curator”…

Oracle cloud infrastructure recently announced the general availability of additional two or more regions connecting Microsoft Azure and Oracle Cloud. Before we deep dive into what is Oracle Cloud and Microsoft Azure interconnect , Let’s first understand the need to multi-cloud adoption and its benefits. Multi cloud strategy enables enterprise…

Python is widely used language in the IT world. Process of packaging and distributing the python code across the teams is a very complex task. Solution to this problem is to create wheel file and share this binary files securely across teams. Python wheel file has an extension .whl which…

Azure Databricks — Cluster policy for auto termination Keep it as minimum as possible By default, when the cluster is created, auto termination time is 120 minutes. It should be kept as minimum as possible to reduce the cost(ex. 20 minutes). 2. Use of spot instance Reference Link : https://databricks.com/blog/2021/05/25/leverage-unused-compute-capacity-for-data-ai-with-azure-spot-instances-and-azure-databricks.html

You can access settings related to Azure Multi-Factor Authentication using Azure Active Directory > Security > MFA. Settings

Introduction Every enterprise organizations use data now a days to derive business insights to increase their business. Data is the new oil and many enterprise organizations is focusing more on collecting data from the different sources work on the data driven projects. Once the data is collected , it becomes important…