Kumaran
Apply Now
Databricks Consultant
Description
Job Description
Must-Have Skills & Qualifications
Strong hands‑on experience with Databricks and Apache Spark (PySpark/Scala). Experience in SQL and data transformation techniques. Knowledge of ETL tools and data pipeline development. Experience working with cloud platforms (Azure/AWS/GCP). Strong Azure cloud background Understanding of data warehousing concepts. Strong problem‑solving and analytical skills. Hands on Experience with Azure Databricks or Delta Lake, in building ETLPipelines: batch (autoloader) and Spark structured streaming Knowledge of data modelling and performance tuning in Spark. Exposure to CI/CD pipelines and DevOps practices. Familiarity with data governance and security practices. Strong hands‑on working experience of Unity catalog: Hands on exposure to Creating end to end environments : creating catalogs,schemas, tables . materialized views, functions, volumes Experience in building SCD 1 and SCD2 (slowly changing dimensions ) ondimension table...
Must-Have Skills & Qualifications
Strong hands‑on experience with Databricks and Apache Spark (PySpark/Scala). Experience in SQL and data transformation techniques. Knowledge of ETL tools and data pipeline development. Experience working with cloud platforms (Azure/AWS/GCP). Strong Azure cloud background Understanding of data warehousing concepts. Strong problem‑solving and analytical skills. Hands on Experience with Azure Databricks or Delta Lake, in building ETLPipelines: batch (autoloader) and Spark structured streaming Knowledge of data modelling and performance tuning in Spark. Exposure to CI/CD pipelines and DevOps practices. Familiarity with data governance and security practices. Strong hands‑on working experience of Unity catalog: Hands on exposure to Creating end to end environments : creating catalogs,schemas, tables . materialized views, functions, volumes Experience in building SCD 1 and SCD2 (slowly changing dimensions ) ondimension table...