Mandatory: Strong in Azure, ADF, Data Lake, Databricks, Python, Spark, Pyspark
Azure Data Specialist Lead
• Min 5+ years of IT experience, including experience in designing Azure data platform with large scale implementation experience.
• Minimum 3+ years of experience in Azure cloud technology
• Hands-on-experience in developing data lake solutions using Azure (Azure data factory for ingestion, Data lake gen 2 and Azure SQL server for storage, Azure analysis service for transformations, Azure data bricks)
• Strong experience in spark, Python, Pyspark ETL
• Good experience in data analysis, profiling and data modelling. This should include use of modern technologies, methodologies, patterns and industry standards.
• Experience in working on data quality.
• Good analytical and problem-solving ability
• Ability to profile data, assess data quality in the context of business rules, and incorporate validation and certification mechanism to ensure data quality