Azure Data Engineer & Architect Poisitions in Toronto Full Time

Cyber Space Technologies LLC

NA

27th Nov

Toronto, ON

Primary Skills : spark, SSIS, Hadoop, Azure, PowerBI.

Secondary Skills : HDInsight, oltip, databricks, synapse.

No. of Positions : 1

Job Description

Positions - 1

Azure Data Engineer

Minimum 2 years of hands on experience in Azure Data Factory, ADLS and Blob Storage
(analyzing log files, IoT data, click streams, large datasets)
Minimum 2 years of experience in working on Azure Event Hub and managing real time
data/event ingestion service; along with Azure Stream Analytics performing analytics on data in
flight
Must be proficient with creating multiple complex Azure Data Factory pipelines and activities
using both Azure and On-Prem data stores for full and incremental data loads to cloud
Hands on implementation of data solutions that use the following Azure services: Azure Data
Factory, Azure Cosmos DB, Azure SQL Database, Azure Synapse Analytics, Azure Data Lake
Storage, Blob, Azure Databricks, Azure Stream Analytics.
Responsible for data-related implementation tasks that include provisioning data storage
services.
Experience with multiple various file formats like Avro, Parquet, ORC, and JSON etc.
Implement security requirements and implement data retention policies.
Proficient and deep knowledge of Azure Analysis Services, Microsoft SQL Server database
programming and optimization
Proficient with Azure SQL DW. Understanding of when to use Azure SQL DW vs Azure SQL
Server/DB and loading patterns to move data from blob or ADLS into Azure SQL DW


Position -2

Azure Data Engineer JD
10+ years of core IT experience
3-5 yrs experience in Azure Cloud
Strong experience in Spark/Scala, python
Strong experience in Real time streaming with Kafka/Spark Streaming
Strong Experience in ADLS, Databricks, ADF and SQL
Hands on experience in Azure Data Factory, ADLS and Blob Storage (analyzing log files, IoT
data, click streams, large datasets)
Hands on experience in working on Azure Event Hub and managing real time data/event
ingestion service; along with Azure Stream Analytics performing analytics on data in flight
Must be proficient with creating multiple complex Azure Data Factory pipelines and activities
using both Azure and On-Prem data stores for full and incremental data loads to cloud
Hands on implementation of data solutions that use the following Azure services: Azure Data
Factory, Azure Cosmos DB, Azure SQL Database, Azure Synapse Analytics, Azure Data Lake
Storage, Blob, Azure Databricks, Azure Stream Analytics.


Position - 3
Azure Data Architect JD

Responsibilities :
Research and properly evaluate sources of information to determine possible limitations in
reliability or usability
Coordinate with clients, data users and key stakeholders and develop and achieve various
long term objectives for data architecture.
Analyze, Design and implement effective data solutions and models on Azure data services
such as Azure Data Factory, Synapse Analytics, Azure Databricks and HDInsights
Examine and identify datalake structural necessities by evaluating client operations,
applications, and programming.
Assess and guide datalake and datawarehouse implementation procedures on Cloud to
ensure they comply with internal and external regulations.
Oversee the migration of data from legacy systems to Azure data platforms.
Monitor the system performance by performing regular tests, troubleshooting and integrating
automations
Recommend solutions to improve new and existing datalake and datawarehouse systems on
both on-premise and cloud
Design and implement data encryption and tokenization solutions
Design conceptual and logical data models and flowcharts
Design and integrate the data pipelines with CI/CD
Define security and Disaster Recovery plans and procedures
Requirements :
At least 5 years of proven data architecture and implementation experience on Big
Data technologies.
At least 3 years of experience on building data solutions on Microsoft Azure
Extensive experience on designing on-premise datawarehouse or datalakes
Experience on designing OTLP systems on Cloud
Mandatory Technical Skills : Azure Data Factory, Databricks, Synapse Analytics, HDInsight,
PowerBI, Hadoop, Spark, SQL Server and SSIS
Optional : Any equivalent associate or professional architect certifications (AWS,Azure or Google Cloud Platform)

Please reply with your interest along with updated resume and confirm your Work Authorization Status, Current Location, Relocation(Y/N), Availability to Start with Expected Compensation

Resumes to

 

CST provides its clients with complete, cost-effective, end-to-end personnel solutions across a range of industrial domains. CST's mission is to empower businesses around the world to make better, faster operational decisions.

 

Job Description

Positions - 1

Azure Data Engineer

Minimum 2 years of hands on experience in Azure Data Factory, ADLS and Blob Storage
(analyzing log files, IoT data, click streams, large datasets)
Minimum 2 years of experience in working on Azure Event Hub and managing real time
data/event ingestion service; along with Azure Stream Analytics performing analytics on data in
flight
Must be proficient with creating multiple complex Azure Data Factory pipelines and activities
using both Azure and On-Prem data stores for full and incremental data loads to cloud
Hands on implementation of data solutions that use the following Azure services: Azure Data
Factory, Azure Cosmos DB, Azure SQL Database, Azure Synapse Analytics, Azure Data Lake
Storage, Blob, Azure Databricks, Azure Stream Analytics.
Responsible for data-related implementation tasks that include provisioning data storage
services.
Experience with multiple various file formats like Avro, Parquet, ORC, and JSON etc.
Implement security requirements and implement data retention policies.
Proficient and deep knowledge of Azure Analysis Services, Microsoft SQL Server database
programming and optimization
Proficient with Azure SQL DW. Understanding of when to use Azure SQL DW vs Azure SQL
Server/DB and loading patterns to move data from blob or ADLS into Azure SQL DW


Position -2

Azure Data Engineer JD
10+ years of core IT experience
3-5 yrs experience in Azure Cloud
Strong experience in Spark/Scala, python
Strong experience in Real time streaming with Kafka/Spark Streaming
Strong Experience in ADLS, Databricks, ADF and SQL
Hands on experience in Azure Data Factory, ADLS and Blob Storage (analyzing log files, IoT
data, click streams, large datasets)
Hands on experience in working on Azure Event Hub and managing real time data/event
ingestion service; along with Azure Stream Analytics performing analytics on data in flight
Must be proficient with creating multiple complex Azure Data Factory pipelines and activities
using both Azure and On-Prem data stores for full and incremental data loads to cloud
Hands on implementation of data solutions that use the following Azure services: Azure Data
Factory, Azure Cosmos DB, Azure SQL Database, Azure Synapse Analytics, Azure Data Lake
Storage, Blob, Azure Databricks, Azure Stream Analytics.


Position - 3
Azure Data Architect JD

Responsibilities :
Research and properly evaluate sources of information to determine possible limitations in
reliability or usability
Coordinate with clients, data users and key stakeholders and develop and achieve various
long term objectives for data architecture.
Analyze, Design and implement effective data solutions and models on Azure data services
such as Azure Data Factory, Synapse Analytics, Azure Databricks and HDInsights
Examine and identify datalake structural necessities by evaluating client operations,
applications, and programming.
Assess and guide datalake and datawarehouse implementation procedures on Cloud to
ensure they comply with internal and external regulations.
Oversee the migration of data from legacy systems to Azure data platforms.
Monitor the system performance by performing regular tests, troubleshooting and integrating
automations
Recommend solutions to improve new and existing datalake and datawarehouse systems on
both on-premise and cloud
Design and implement data encryption and tokenization solutions
Design conceptual and logical data models and flowcharts
Design and integrate the data pipelines with CI/CD
Define security and Disaster Recovery plans and procedures
Requirements :
At least 5 years of proven data architecture and implementation experience on Big
Data technologies.
At least 3 years of experience on building data solutions on Microsoft Azure
Extensive experience on designing on-premise datawarehouse or datalakes
Experience on designing OTLP systems on Cloud
Mandatory Technical Skills : Azure Data Factory, Databricks, Synapse Analytics, HDInsight,
PowerBI, Hadoop, Spark, SQL Server and SSIS
Optional : Any equivalent associate or professional architect certifications (AWS,Azure or Google Cloud Platform)

Please reply with your interest along with updated resume and confirm your Work Authorization Status, Current Location, Relocation(Y/N), Availability to Start with Expected Compensation

Resumes to

 

CST provides its clients with complete, cost-effective, end-to-end personnel solutions across a range of industrial domains. CST's mission is to empower businesses around the world to make better, faster operational decisions.

 

Relevant Skill Jobs

San Jose

Philadelphia

Tek Mahindra

Philadelphia

Seattle

Seattle

Remote

Latest Azure Data Engineer & Architect Poisitions in Toronto Jobs