Senior Data Engineer Full Time

We are looking for a Senior Data Engineer for our client who meets the following criteria:

• Language: English
• Security Clearance: Enhanced Reliability
• Location of Work: Remote

Mandatory requirements:

• Programming experience in Spark using modern languages such as Python, Scala
• Experience working with modern data architectures like Azure Data Lake Storage, Azure Databricks, Azure Synapse (formerly SQL Data Warehouse) and Delta Lakes
• Experience leading Data Engineering principles within an organization/team.
• Experience working with Integration patterns and technologies such as Azure Event Hub, Function App and C#
• Knowledge and expertise of database modeling techniques: Data Vaults, Star, Snowflake, 3NF, etc.
• Experience working with streaming data architecture and technologies for real-time: Spark Streaming, Kafka, Flink, Storm
• Experience working with relational and non-relational database technologies: SQL Server, Oracle, Cassandra, MongoDB, CosmosDB, HBase
• Experience working with source code and configuration management environments such as Azure DevOps, Git, Maven, Nexus

Additional requirements:

• Experience within Azure environment
• Strong Python, Scala and Spark experience
• Experience modernizing data platforms.
• Experience with Azure Functions and C#
• 2 to 3 projects developing Data Vault

If interested, please reach out to June at june@mdosconsulting.com