Associate Data Engineer
HYLA Mobile
Job Purpose
The Associate Data Engineer will play a critical role in ensuring massive reservoirs of big data availability, seamless integration and deployment of Machine Learning, Artificial Intelligence, and Generative AI applications on the Azure platform.
This position will collaborate closely with Data Engineers, Data Warehouse Developers, Data Scientists, Cloud Engineers, Enterprise Architects, Security, and Network Engineers to design and implement robust CI/CD processes using Assurant's Azure DevOps and GitHub Enterprise infrastructure.
Primary Job Accountabilities and Responsibilities
Perform hands-on programming work with Microsoft technology stack, including .NET Core, Microservices, Web API, C#, ASP.NET, ADO.NET, MVC, Entity Framework, SQL Server and Python.
Participate in continuous integration and continuous delivery (CI/CD) pipeline development and maintenance using Azure DevOps and GitHub using
May also implement infrastructure as code (IaC) practices using Terraform and Azure Resource Manager (ARM) templates to provision and manage Azure resources
Troubleshoot and resolve errors in production systems, logging detailed information and providing customer updates
Assist other engineers in product development, optimization, and process improvement efforts
Coordinate data-related activities and manage customer expectations during system maintenance
Assist with data reconciliation to ensure high-quality data for reporting, analytics, ML, and AI solutions
Monitor production solutions to ensure compliance with established SLA metrics and data quality standards
Participate in all Agile ceremonies and stand-ups
Contribute to research and proof of concept development as guided by Senior and Lead Engineers
Create comprehensive documentation and track technical issues
Communicate effectively with cross-functional teams and customers
Stay updated with the latest industry trends and technologies to propose and implement improvements
Basic Qualifications Required
Education
Bachelor's degree with 3+ years of experience in engineering, science, or computer science
Alternatively, a Master's degree with 2+ years of experience
Technical Skills and Experience
Proficiency in at least one cloud platform (Microsoft Azure, AWS, or Google Cloud Platform)
Experience with containerization concepts and tools (Docker and Kubernetes)
Proficiency in scripting languages such as PowerShell, Bash, or Azure CLI
Knowledge of agile methodologies (Scrum or Kanban)
Understanding of security best practices and compliance frameworks (e.g., GDPR)
Experience with Cloud Service Models: PaaS, IaaS, SaaS
Minimum 3 years of development experience using Microsoft technology stack
Strong problem-solving and troubleshooting abilities
Excellent collaboration and communication skills
Preferred Experience, Skills, and Knowledge
Knowledge of foundational concepts in:
Business Intelligence
Data Warehousing
Machine Learning
Artificial Intelligence
Large Language Models
Experience with:
SQL, Python
Linux Shell Scripting, Microsoft PowerShell
Spark, PySpark
NoSQL
Proficiency in creating interactive web applications and single-page applications
Experience writing unit test cases for business logic, repositories, and controllers
Vendor-based cloud certifications in Azure or DevOps (e.g., Microsoft Certified: Azure Fundamentals, Microsoft Certified: Azure DevOps Engineer Expert)