GOBI Technologies is seeking a passionate and experienced Senior Data Engineer to join our growing team! In this role, you will play a key role in designing, building, and maintaining scalable data pipelines and infrastructure utilizing the Microsoft data stack.
**Who You Are**
- You have at least 5 years of experience as a Data Engineer or in a similar role, with a robust portfolio of successful data projects.
- You possess expert-level knowledge of Microsoft Azure and have hands-on experience with Azure Data Factory, Azure Synapse Analytics, and Azure Cosmos DB.
- Your skills include advanced data pipeline development, data warehousing, big data processing using Apache Spark, and programming in Python and Scala.
- You are proficient in data modeling, and a working knowledge of Power BI for data visualization is a strong advantage.
- Your excellent communication skills make you a natural collaborator and leader within cross-functional teams.
- You thrive in roles where you can work independently yet are equally comfortable contributing to team success.
**What You'll Do**
- Architect and maintain scalable data pipelines and infrastructure within the Microsoft data ecosystem.
- Design and implement robust data models and storage solutions in Azure Synapse and other platforms to ensure optimal performance and scalability.
- Lead the development and maintenance of orchestration workflows using Azure Data Factory and other tools to automate data processes.
- Collaborate with data analysts, scientists, and business stakeholders to gather requirements, deliver insights, and refine data strategies.
- Develop and enforce best practices in data management, quality assurance, and documentation to ensure excellence and consistency across data operations.
- Stay ahead of the curve with the latest innovations in Microsoft data technologies and lead educational initiatives to disseminate this knowledge across the company.
**Key Responsibilities**:
- Independently scope and execute projects, collaborating closely with the product team to understand platform capabilities and optimize customer data integration.
- Design and optimize data pipelines and models for high performance and resilience, identifying technical and operational requirements.
- Promote excellence in process, methodology, standards, and technology selection, both internally and with customer teams.
- Lead requirements discovery and delivery workshops to guide customers through their data journey.
- Serve as a customer advocate, assisting company leadership in managing client expectations.
- Commit to continuous learning to maintain and share cutting-edge knowledge in the data space.
- Actively contribute to the technical growth and maturity of the organization.