Arbetsbeskrivning

Veritaz is a leading IT staffing solutions provider in Sweden, committed to advancing individual careers and aiding employers in securing the perfect talent fit. With a proven track record of successful partnerships with top companies, we have rapidly grown our presence in the USA, Europe, and Sweden as a dependable and trusted resource within the IT industry.

Assignment Description:

We are looking for a Senior Data Engineer to join our dynamic team.

What you will work on:

• Design, build, and optimize robust data pipelines (ETL/ELT) integrating multiple structured and unstructured data sources.
• Develop and maintain data models, ensuring high availability, scalability, and reliability of data infrastructure.
• Work with Databricks, Unity Catalog, Apache Spark, and Delta Lake to support advanced analytics and data lakehouse solutions.
• Collaborate closely with data scientists, software engineers, and project managers to deliver efficient and high-quality data integration solutions.
• Implement CI/CD pipelines, version control (Git), and DevOps practices for automated and reliable data workflows.
• Ensure adherence to best practices in data quality, governance, and security.
• Leverage Azure cloud services such as Azure Data Lake and Azure Data Factory to manage, process, and distribute data efficiently.
• Monitor and optimize cloud resource usage for performance and cost-effectiveness.

What you bring:

• 5+ years of experience in data engineering or software development.
• Strong proficiency in SQL and Python for data processing and automation.
• Hands-on expertise with Databricks, Unity Catalog, Apache Spark, and Delta Lake.
• Proven experience designing and implementing scalable ETL/ELT pipelines.
• Deep understanding of Azure cloud platforms, data lakehouse architectures, and dimensional modeling.
• Practical experience with CI/CD, version control (Git), and DevOps methodologies.
• Strong understanding of data engineering best practices and ability to promote them across teams.
• Excellent analytical, problem-solving, and troubleshooting skills.
• Strong communication skills and the ability to collaborate effectively across technical and non-technical teams.
• Self-driven, proactive, and able to work independently in a fast-paced environment.
• Nice to have: Experience with Power BI for data visualization and reporting.