Data Engineer Consultant
Job Summary
We Love #data.
We are looking for an experienced engineer with a strong foundation in databases, SQL and data integration, combined with experience or exposure to modern cloud data platforms and architectures.
You will work with a diverse technology landscape, from enterprise databases and data integration platforms to cloud data warehouses, lakehouse environments and AI-ready data platforms, contributing across the full lifecycle of data projects.
The role combines hands-on engineering, problem solving, solution design and direct collaboration with customers and technical teams. We also value people who are curious about AI and Generative AI and want to understand how these technologies can improve both the solutions we build and the way we work.
What You'll Do
· Work with technical and business stakeholders to translate requirements into effective data solutions
· Analyse and integrate heterogeneous data sources, including databases, enterprise applications, files and APIs
· Design, develop and optimise ETL/ELT pipelines and data integration workflows
· Work extensively with databases, including data modelling, advanced SQL and performance optimisation
· Design and develop data warehouse, cloud data warehouse, data lake and lakehouse solutions
· Implement data quality, validation and monitoring mechanisms
· Work with modern data platforms such as Snowflake, Google BigQuery and Databricks
· Troubleshoot complex data, integration and performance issues
· Contribute to technical design and architecture decisions
· Apply good engineering practices including Git, testing, documentation and deployment automation.
· Explore how AI and AI-assisted tools can improve data engineering, productivity and the solutions we deliver
· Contribute to building AI-ready data platforms, ensuring that data is reliable, accessible, well-structured and appropriately governed for analytics and AI use cases
· Collaborate directly with customers and technical teams throughout project delivery
What We're Looking For
Strong experience in Data Engineering, Data Integration and Data Warehousing
Advanced SQL skills and strong knowledge of relational databases, data structures and query optimisation
Hands-on experience developing ETL/ELT processes and data pipelines
Experience with enterprise data integration tools
Solid knowledge of data modelling and data warehouse concepts
Experience integrating data from databases, files and APIs
Experience working with large datasets and solving performance challenges
Knowledge of Python for data engineering and automation
Experience or exposure to cloud data platforms and modern data architectures
Strong analytical and problem-solving skills
Good communication and customer-facing skills
Fluent English
Knowledge of AI/Generative AI or a strong desire to understand, learn and apply AI in day-to-day engineering and data solutions
Relevant Technology Experience
We don't expect you to know every technology. Strong data engineering fundamentals and experience with a combination of the following are what matter:
· Databases & Cloud Data Warehouses: Rocket Vertica, Snowflake, Google BigQuery, Oracle, Microsoft SQL Server, PostgreSQL, MySQL
· Data Integration: Qlik Talend, Informatica, SSIS or comparable ETL/ELT platforms
· Modern Data Platforms: Databricks, Apache Spark, Data Lake/Lakehouse architectures, Azure, AWS or Google Cloud Platform
· Experience with Snowflake, BigQuery and/or Databricks is particularly relevant for this role
Nice to Have
Experience with orchestration or streaming technologies such as Airflow or Kafka
Knowledge of data governance, metadata and data lineage
Experience with cloud migration or data modernisation projects
Exposure to CI/CD practices for data engineering
Exposure to AI/ML or Generative AI projects and AI-assisted development tools
Experience working in consulting or customer-facing environments
To Apply, send us your CV at office@staffingbysquill.com
