As a Full Stack Data Engineer, you will be integral in developing and maintaining our next-generation digital analytics application. You will be building scalable web applications, designing robust data pipelines, and ensuring seamless data integration and processing. This role requires a unique blend of data engineering and software development expertise to design, develop, and maintain both the backend infrastructure and data pipelines that support our platform. You will work closely with cross-functional teams, including data analysts, Power BI developers, and UX/UI designers, to create a reliable and efficient data infrastructure that supports advanced analytics and reporting. 

Principal Accountabilities 

• Develop and maintain robust front-end and back-end components of web applications, ensuring software quality, security, and maintainability through rigorous testing and code reviews. 

• Design, build, and maintain data pipelines to extract, transform, and load (ETL) data from various sources, optimizing data storage and retrieval processes for performance and scalability. 

• Design, develop, and maintain scalable data pipelines to extract, transform and load (ETL) data form various sources, optimizing data storage and retrieval processes for performance and scalability using Dagster. 

• Build data workflows that ensure high availability, reliability, and performance. 

• Integrate data from various sources (databases, APIs, event streams) into data lakes and warehouses. 

• Monitor, troubleshoot, and optimize data workflows for performance and scalability. 

• Create efficient data models and schemas to support the platform's analytical and operational needs using SQL and NoSQL databases. 

• Design, develop, and maintain RESTful APIs using industry standards to expose data and functionality to frontend applications. 

• Collaborate with data engineers, data analysts, and Power BI developers to integrate data sources into the analytics platform, providing technical guidance and mentorship to junior developers. 

• Deploy tested software applications and updates to production environments, troubleshoot and resolve issues related to data pipelines, application performance, and data integration, and implement monitoring and alerting mechanisms to ensure data pipeline reliability. 

Qualifications

 

We recruit talented, dynamic people with diverse backgrounds and experiences, all united by a belief in our mission to provide the world’s leading and most trusted price reporting, events, and intelligence service for the markets we serve. We’re proud to be an equal opportunities employer and are committed to creating a fully inclusive workplace, where everyone feels able to participate and contribute meaningfully.

If you are open-minded, curious, resilient, solutions-oriented and committed to promoting equality, then read on.

KNOWLEDGE, EXPERIENCE AND SKILLS

We are looking for an individual who is highly motivated, driven, and have a passion to be part of a fast-paced, successful team. Being a strong team player is also important as well as someone who is happy to work flexibly.

• 10+ years of experience in building data pipelines and backend development using Python, Java, or Node.js with proficiency in frameworks like Django, Flask, Spring Boot, or Express.js. 

• Proficiency in Dagster for workflow orchestration, including creating solids, pipelines, and schedules. 

• Strong programming skills in Python or similar languages. 

• Experience with SQL and database systems (e.g., PostgreSQL, MySQL, Snowflake, BigQuery). 

• Familiarity with cloud platforms such as AWS, Azure, or Google Cloud. 

• Expertise in building and maintaining data pipelines and ETL processes, with knowledge of data structures, algorithms, and data analytics; experience with big data technologies like Hadoop, Spark, or Kafka  

• Strong understanding of relational and NoSQL databases. Proficiency in database design and optimization. 

• Experience in designing, developing and maintaining RESTful APIs using industry standards. 

• Knowledge of CI/CD pipelines and automated testing frameworks 

• Experience in creating efficient data models and schemas. 

• Strong analytical and problem-solving skills. 

• Experience with frontend development technologies (HTML, CSS, JavaScript) is a plus.  

If you're excited about the role but your experience, skills or qualifications don't perfectly align, we encourage you to apply anyway.