Data Engineer (Feeds)

About 15gifts

At 15gifts, we’re obsessed with the psychology of choice. We study the key consumer psychology principles that enable consumers to make confident choices on the high street, and we replicate these within our digital guided selling technology to enable consumers to make the same confident decisions online.

We work with some of the world’s leading telecommunications and media brands throughout Europe & the U.S. with our technology powering millions of confident customer decisions across brands such as Verizon, T-Mobile, O2, Sky, Virgin Media, EE, BT, Tesco and Vodafone.

About the role

We work primarily with a python/airflow/AWS data stack, using python in our pipelines and docker to manage our instances. You will have experience in these as well as being fluent with more general data engineering tools and techniques.

As an individual contributor your primary focus will be on building and optimising data pipelines within our existing framework, as well as looking for ways to improve the framework. You will be confident in taking functional and non-functional requirements and translating these into technical requirements, from which high-quality data products can be built.

This is a fantastic opportunity to build out and take ownership of end-to-end data pipelines and help to grow a burgeoning team in an industry with highly rewarding challenges. 

The person we’re looking for

• Passionate about designing and delivering solutions to complex problems

• Inquisitive and keen to innovate in the realms of ELT, Data Modelling and Big Data

• Curious with a desire for continuous learning

• Friendly with a collaborative attitude to solving problems

• Excellent communication skills

You’ll be responsible for

• Extracting and ingesting data from a variety of websites and data services

• Maintaining and improving the 15gifts scraping framework

• Identifying and designing process improvements, redesigning infrastructure for greater efficiency/scalability, automating manual data processes, etc.

• Translating functional and non-functional requirements into technical requirements

• Designing, building and upgrading clean, well documented data pipelines

• Writing automated tests to validate data and data pipelines

• Using version control and performing code reviews

• Fixing bugs in a timely manner

Skills and experience 

Essential

• Comfortable with ELT pipelines and the full data lifecycle

• Comfortable evaluating both business requirements and technical requirements

• A good understanding of techniques to deal with large datasets

• Experience with airflow and docker (or similar technologies)

• Great python and SQL skills and experience

• Experience with cloud (AWS or similar)

• Experience managing data pipelines over time and evolving them to meet new business requirements

Desirable

• Familiarity with web scraping techniques and technologies

• Experience with NoSQL databases (such as MongoDB, DocumentDB)

• Experience with Graph databases (such as ArangoDB, Neo4j)

• Experience handling real-time data

• DevOps experience (CI/CD and automated tooling, bash/zsh scripting)

• Cloud computing with AWS, GCP or Azure 

Why choose us

Our Culture

Our success is underpinned by our cultural values. These values are not something we stick up on a wall – they don’t need to be. They are behaviours that we recognise and celebrate in each other. They are what we live by every day.

Our Cultural Values

• Celebrate brilliance

• Take ownership

• Share Insights

• Look for a better way

• Support each other

Our values are driven through Culture Club – a staff team that rotates every quarter. Advocates for our culture as we grow, Culture Club activates ideas, makes improvements and helps everyone to connect.

Our office and remote working

We can confidently say that our sea-view office is one of Brighton’s best, and we’re really excited that we’ve been able to open up the office to our entire team again. It’s been great to reconnect with everyone in person and to meet the newer members of our team for the first time! 

Whilst we see huge benefits to being able to collaborate and socialise together again, we’ve also learnt a lot about the benefits of working from home. Therefore, we plan to offer our team the flexibility to be in the office when they want to be, and when they need to attend key meetings and workshops, and to work from home on the days when that suits their lives and their workloads best.

When in the office, we have flexible workspaces, which means you’re not tied to a desk, unless you want to be. You could work in a sociable spot on floor 4, or set yourself up with a screen on floor 3. This is everyone’s space and it’s available after work – our staff host everything from gaming and craft nights to adventure film screenings.

Benefits include

• Employee Assistance Programme (confidential counselling)

• Medicash healthcare scheme (reclaim costs for dental, physiotherapy, osteopathy and optical care)

• easitBrighton travel scheme (discounted public transport options)

• Cycle to work scheme

• Life Insurance scheme 

• 33 days holiday (including bank holidays)

• Contributory pension scheme

Other extras in the office

• On site changing rooms, showers and internal bike storage

• Breakfast, fresh fruit, snacks, beers

• Yoga and other fitness activities

• Regular social events, including Friday drinks and book club

• Visits from friendly office dogs

For more information on what it's like to work at 15gifts, check out our Talent Talk with Wired Sussex