Data Engineer

Data Engineer

Location: Remote with occasional travel to head office in Wales

Reports to: Chief Technology Officer

Salary Range: £50-60k

The Company:

A highly innovative AI start-up that uses advanced natural language processing and AI methodologies

Similar to the adaptive nature of ChatGPT, their Large Language Model showcases temporal dynamics honed over five years of research & development

• Continuously learning and updating, their model provides real-time information and proactive strategy recommendations, setting a standard for accuracy and responsiveness

• The end product is a software platform that captures, refines, and delivers highly intuitive information on demand, precisely where how and when it is needed by the user

The Opportunity:

The company is a start-up with a phenomenal track record of growth since launch. They have already secured relationships with many top tier brands in their field.

We need a Data Engineer to work closely with our data scientists, assisting them in the production ready implementation of exploratory work in AI, ML and NLP, and with our software engineers in the integration of our AI tools and services into the customer facing product.

The Data Engineer will work with a high degree of autonomy to propose and develop solutions to difficult problems in the hosting, retrieval and distribution of large volumes of data and documents.

We make real products for real users, and the ability to produce maintainable, production ready code would have a huge impact on the success of the business.

The Role:

• Implementing work carried out within a research and development scope in a production ready environment
• Implement production ready data pipeline, storage and retrieval systems across a hybrid cloud solution
• Collaborate with data scientists and software engineers to ensure the integration of NLP solutions into existing data pipelines and systems
• Work closely with product managers and business stakeholders to understand requirements and translate them into technical solutions
• Work closely with Data Scientists and Software engineers to develop and implement intelligence platform APIs and system
• Maintaining and developing MLOPs solutions for the deployment and maintainability of intelligence systems

The Candidate:

• Production level python experience with applicable matching learning libraries

nltk

spacy

scikit-learn

transformers

sentence-transformers

• Experience with Node.js for API development
• Experience working with a variety of data storage solutions include S3, Elastic Stack, SQL, and Graph Databases
• Experience with high volume data throughput pipelines such as Apache Kafka
• Experience with Containerisation and related technologies – Docker, Kubernetes
• Knowledge of Microservices architecture patterns
• Experience with Software Engineering practices including:

Git version control

Test Driven Development

Agile practices

• The ability to work with a high degree of autonomy and self-initiative
• The ability to communicate ideas and processes across project stakeholders

The Culture:

We are a remote friendly organisation open to candidates from across the UK, but at least some time each month will be required in our Wales head office to foster relationships and collaboration.

We can offer flexible hours around family or healthcare commitments as we our primarily outcome based.

We encourage growth and learning at every opportunity with dedicated time for training and professional development, and funding and support available for training and education.