Open
Prompt
Engineer
Are you a test automation engineer with experience in prompt engineering? Do you want to help shape the future of QA through the use of AI and advanced automation solutions? Then we're looking for you as a Prompt Engineer.
QA Company is looking for a Prompt Engineer with a focus on AI in test automation. In this role, you'll be responsible for designing, setting up and implementing prompt engineering across multiple teams. You'll work with both internal and external stakeholders to optimise AI-driven testing processes and structurally improve the quality of software products.
🎯
Your mission
- Designing and implementing prompt engineering strategies for test automation across multiple client teams.
- Developing structured prompts and context engineering through which LLMs generate reliable test output: test cases, test data, assertions and reports.
- Optimising existing AI-driven testing processes by systematically experimenting, evaluating and improving on output quality.
- Collaborating with internal and external stakeholders to structurally integrate AI tooling and test automation into the development cycle.
- Sharing knowledge on prompt engineering and AI in testing, acting as a subject-matter point of contact within QA Company and at clients.
- Contributing to the QA Company learning programme and internal knowledge sharing around AI adoption in the testing profession.
- Working with a wide range of clients across various sectors throughout the Netherlands.
AI/LLM Test Automation
Self-healing Tests CI/CD DevOps SAFe / Agile Platform Engineering
- Designing and implementing prompt engineering strategies for test automation across multiple client teams.
- Developing structured prompts and context engineering through which LLMs generate reliable test output: test cases, test data, assertions and reports.
- Optimising existing AI-driven testing processes by systematically experimenting, evaluating and improving on output quality.
- Samenwerken met interne en externe stakeholders om AI-tooling en testautomatisering structureel te integreren in de ontwikkelcyclus.
- Kennisdelen over prompt engineering en AI in testing, als vakinhoudelijk aanspreekpunt binnen QA Company en bij klanten.
- Bijdragen aan de QA Company-leergang en interne kennisdeling rondom AI-adoptie in het testvak.
- Werken bij uiteenlopende klanten in diverse sectoren door heel Nederland.
✅
What you bring
- At least 3 years of experience in test automation and a solid foundation in QA processes and methodologies.
- Demonstrable experience with prompt engineering: you know how to systematically direct LLMs and evaluate output quality.
- Understanding of how LLMs work, from tokenisation and context windows to the effect of temperature and system prompts on output behaviour.
- Programming experience in Python or JavaScript for building and automating prompt pipelines.
- Strong analytical and communication skills: you translate complex AI concepts into clear language for developers, testers and stakeholders alike.
- Comfortable in Agile and DevOps environments, and used to working in multidisciplinary teams.
- Experience with agentic AI frameworks such as LangChain, LangGraph or AutoGen.
- Knowledge of LLM output evaluation techniques: ragas, LLM-as-a-judge, groundedness scoring or similar methods.
- Familiarity with observability tooling for AI systems, such as LangWatch or similar platforms.
- Experience with RAG systems (Retrieval-Augmented Generation) and testing the retrieval component.
🌞
Wat bieden wij
Innovative projects
At leading clients who are at the forefront of AI-driven testing
AI learning programme
"Mastering AI-Powered Testing" exclusive training for our team
Market-competitive salary
Strong secondary benefits and ample growth opportunities
Key role
Help build a new A-label in QA and testing in the Netherlands
Nerdy colleagues
A team of like-minded professionals with a passion for quality
Knowledge sharing
Inspiring company meetings and continuous knowledge development
Apply directly
Send us your details and we'll be in touch soon
Working at QA Company
Professionals with serious ambitions and always at the forefront of the field.
