If you’re skillful QA AI Engineer, stay at home, we have a project for you that needs your hands.
TECHNOLOGIES:
Python
LLM
API testing
CI/CD pipelines
Job info
Job description, responsibilities and duties
Hi,
I'm Nika from CODERAMA and I'm looking for a smart QA with AI experience to join the team.
What will you do?
- Design QA and evaluation strategy for AI systems (LLM, Agents, RAG).
- Testing AI behavior in standard, boundary and risk scenarios.
- Building evaluation and testing frameworks (automated and manual).
- Test automation and integration into CI/CD.
- Validation of data quality, retrieval and embeddings.
- Hallucination detection, model drift, bias and regressions.
- Collaboration on monitoring and observability of AI systems.
- Defect triage and root cause analysis.
What do we expect from you?
- Experience with QA for AI/ML systems or complex data systems.
- Ability to design end-to-end testing strategy.
- Experience testing non-deterministic systems.
- Analytical thinking and ability to identify failure scenarios.
- Self-sufficiency, ownership, and ability to collaborate with development teams.
Technologies on the project:
- Python
- LLM and agent-based AI systems
- RAG, embeddings, retrievel
- API and backend testing
- CI/CD pipeline
- Monitoring and observability tools
- Test automation frameworks
We take good care of you at CODERAMA, so if you want to know more, drop us a line and we'll get back to you :)
Employee benefits
- Excellent and fair salary
- Career growth
- Acquiring a wide range of skills in modern technologies
- Opportunity to rotate between projects
- Attractive referral bonus system - you get 2000 Euros for referring a developer
- Work in an excellent team, both professionally and humanly
- Friendly atmosphere, openness and transparency
- Possibility to work full-time remote, flexible working hours
- Informal environment and bureaucracy protection
- Company hardware also for personal use
- Training allowance
- Stability, almost no turnover - once you come to CODERAMA, you won't want to leave
- Event calendar full of sports and cultural events, team building and other activities
- Work with travel, Work & Travel
Employee requirements
Languages:
- Slovak/Czech C1
- English C1
