Data Scientist Responsible AI

Detachering36 uurData
Detachering36 uurData
Plaats
Utrecht, Utrecht
Start
1 januari 2027
Looptijd
5 maanden
Reageren tot
20 november 2026
Werkplek
Hybride
Opdrachtgever
Rabobank
Gezien bij de bron
vandaag 01:19
Checkvragen

Kies je bemiddelaar

De opdrachtgever betaalt tot €90 per uur.

1UPPLY

Detachering
Na fee€80 per uur, berekend uit het maximum van de opdrachtgever
Fee€10 per uur, opdrachtgever betaalt (Via het loyaltyprogramma €5/uur, dan kan het tarief €5 hoger uitvallen)
Reageren totopen tot 20 nov
Tarief van het bureauonbekend
Transparantie

Omschrijving

Data Scientist (Responsible GenAI)

Level: Medior–Senior
Working arrangement: Hybrid, with office attendance on Thursdays in Utrecht.

The Role
As a Data Scientist in the Responsible GenAI team, you will build evaluation capabilities and guardrails that help teams understand, measure and improve the quality and safety of their GenAI solutions.

You will work at the intersection of data science, software engineering and responsible AI. You’ll translate real-world use cases and risks into robust evaluation methods, reusable tools and practical controls. Your work may span assistants, report generation, document processing and agentic applications.

This is a hands-on development role requiring strong statistical judgement and production experience. You’ll design sound experiments, analyse data and metrics critically, and make clear what the evidence does—and does not—support. You’ll turn experiments into maintainable, tested, production-ready code and work with engineers to integrate it into deployed solutions. The focus is on putting evaluation and safeguards into practice, rather than training foundation models or conducting standalone research.

Your Responsibilities

Build reusable evaluation frameworks and tools for repeatable testing, comparison and regression analysis across GenAI use cases.
Develop and validate evaluation metrics using deterministic checks, model-based evaluation and human assessments. Assess metric reliability, uncertainty and whether metrics measure what they are intended to measure.
Design statistically sound experiments, test datasets and evaluation scenarios with use-case teams and domain experts. Consider sampling strategies, representativeness, ground truth, edge cases and challenging inputs.
Develop and assess guardrails using appropriate methods, including rule-based controls, LLM-as-a-judge approaches and trained ML classifiers.

Address risks such as sensitive-data exposure, unsupported outputs, prompt injection and unintended system behaviour.
Measure guardrail effectiveness and trade-offs, including precision and recall, detection thresholds, class imbalance, missed detections, false positives, robustness, drift, latency and cost.
Deliver maintainable, tested, production-ready code and work with engineers to integrate evaluations and controls into CI/CD, APIs, pipelines, deployment, monitoring and production workflows.
Translate use-case needs into actionable evaluation criteria, explain findings and limitations, and turn delivery experience into reusable methods, documentation and tooling.

What You’ll Bring

GenAI systems

Practical experience with LLM-based applications and an understanding of their limitations and failure modes.
Familiarity with retrieval-augmented generation, prompting, grounding and context management.
Ability to assess GenAI outputs against explicit criteria and understand how changes to models, prompts, data or application logic can affect quality and safety.

Production-ready development and integration

Strong Python skills and experience turning experiments and prototypes into maintainable, tested, production-ready code—not just exploratory notebooks.
Experience integrating data-science components with APIs, structured and unstructured data, and automated data-processing or evaluation pipelines.
Hands-on experience with version control, automated testing, CI/CD and reproducible experimentation.
Production experience that enables you to understand deployment, monitoring and operational workflows, diagnose issues and deliver code engineers can integrate and operate. ML or platform engineering specialisation is not required.

Statistics, measurement and experimentation

Experience designing sound evaluations and experiments, and critically analysing metrics and datasets. Applied statistical knowledge of sampling, dataset representativeness, uncertainty, metric reliability and experimental design, including the limitations of aggregate scores.

… lees de volledige omschrijving bij 1UPPLY.

Bekijk meer opdrachten

Vergelijkbare opdrachten