Toloka · Standplaats: Amsterdam · 3 februari 2026

logo

Senior Software Engineer (Python)

Op locatie

Amsterdam, North Holland, Netherlands

Company Intro

At AI we create data that powers leading GenAI models and innovations. We work with frontier labs, big tech, renowned AI startups, enterprises and non-profit research organizations worldwide. We use a combination of Experts + Crowd + Tech Platform to teach AI models to reason and evaluate their efficacy and safety. We have experts in more than 50 different domains-from doctors and lawyers to physicists and engineers-and boast one of the most diverse global crowds, representing over 100 countries and speaking 40+ languages . We are a well - funded startup with an enviable portfolio of clients including Anthropic , Amazon , Microsoft , Poolside , Recraft , and Shopify .

Recently, we secured strategic investment led by Bezos Expeditions with participation from Mikhail Parakhin , CTO of Shopify and board advisor to leading GenAI companies, who now serves as our Chairman of the Board. Our remote-first team is globally distributed around the world: USA , UK , the Netherlands , Israel , Czech Republic , Serbia , and more. We are headquartered in Amsterdam .

About the Role

We are looking for Senior Python developer with deep functional testing experience, strong Linux/Docker skills, the ability to read code in many languages with LLM (e.g. C/Rust/Go) and translate requirements for migration tasks, and comfortable using LLMs (Roo Code / Claude Code) to accelerate iterative development.

Key Responsibilities

  • Create functional black box tests for large codebases in various source languages
  • Create and manage Docker environments to ensure 100% reproducible builds and test execution across different platforms
  • Monitor code coverage and configure automated scoring criteria to meet industry benchmark-level standards
  • Leverage LLMs (Roo Code, Claude) to accelerate development cycles, automate repetitive tasks, and improve overall code quality

Requirements

  • 5+ years of experience as a Software Engineer (primarily Python )
  • Deep experience with pytest (fixtures, session-scoped, timeouts) and designing black-box functional tests for CLI tools
  • Expert-level Docker skills (reproducible Dockerfiles, user contexts, secure workspaces)
  • Strong Linux & Bash scripting skills and comfort debugging inside containers
  • Proficiency with modern Python tooling (uv, pyproject.toml, packaging)
  • Ability to read and understand with LLM many coding languages (for example C, C++, Rust, or Go)
  • Experience using LLMs (Claude Code, Roo Code, Cursor) to accelerate iterative development and test-case generation
  • English language - B2 or higher

Requirements +

  • Prior experience with agent evaluation platforms and MCP CLI

Tools and Technologies: Python (pytest, uv, Pillow), Docker, Bash, Git Submodules, C/C++/Rust/Go (reading), Dagger, GitHub Codespaces, LLMs (Claude Code, Roo Code, Cursor), coverage.py, gcov, kcov.

What we can offer

  • Freelance collaboration via the Mindrift platform (part of AI)
  • Flexible, fully remote work schedule (20-30 hours per week), with the option to work on weekends
  • Hourly rate: up to $50 (final amount to be determined after the final interview with the team)
  • You'll have the opportunity to work on highly innovative projects at the leading edge of AI development, together with a genuinely dedicated and dynamic team of experts
  • You'll also be working on projects with customers that are AI industry leaders and well-known household names
  • Friendly community

[Important Notice] Scam Alert Regarding Fake Job Postings

It has come to our attention that an individual or group is fraudulently impersonating to post fake jobs and solicit personal information from applicants.Please be aware:

  • Official Communication: Our recruiting team will only contact you from an official " .ai " email address. We will NEVER use Gmail, Yahoo, inc, .inc, or other personal or seemingly business email accounts.
  • Official Listings: All legitimate job openings are posted on our official careers page: https://.ai/careers#job-list
Instead, report the incident to us directly at and report the profile/post to LinkedIn.We are taking this matter very seriously and are working with the appropriate parties to resolve it.

Meld Misbruik

Toloka

Standplaats: Amsterdam

3 februari 2026

Vacature kenmerken


Functiegroep
Overig
Functie
python developer
Branche
Overig
Dienstverband
Vast
Uren
20 - 30 uur per week
Opleidingsniveau
HBO
Carriere
Ervaren
Werklocatie
Gustav Mahlerlaan, Amsterdam

Contact


Adres
Toloka
Contactgegevens
Toloka