Skip to content

Community tasks

Submission, six validation gates, private visibility, and curator promotion.

Anyone can submit a real GitHub issue task from /tasks/new: repoUrl, baseCommit, issueText, testCommand, visibility. GitHub OAuth is preferred when configured; otherwise a hashed anonymous cookie is the stable submitter id.

Six gates

  • Cloned — exact base commit, 60s
  • Installs — runtime dependencies only; network-dependent installs are rejected
  • Test fails at base — nonzero exit
  • Deterministic — three failing runs
  • Time bounded — each run under 600s
  • License — GitHub API SPDX or LICENSE-file heuristic against a permissive allowlist

A validated community task becomes public only after a curator promotes it. Private tasks return 403 to every other viewer. Rate limits: 3 pending per user, 10 per 24 hours per user, 20 globally.