Protein complexes
complex, version 2026.01
Protein assemblies released after 2021-09-30: the L-polypeptide chains of each entry's first biological assembly, given as one sequence per entity without copy numbers. Predictors build the whole assembly, its stoichiometry included.
Download the data for this version.
Scores and metrics
Each uploaded model gets scores: one value per instance of its target, for example per ligand. The leaderboard ranks runs by metrics, computed from the scores of all their models in a subset. See Help for how each one is defined.
Scores
- LDDT (higher is better)
- iLDDT (higher is better)
- QS-best (higher is better)
- TM-score (higher is better)
- Stoichiometry (higher is better)
Metrics
- Stoichiometry success rate (higher is better)
- Mean LDDT (higher is better)
- Mean iLDDT (multi-chain targets) (higher is better), the default ranking
- Mean QS-best (multi-chain targets) (higher is better)
- Mean TM-score (higher is better)
Subsets and leaderboards
A subset is a selection of the targets with a training cutoff date. Each subset has its own leaderboard, which shows the runs whose own training cutoff is the same or earlier.
| Subset | Training cutoff | Targets |
|---|---|---|
| 2021-09-30 | 2021-09-30 | 5062 |
| 2025-06-30 | 2025-06-30 | 1204 |
Uploading predictions
Predictions are uploaded through the API, one model per request. The examples below create a run, upload one model for the target 10br, and wait until it is scored. Replace YOUR_API_TOKEN with the token on your Account page (sign in first), MODEL_FILES with the files of your model (one CIF or legacy PDB file (optional .gz) with the whole assembly: every copy of every protein chain the model predicts, and nothing else. Each chain is numbered after one input sequence; ligands, ions, waters and nucleic acids are not accepted; at most 5 models per target, and at most 200000 uploads per day or 64 GiB per day for each user),my-method with a label for your run, and 2021-09-30 with your method's training cutoff: the run appears on every leaderboard whose cutoff is the same or later.
import time
from pathlib import Path
import requests
API = "https://beta.cameo3d.org/api/v1"
HEADERS = {"Authorization": "Token YOUR_API_TOKEN"} # from your Account page
def ok(response):
"""The JSON body, or stop with the API's error message."""
if not response.ok:
raise SystemExit(f"{response.status_code} {response.url}: {response.text}")
return response.json()
# 1. The benchmark, and the numeric id of the target to predict
benchmark = ok(requests.get(f"{API}/benchmarks/complex/2026.01/"))
target_id = next(t["id"] for t in benchmark["targets"]
if t["local_id"] == "10br")
# 2. Create a run (private until CAMEO publishes it); labels are unique
# among your runs of a benchmark. training_cutoff is the latest release
# date of your method's training data; it cannot be changed later.
run = ok(requests.post(f"{API}/runs/", headers=HEADERS,
json={"label": "my-method",
"benchmark_id": benchmark["id"],
"training_cutoff": "2021-09-30"}))
# 3. Upload one model for that target: its structure file
MODEL_FILES = ["model.cif"]
prediction = ok(requests.post(
f"{API}/runs/{run['id']}/predictions/", headers=HEADERS,
data={"target": target_id, "model_number": 1},
files=[("files", (Path(f).name, Path(f).read_bytes())) for f in MODEL_FILES]))
# 4. Poll the prediction until it reaches a final status
FINAL = {"invalid", "succeeded", "partial", "failed"}
while prediction["status"] not in FINAL:
time.sleep(30)
prediction = ok(requests.get(f"{API}/predictions/{prediction['id']}/",
headers=HEADERS))
print(prediction["status"])
print(prediction["error"] or prediction["scores"])
This version needs bash and jq.
API="https://beta.cameo3d.org/api/v1"
TOKEN="YOUR_API_TOKEN" # from your Account page
# 1. The benchmark, and the numeric id of the target to predict
BENCHMARK_ID=$(curl -sSf "$API/benchmarks/complex/2026.01/" | jq -r '.id')
TARGET_ID=$(curl -sSf "$API/benchmarks/complex/2026.01/" \
| jq -r '.targets[] | select(.local_id == "10br") | .id')
# 2. Create a run (private until CAMEO publishes it); labels are unique
# among your runs of a benchmark. training_cutoff is the latest release
# date of your method's training data; it cannot be changed later.
RUN_ID=$(curl -sSf -X POST "$API/runs/" \
-H "Authorization: Token $TOKEN" -H "Content-Type: application/json" \
-d "{\"label\": \"my-method\", \"benchmark_id\": $BENCHMARK_ID, \"training_cutoff\": \"2021-09-30\"}" \
| jq -r '.id')
# 3. Upload one model for that target: its structure file
MODEL_FILES=(model.cif)
FILE_ARGS=(); for f in "${MODEL_FILES[@]}"; do FILE_ARGS+=(-F "files=@$f"); done
PREDICTION_ID=$(curl -sSf -X POST "$API/runs/$RUN_ID/predictions/" \
-H "Authorization: Token $TOKEN" \
-F target=$TARGET_ID -F model_number=1 "${FILE_ARGS[@]}" \
| jq -r '.id')
# 4. Poll the prediction until it reaches a final status
while true; do
STATUS=$(curl -sSf "$API/predictions/$PREDICTION_ID/" \
-H "Authorization: Token $TOKEN" | jq -r '.status')
[ -n "$STATUS" ] || break # the request failed: curl printed why
echo "$STATUS"
case "$STATUS" in invalid|succeeded|partial|failed) break;; esac
sleep 30
done
curl -sSf "$API/predictions/$PREDICTION_ID/" -H "Authorization: Token $TOKEN" \
| jq '{status, error, scores}'