Skip to content
ExecuTorch E2E / Python - Test

Cover custom sdpa + kv cache + quant in CI #357

Sign in to view logs

Cover custom sdpa + kv cache + quant in CI

Cover custom sdpa + kv cache + quant in CI #357

Run time

Learn about OS pricing on GitHub Actions
Job Run time
discover-tests
4s
smollm (et=0.6.0, py=3.11, macos-15)
6m 20s
smollm (et=0.6.0, py=3.11, ubuntu-22.04)
10m 51s
smollm (et=nightly, py=3.11, macos-15)
13m 13s
smollm (et=nightly, py=3.11, ubuntu-22.04)
23m 55s
llama (et=0.6.0, py=3.11, macos-15)
1m 19s
llama (et=0.6.0, py=3.11, ubuntu-22.04)
2m 44s
llama (et=nightly, py=3.11, macos-15)
7m 55s
llama (et=nightly, py=3.11, ubuntu-22.04)
13m 59s
bert (et=0.6.0, py=3.11, macos-15)
2m 43s
bert (et=0.6.0, py=3.11, ubuntu-22.04)
5m 1s
bert (et=nightly, py=3.11, macos-15)
3m 7s
bert (et=nightly, py=3.11, ubuntu-22.04)
5m 29s
common (et=0.6.0, py=3.11, macos-15)
2m 12s
common (et=0.6.0, py=3.11, ubuntu-22.04)
3m 23s
common (et=nightly, py=3.11, macos-15)
2m 13s
common (et=nightly, py=3.11, ubuntu-22.04)
4m 3s
gemma (et=0.6.0, py=3.11, macos-15)
1m 16s
gemma (et=0.6.0, py=3.11, ubuntu-22.04)
2m 54s
gemma (et=nightly, py=3.11, macos-15)
17m 49s
gemma (et=nightly, py=3.11, ubuntu-22.04)
16m 1s
deit (et=0.6.0, py=3.11, macos-15)
2m 19s
deit (et=0.6.0, py=3.11, ubuntu-22.04)
4m 3s
deit (et=nightly, py=3.11, macos-15)
2m 36s
deit (et=nightly, py=3.11, ubuntu-22.04)
4m 34s
gemma2 (et=0.6.0, py=3.11, macos-15)
1m 19s
gemma2 (et=0.6.0, py=3.11, ubuntu-22.04)
2m 40s
gemma2 (et=nightly, py=3.11, macos-15)
24m 25s
gemma2 (et=nightly, py=3.11, ubuntu-22.04)
22m 33s
distilbert (et=0.6.0, py=3.11, macos-15)
2m 2s
distilbert (et=0.6.0, py=3.11, ubuntu-22.04)
4m 2s
distilbert (et=nightly, py=3.11, macos-15)
2m 29s
distilbert (et=nightly, py=3.11, ubuntu-22.04)
4m 21s
cvt (et=0.6.0, py=3.11, macos-15)
3m 2s
cvt (et=0.6.0, py=3.11, ubuntu-22.04)
5m 34s
cvt (et=nightly, py=3.11, macos-15)
3m 13s
cvt (et=nightly, py=3.11, ubuntu-22.04)
5m 59s
albert (et=0.6.0, py=3.11, macos-15)
2m 51s
albert (et=0.6.0, py=3.11, ubuntu-22.04)
5m 22s
albert (et=nightly, py=3.11, macos-15)
2m 55s
albert (et=nightly, py=3.11, ubuntu-22.04)
5m 30s
whisper (et=0.6.0, py=3.11, macos-15)
2m 23s
whisper (et=0.6.0, py=3.11, ubuntu-22.04)
4m 18s
whisper (et=nightly, py=3.11, macos-15)
3m 27s
whisper (et=nightly, py=3.11, ubuntu-22.04)
4m 48s
phi4 (et=0.6.0, py=3.11, macos-15)
1m 17s
phi4 (et=0.6.0, py=3.11, ubuntu-22.04)
2m 46s
phi4 (et=nightly, py=3.11, macos-15)
13m 0s
phi4 (et=nightly, py=3.11, ubuntu-22.04)
17m 36s
mobilevit2 (et=0.6.0, py=3.11, macos-15)
1m 56s
mobilevit2 (et=0.6.0, py=3.11, ubuntu-22.04)
3m 36s
mobilevit2 (et=nightly, py=3.11, macos-15)
2m 12s
mobilevit2 (et=nightly, py=3.11, ubuntu-22.04)
4m 14s
olmo (et=0.6.0, py=3.11, macos-15)
1m 15s
olmo (et=0.6.0, py=3.11, ubuntu-22.04)
2m 45s
olmo (et=nightly, py=3.11, macos-15)
22m 23s
olmo (et=nightly, py=3.11, ubuntu-22.04)
14m 13s
roberta (et=0.6.0, py=3.11, macos-15)
3m 20s
roberta (et=0.6.0, py=3.11, ubuntu-22.04)
5m 11s
roberta (et=nightly, py=3.11, macos-15)
3m 16s
roberta (et=nightly, py=3.11, ubuntu-22.04)
6m 0s
efficientnet (et=0.6.0, py=3.11, macos-15)
2m 11s
efficientnet (et=0.6.0, py=3.11, ubuntu-22.04)
4m 8s
efficientnet (et=nightly, py=3.11, macos-15)
2m 23s
efficientnet (et=nightly, py=3.11, ubuntu-22.04)
4m 38s
gemma3 (et=0.6.0, py=3.11, macos-15)
1m 17s
gemma3 (et=0.6.0, py=3.11, ubuntu-22.04)
2m 34s
gemma3 (et=nightly, py=3.11, macos-15)
44m 17s
gemma3 (et=nightly, py=3.11, ubuntu-22.04)
24m 47s
focalnet (et=0.6.0, py=3.11, macos-15)
2m 13s
focalnet (et=0.6.0, py=3.11, ubuntu-22.04)
3m 54s
focalnet (et=nightly, py=3.11, macos-15)
2m 24s
focalnet (et=nightly, py=3.11, ubuntu-22.04)
4m 28s
vit (et=0.6.0, py=3.11, macos-15)
3m 7s
vit (et=0.6.0, py=3.11, ubuntu-22.04)
4m 14s
vit (et=nightly, py=3.11, macos-15)
2m 28s
vit (et=nightly, py=3.11, ubuntu-22.04)
4m 39s
dit (et=0.6.0, py=3.11, macos-15)
2m 8s
dit (et=0.6.0, py=3.11, ubuntu-22.04)
4m 8s
dit (et=nightly, py=3.11, macos-15)
2m 34s
dit (et=nightly, py=3.11, ubuntu-22.04)
4m 49s
t5 (et=0.6.0, py=3.11, macos-15)
3m 43s
t5 (et=0.6.0, py=3.11, ubuntu-22.04)
7m 19s
t5 (et=nightly, py=3.11, macos-15)
5m 21s
t5 (et=nightly, py=3.11, ubuntu-22.04)
8m 0s
qwen3 (et=0.6.0, py=3.11, macos-15)
21m 10s
qwen3 (et=0.6.0, py=3.11, ubuntu-22.04)
15m 33s
qwen3 (et=nightly, py=3.11, macos-15)
27m 53s
qwen3 (et=nightly, py=3.11, ubuntu-22.04)
22m 19s
mobilevit (et=0.6.0, py=3.11, macos-15)
2m 5s
mobilevit (et=0.6.0, py=3.11, ubuntu-22.04)
4m 3s
mobilevit (et=nightly, py=3.11, macos-15)
2m 25s
mobilevit (et=nightly, py=3.11, ubuntu-22.04)
4m 27s
qwen2 (et=0.6.0, py=3.11, macos-15)
7m 4s
qwen2 (et=0.6.0, py=3.11, ubuntu-22.04)
9m 18s
qwen2 (et=nightly, py=3.11, macos-15)
8m 52s
qwen2 (et=nightly, py=3.11, ubuntu-22.04)
9m 41s
pvt (et=0.6.0, py=3.11, macos-15)
2m 1s
pvt (et=0.6.0, py=3.11, ubuntu-22.04)
3m 57s
pvt (et=nightly, py=3.11, macos-15)
2m 21s
pvt (et=nightly, py=3.11, ubuntu-22.04)
4m 17s
swin (et=0.6.0, py=3.11, macos-15)
2m 52s
swin (et=0.6.0, py=3.11, ubuntu-22.04)
5m 9s
swin (et=nightly, py=3.11, macos-15)
3m 6s
swin (et=nightly, py=3.11, ubuntu-22.04)
5m 39s
11h 34m 12s