Skip to content
ExecuTorch E2E / Python - Test

Cover custom sdpa + kv cache + quant in CI (#75) #364

Sign in to view logs

Cover custom sdpa + kv cache + quant in CI (#75)

Cover custom sdpa + kv cache + quant in CI (#75) #364

Run time

Learn about OS pricing on GitHub Actions
Job Run time
discover-tests
5s
smollm (et=0.6.0, py=3.11, macos-15)
6m 54s
smollm (et=0.6.0, py=3.11, ubuntu-22.04)
9m 18s
smollm (et=nightly, py=3.11, macos-15)
12m 42s
smollm (et=nightly, py=3.11, ubuntu-22.04)
23m 53s
llama (et=0.6.0, py=3.11, macos-15)
1m 17s
llama (et=0.6.0, py=3.11, ubuntu-22.04)
2m 50s
llama (et=nightly, py=3.11, macos-15)
12m 17s
llama (et=nightly, py=3.11, ubuntu-22.04)
14m 56s
bert (et=0.6.0, py=3.11, macos-15)
2m 51s
bert (et=0.6.0, py=3.11, ubuntu-22.04)
5m 3s
bert (et=nightly, py=3.11, macos-15)
3m 35s
bert (et=nightly, py=3.11, ubuntu-22.04)
5m 45s
common (et=0.6.0, py=3.11, macos-15)
1m 45s
common (et=0.6.0, py=3.11, ubuntu-22.04)
3m 15s
common (et=nightly, py=3.11, macos-15)
2m 33s
common (et=nightly, py=3.11, ubuntu-22.04)
4m 10s
gemma (et=0.6.0, py=3.11, macos-15)
1m 19s
gemma (et=0.6.0, py=3.11, ubuntu-22.04)
2m 45s
gemma (et=nightly, py=3.11, macos-15)
18m 19s
gemma (et=nightly, py=3.11, ubuntu-22.04)
16m 37s
deit (et=0.6.0, py=3.11, macos-15)
2m 16s
deit (et=0.6.0, py=3.11, ubuntu-22.04)
4m 11s
deit (et=nightly, py=3.11, macos-15)
3m 10s
deit (et=nightly, py=3.11, ubuntu-22.04)
5m 0s
gemma2 (et=0.6.0, py=3.11, macos-15)
1m 18s
gemma2 (et=0.6.0, py=3.11, ubuntu-22.04)
2m 38s
gemma2 (et=nightly, py=3.11, macos-15)
22m 3s
gemma2 (et=nightly, py=3.11, ubuntu-22.04)
45m 2s
distilbert (et=0.6.0, py=3.11, macos-15)
1m 55s
distilbert (et=0.6.0, py=3.11, ubuntu-22.04)
4m 13s
distilbert (et=nightly, py=3.11, macos-15)
2m 50s
distilbert (et=nightly, py=3.11, ubuntu-22.04)
4m 30s
cvt (et=0.6.0, py=3.11, macos-15)
4m 11s
cvt (et=0.6.0, py=3.11, ubuntu-22.04)
5m 25s
cvt (et=nightly, py=3.11, macos-15)
3m 50s
cvt (et=nightly, py=3.11, ubuntu-22.04)
6m 11s
albert (et=0.6.0, py=3.11, macos-15)
3m 10s
albert (et=0.6.0, py=3.11, ubuntu-22.04)
5m 3s
albert (et=nightly, py=3.11, macos-15)
3m 8s
albert (et=nightly, py=3.11, ubuntu-22.04)
6m 2s
whisper (et=0.6.0, py=3.11, macos-15)
2m 50s
whisper (et=0.6.0, py=3.11, ubuntu-22.04)
4m 44s
whisper (et=nightly, py=3.11, macos-15)
3m 44s
whisper (et=nightly, py=3.11, ubuntu-22.04)
5m 17s
phi4 (et=0.6.0, py=3.11, macos-15)
1m 16s
phi4 (et=0.6.0, py=3.11, ubuntu-22.04)
2m 33s
phi4 (et=nightly, py=3.11, macos-15)
14m 31s
phi4 (et=nightly, py=3.11, ubuntu-22.04)
17m 27s
mobilevit2 (et=0.6.0, py=3.11, macos-15)
1m 55s
mobilevit2 (et=0.6.0, py=3.11, ubuntu-22.04)
3m 28s
mobilevit2 (et=nightly, py=3.11, macos-15)
2m 27s
mobilevit2 (et=nightly, py=3.11, ubuntu-22.04)
4m 21s
olmo (et=0.6.0, py=3.11, macos-15)
1m 14s
olmo (et=0.6.0, py=3.11, ubuntu-22.04)
2m 40s
olmo (et=nightly, py=3.11, macos-15)
20m 25s
olmo (et=nightly, py=3.11, ubuntu-22.04)
14m 11s
roberta (et=0.6.0, py=3.11, macos-15)
3m 42s
roberta (et=0.6.0, py=3.11, ubuntu-22.04)
5m 20s
roberta (et=nightly, py=3.11, macos-15)
4m 22s
roberta (et=nightly, py=3.11, ubuntu-22.04)
6m 3s
efficientnet (et=0.6.0, py=3.11, macos-15)
2m 19s
efficientnet (et=0.6.0, py=3.11, ubuntu-22.04)
4m 18s
efficientnet (et=nightly, py=3.11, macos-15)
2m 48s
efficientnet (et=nightly, py=3.11, ubuntu-22.04)
5m 4s
gemma3 (et=0.6.0, py=3.11, macos-15)
1m 23s
gemma3 (et=0.6.0, py=3.11, ubuntu-22.04)
2m 35s
gemma3 (et=nightly, py=3.11, macos-15)
27m 55s
gemma3 (et=nightly, py=3.11, ubuntu-22.04)
26m 32s
focalnet (et=0.6.0, py=3.11, macos-15)
2m 18s
focalnet (et=0.6.0, py=3.11, ubuntu-22.04)
4m 4s
focalnet (et=nightly, py=3.11, macos-15)
3m 24s
focalnet (et=nightly, py=3.11, ubuntu-22.04)
4m 33s
vit (et=0.6.0, py=3.11, macos-15)
2m 13s
vit (et=0.6.0, py=3.11, ubuntu-22.04)
3m 56s
vit (et=nightly, py=3.11, macos-15)
2m 48s
vit (et=nightly, py=3.11, ubuntu-22.04)
4m 40s
dit (et=0.6.0, py=3.11, macos-15)
2m 25s
dit (et=0.6.0, py=3.11, ubuntu-22.04)
4m 17s
dit (et=nightly, py=3.11, macos-15)
2m 50s
dit (et=nightly, py=3.11, ubuntu-22.04)
5m 0s
t5 (et=0.6.0, py=3.11, macos-15)
3m 58s
t5 (et=0.6.0, py=3.11, ubuntu-22.04)
7m 8s
t5 (et=nightly, py=3.11, macos-15)
4m 36s
t5 (et=nightly, py=3.11, ubuntu-22.04)
7m 55s
qwen3 (et=0.6.0, py=3.11, macos-15)
10m 56s
qwen3 (et=0.6.0, py=3.11, ubuntu-22.04)
7m 54s
qwen3 (et=nightly, py=3.11, macos-15)
29m 38s
qwen3 (et=nightly, py=3.11, ubuntu-22.04)
27m 11s
mobilevit (et=0.6.0, py=3.11, macos-15)
2m 39s
mobilevit (et=0.6.0, py=3.11, ubuntu-22.04)
3m 50s
mobilevit (et=nightly, py=3.11, macos-15)
2m 42s
mobilevit (et=nightly, py=3.11, ubuntu-22.04)
4m 31s
qwen2 (et=0.6.0, py=3.11, macos-15)
6m 59s
qwen2 (et=0.6.0, py=3.11, ubuntu-22.04)
9m 42s
qwen2 (et=nightly, py=3.11, macos-15)
7m 40s
qwen2 (et=nightly, py=3.11, ubuntu-22.04)
9m 34s
pvt (et=0.6.0, py=3.11, macos-15)
2m 16s
pvt (et=0.6.0, py=3.11, ubuntu-22.04)
3m 43s
pvt (et=nightly, py=3.11, macos-15)
2m 55s
pvt (et=nightly, py=3.11, ubuntu-22.04)
4m 27s
swin (et=0.6.0, py=3.11, macos-15)
2m 44s
swin (et=0.6.0, py=3.11, ubuntu-22.04)
5m 18s
swin (et=nightly, py=3.11, macos-15)
3m 43s
swin (et=nightly, py=3.11, ubuntu-22.04)
6m 13s
11h 44m 19s