Skip to content

scripts: Remove resolved and obsolete quarantine entries #23403

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 0 additions & 17 deletions scripts/quarantine.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,10 +2,6 @@
# will be skipped if quarantine is used. More details here:
# https://docs.zephyrproject.org/latest/guides/test/twister.html#quarantine

- scenarios:
- net.lib.wifi_credentials_backend_psa
comment: "Fix not known at time of upmerge, temporarily excluded to be fixed after upmerge"

- scenarios:
- sample.nrf7002.shell.otbr
platforms:
Expand All @@ -16,13 +12,6 @@
- native_posix
comment: "native_posix will be removed soon - native_sim platform is the default simulator now"

- scenarios:
- sample.benchmark.coremark.heap_memory
- sample.benchmark.coremark.multiple_threads
platforms:
- [email protected]/nrf54h20/cpuapp
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-31409"

- scenarios:
- sample.matter.light_bulb.aws
platforms:
Expand Down Expand Up @@ -81,9 +70,3 @@
platforms:
- [email protected]/nrf54h20/cpuapp
comment: "Needs alignment to work with MCUBoot"

- scenarios:
- drivers.counter.basic_api
platforms:
- [email protected]/nrf54h20/cpuapp
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-34187"
196 changes: 34 additions & 162 deletions scripts/quarantine_zephyr.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -8,20 +8,6 @@
- sample.libraries.hash_map.newlib.cxx_unordered_map.djb2
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-21219"

- scenarios:
- mcuboot.recovery.retention
- mcuboot.recovery.retention.mem
platforms:
- nrf52840dk/nrf52840
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-24920"

- scenarios:
- mgmt.mcumgr.all.options
- mgmt.mcumgr.all.options.other
platforms:
- nrf52840dk/nrf52840
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-24921"

- scenarios:
- sample.bluetooth.central.multilink
- sample.bluetooth.peripheral_identity
Expand Down Expand Up @@ -61,18 +47,6 @@
- native_sim/native/64
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-24924"

- scenarios:
- sample.ipc.openamp
platforms:
- mps2_an521
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-24926"

- scenarios:
- sample.mcumgr.smp_svr.mcuboot_flags.direct_xip_withrevert
platforms:
- nrf52840dk/nrf52840
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-24927"

- scenarios:
- sample.mgmt.osdp.control_panel
- sample.mgmt.osdp.control_panel_sc
Expand Down Expand Up @@ -115,60 +89,6 @@
- [email protected]/nrf9160
comment: "https://nordicsemi.atlassian.net/browse/NRFX-3813"

- scenarios:
- kernel.timer.timer
platforms:
- nrf52dk/nrf52832
comment: "RAM overflow in NCS specifically - vanilla Zephyr build still fits."

- scenarios:
- drivers.flash.common.default
platforms:
- nrf54l15dk/nrf54l15/cpuapp
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-27852"

- scenarios:
- arch.interrupt.gen_isr_table.riscv_no_direct
platforms:
- [email protected]/nrf54h20/cpuppr
- nrf54l15dk/nrf54l15/cpuflpr
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-27981"

- scenarios:
- sample.net.sockets.big_http_download
- sample.net.sockets.big_http_download.ci
platforms:
- nrf54l15dk/nrf54l15/cpuapp
comment: "to be fixed in https://github.com/zephyrproject-rtos/zephyr/pull/73777"

- scenarios:
- sample.net.sockets.http.server
platforms:
- [email protected]/nrf54h20/cpurad
comment: "to be fixed in https://github.com/zephyrproject-rtos/zephyr/pull/73777"

- scenarios:
- sample.drivers.spi.flash
- sample.drivers.spi.flash_dpd
platforms:
- nrf54l15dk/nrf54l15/cpuapp
comment: "Test not aligned for nrf54l15 but selected due to jedec,spi-nor"

- scenarios:
- llext.*
platforms:
- [email protected]/nrf54h20/cpurad
- nrf52dk/nrf52832
- nrf5340dk/nrf5340/cpunet
- [email protected]/nrf54h20/cpuppr
- nrf54l15dk/nrf54l15/cpuflpr
- qemu_cortex_m3/ti_lm3s6965
comment: "overflow, to report/fix in the upstream @permac and put ticket # here"

- scenarios:
- sample.net.mqtt.nrf70.tls
comment: "To report @chaitanya and put ticket # here"

- scenarios:
- storage.flash_map
platforms:
Expand All @@ -179,29 +99,7 @@
- sample.filesystem.fat_fs.nrf54l15dk
platforms:
- nrf54l15dk/nrf54l15/cpuapp
comment: "Test not aligned for nrf54l15 - missing PM configuration"

- scenarios:
- sample.bluetooth.hci_uart.nrf54l15.all
platforms:
- nrf54l15dk/nrf54l15/cpuapp
comment: "Test not aligned for nrf54l15 - missing snippet settings"

- scenarios:
- net.sockets.tls12.ec_kex
- net.sockets.tls13.ephemeral_kex
- net.sockets.tls13.psk_kex.tickets
- net.sockets.tls13.ephemeral_kex.tickets
platforms:
- native_sim/native
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-30873"

- scenarios:
- drivers.power_domain.build.pm
- drivers.power_domain.build
platforms:
- native_sim/native
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-30877"
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-34573"

- scenarios:
- sample.mcumgr.smp_svr.ram_load.*
Expand All @@ -216,21 +114,6 @@
- nrf5340dk/nrf5340/cpuapp/ns
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-31574"

- scenarios:
- drivers.eeprom.emul.build
platforms:
- [email protected]/nrf54h20/cpuppr
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-31589"

- scenarios:
- llext.writable
- llext.writable_relocatable
- llext.writable_slid_linking
- llext.writable_relocatable_slid_linking
platforms:
- [email protected]/nrf9160
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-31590"

- scenarios:
- drivers.stepper.shell
- drivers.stepper.shell_async
Expand All @@ -252,17 +135,22 @@
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-31671"

- scenarios:
- init.check_init_priorities
- shell.device_filter
platforms:
- native_sim/native
comment: "clash of entropy configurations, will be resolved in upstream (Frank Kvamtro)"
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-34576"

- scenarios:
- init.check_init_priorities
platforms:
- native_sim/native
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-34577"

- scenarios:
- mgmt.mcumgr.fs.mgmt.hash.supported.sha256
platforms:
- nrf54l15dk/nrf54l15/cpuapp
comment: "needs porting, owner not clear"
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-34575"

- scenarios:
- libraries.encoding.jwt.rsa.psa
Expand All @@ -273,41 +161,18 @@
- nrf54l15dk/nrf54l15/cpuapp
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-31783"

- scenarios:
- sample.net.openthread.coprocessor
- sample.net.openthread.coprocessor.usb
- sample.openthread.coprocessor.rcp
platforms:
- nrf52840dk/nrf52840
comment: "Not compatible with NCS. https://nordicsemi.atlassian.net/browse/KRKNWK-20183"

- scenarios:
- bluetooth.shell.shell_br
platforms:
- qemu_cortex_m3/ti_lm3s6965
comment: "https://github.com/zephyrproject-rtos/zephyr/issues/89488"

- scenarios:
- portability.posix.xsi_realtime
- portability.posix.xsi_realtime.minimal
- portability.posix.xsi_realtime.newlib
- portability.posix.xsi_realtime.picolibc
platforms:
- qemu_cortex_m3/ti_lm3s6965
comment: "https://github.com/zephyrproject-rtos/zephyr/issues/89485"

- scenarios:
- drivers.gpio.build
platforms:
- nrf54l15dk/nrf54l15/cpuflpr
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-33288"

- scenarios:
- kernel.scheduler.simple_timeslicing
platforms:
- nrf52dk/nrf52832
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-33279"

- scenarios:
- usb.device_next.build_all
platforms:
Expand Down Expand Up @@ -338,6 +203,12 @@
- nrf54l15dk/nrf54l15/cpuapp
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-34100"

- scenarios:
- examples.nrfx_spim.non_blocking
platforms:
- [email protected]/nrf9160
comment: "https://nordicsemi.atlassian.net/browse/NRFX-8152"

# --------------------------------- Won't fix section -----------------------------------

- scenarios:
Expand All @@ -348,13 +219,6 @@
- nrf54l15dk/nrf54l15/cpuapp
comment: "Won't be fixed - https://nordicsemi.atlassian.net/browse/NCSDK-15508"

- scenarios:
- net.mqtt.tls
platforms:
- [email protected]/nrf9160/ns
- nrf5340dk/nrf5340/cpuapp/ns
comment: "Won't be fixed - https://nordicsemi.atlassian.net/browse/NCSDK-24922"

- scenarios:
- net.socket.register.tls
platforms:
Expand Down Expand Up @@ -585,17 +449,6 @@
- [email protected]/nrf54h20/cpurad
comment: "Won't be fixed, 'rodata will not fit in region FLASH' - no ticket"

- scenarios:
- examples.nrfx_spim.blocking
- examples.nrfx_spim.non_blocking
comment: "Not fixable during upmerge, fix will be included in next upmerge"

- scenarios:
- sample.filesystem.fat_fs.nrf54l15dk
platforms:
- nrf54l15dk/nrf54l15/cpuapp
comment: "partition manager configuration need to be fixed/provided"

- scenarios:
- drivers.hwinfo.api
platforms:
Expand Down Expand Up @@ -644,3 +497,22 @@
platforms:
- [email protected]/nrf54h20/cpuppr
comment: "https://nordicsemi.atlassian.net/browse/NCSDK-34011"

- scenarios:
- llext.*
platforms:
- [email protected]/nrf54h20/cpurad
- nrf52dk/nrf52832
- nrf5340dk/nrf5340/cpunet
- [email protected]/nrf54h20/cpuppr
- nrf54l15dk/nrf54l15/cpuflpr
- qemu_cortex_m3/ti_lm3s6965
comment: "https://github.com/zephyrproject-rtos/zephyr/issues/74536 - overflow"

- scenarios:
- sample.net.openthread.coprocessor
- sample.net.openthread.coprocessor.usb
- sample.openthread.coprocessor.rcp
platforms:
- nrf52840dk/nrf52840
comment: "Not compatible with NCS. https://nordicsemi.atlassian.net/browse/KRKNWK-20183"