More than 100 roles will cause RLS role dropdown and API not showing all roles

[ziggekatten]

Bug description

As per discussion: #31439

There seems to be an hard limit on number of roles returned in API as well as the dropdown in Row Level Security form

I have tried to find this in the code, but with no luck

Screenshots/recordings

No response

Superset version

4.0.2

Python version

3.10

Node version

I don't know

Browser

Chrome

Additional context

I'm using official docker image

Checklist

• I have searched Superset docs and Slack and didn't find a solution to my problem.
• I have searched the GitHub issue tracker and didn't find a similar bug report.
• I have checked Superset's logs for errors and if I found a relevant Python stacktrace, I included it here as text in the "additional context" section.

[dosubot]

I found a similar unsolved discussion titled "RLS do not show all roles in dropdown" on GitHub, which might be related to the issue you're experiencing ^[1].

Regarding the issue of a hard limit on the number of roles returned by the API and displayed in the dropdown, it seems that the AsyncSelect component is involved in fetching roles. This component uses pagination parameters such as page and pageSize, with a default pageSize of 10 ^[2]. However, there is no specific information available about a hard limit of 100 roles in the backend or in the superset_config.py file.

To address this issue, you might want to investigate the backend code handling the /api/v1/rowlevelsecurity/related/roles endpoint for any pagination logic or limits. Additionally, reviewing the superset_config.py file for any settings related to API pagination or limits could be helpful, although no specific settings were found in the available information.

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other}

[rusackas]

That's a lot of roles! I don't doubt the bug, but I'm curious the use case. I also see you opened a discussion as well... can we close one or the other so there's not a duplicate conversation?

[ziggekatten]

Very simple use case: 200+ contracts with varying data sources as well as shared data sources (hence the RLS)

[rusackas]

Is this still an issue in the current CRUD view? I think the UI was updated quite a bit lately, so I'm not sure if you'll still have this issue and I certainly don't have that many roles :D

[ziggekatten]

Yep, still an issue in 4.1.2