Is there any function that I can turn polars.LazyFrame
or polars.Expr
into daft.LazyFrame
or daft.Expr
?
#4916
Answered
by
universalmind303
baiguoname
asked this question in
Q&A
-
This function is very powerful for those coming from |
Beta Was this translation helpful? Give feedback.
Answered by
universalmind303
Aug 6, 2025
Replies: 1 comment
-
@baiguoname, to convert to/from polars, it will require a full materialization via # polars to daft
df = pl.scan_parquet('...')
# some df operations
df = df.collect()
daft_df = daft.from_arrow(df.to_arrow())
# daft to polars
df = daft.read_parquet('...')
# some daft operations
df = df.collect()
pl_df = pl.from_arrow(df.to_arrow()) We do not have plans on supporting conversions between polars <-> daft logical plans (LazyFrame) and expressions |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
universalmind303
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
@baiguoname, to convert to/from polars, it will require a full materialization via
.collect
in both libraries. Once materialized, you can use arrow to convert between the two at very little costWe do not have plans on supporting conversions between polars <-> daft logical plans (LazyFrame) and expressions