0.12.0 (2022-10-14)
New Features
- Added new APIs for async job:
Session.create_async_job()
to create anAsyncJob
instance from a query id.AsyncJob.result()
now accepts argumentresult_type
to return the results in different formats.AsyncJob.to_df()
returns aDataFrame
built from the result of this asynchronous job.AsyncJob.query()
returns the SQL text of the executed query.
DataFrame.agg()
andRelationalGroupedDataFrame.agg()
now accept variable-length arguments.- Added parameters
lsuffix
andrsuffix
toDataFram.join()
andDataFrame.cross_join()
to conveniently rename overlapping columns. - Added
Table.drop_table()
so you can drop the temp table afterDataFrame.cache_result()
.Table
is also a context manager so you can use thewith
statement to drop the cache temp table after use. - Added
Session.use_secondary_roles()
. - Added functions
first_value()
andlast_value()
. (contributed by @chasleslr) - Added
on
as an alias forusing_columns
andhow
as an alias forjoin_type
inDataFrame.join()
.
Bug Fixes
- Fixed a bug in
Session.create_dataframe()
that raised an error whenschema
names had special characters. - Fixed a bug in which options set in
Session.read.option()
were not passed toDataFrame.copy_into_table()
as default values. - Fixed a bug in which
DataFrame.copy_into_table()
raises an error when a copy option has single quotes in the value.