Added
- Added
error_log_file_path
parameter inBCPTask
that enables setting name of errors logs file - Added
on_error
parameter inBCPTask
that tells what to do if bcp error occurs. - Added error log file and
on_bcp_error
parameter inADLSToAzureSQL
- Added handling POST requests in
handle_api_response()
add added it toEpicor
source. - Added
SalesforceToDF
task - Added
SalesforceToADLS
flow - Added
overwrite_adls
option toBigQueryToADLS
andSharepointToADLS
- Added
cast_df_to_str
task inutils.py
and added this toEpicorToDuckDB
,SAPToDuckDB
,SQLServerToDuckDB
- Added
if_empty
parameter inDuckDBCreateTableFromParquet
task and inEpicorToDuckDB
,SAPToDuckDB
,
SQLServerToDuckDB
flows to check if output Parquet is empty and handle it properly. - Added
check_if_empty_file()
andhandle_if_empty_file()
inutils.py