Used by streaming query to add a datframe to hive acid table.
Used by streaming query to add a datframe to hive acid table.
- dataframe to insert
- Transaction under which the operation is being done
Delete rows from the table based on condtional
expression.
Delete rows from the table based on condtional
expression.
Note: This API is transactional in nature.
- Boolean SQL Expression filtering rows to be deleted
- Transaction under which DELETE will be performed
Return an RDD on top of Hive ACID table
Return an RDD on top of Hive ACID table
- columns needed
- filters that can be pushed down to file format
- read conf
- current Transaction under which ead will be done
Appends a given dataframe df into the hive acid table
Appends a given dataframe df into the hive acid table
Note: This API is transactional in nature.
- dataframe to insert
- current transaction underwhich INSERT operation needs to run.
Optional. In a same transaction, multiple statements like INSERT/UPDATE/DELETE (like in case of MERGE) can be issued. statementId has to be different for them to ensure delta collision is avoided for them during writes.
Overwrites a given dataframe df onto the hive acid table
Overwrites a given dataframe df onto the hive acid table
Note: This API is transactional in nature.
- dataframe to insert
- current transaction under which insertOverWrite need to be run
Optional. In a same transaction, multiple statements like INSERT/UPDATE/DELETE (like in case of MERGE) can be issued. statementId has to be different for them to ensure delta collision is avoided for them during writes.
Merge from sourceDf to the current Table
Delete dataframe of rows specified by MERGE Delete statement
Delete dataframe of rows specified by MERGE Delete statement
dataframe of rows specified by MERGE Delete statement
Transaction under which this operation will be performed
Specify Statement Id, for multi operation command like Merge statement Id need to be unique for every operation
Update dataframe with updated rows specified by MERGE update statement
Update dataframe with updated rows specified by MERGE update statement
- Dataframe with updated rows specified by MERGE update statement
- Transaction under which this operation will be performed
- Specify Statement Id, for multi operation command like Merge statement Id need to be unique for every operation
Update rows in the hive acid table based on condition and newValues
Update rows in the hive acid table based on condition and newValues
Note: This API is transactional in nature.
- condition string to identify rows which needs to be updated
- Map of (column, value) to set
Delegate to perform ACID operations: UPDATE/DELETE/INSERT/READ These APIs are not protected under Transactions, however most of them may need transactions to be already open.