- spark session object
- metadata object
- additional parameters
Used by streaming query to add a datframe to hive acid table.
Used by streaming query to add a datframe to hive acid table.
- dataframe to insert
- transaction Id
Delete rows from the table based on condtional
expression.
Delete rows from the table based on condtional
expression.
Note: This API is transactional in nature.
- Boolean SQL Expression filtering rows to be deleted
Delete rows from the table based on condtional
boolean expression.
Delete rows from the table based on condtional
boolean expression.
Note: This API is transactional in nature.
- Boolean SQL Expression filtering rows to be deleted
Return an RDD on top of Hive ACID table
Return an RDD on top of Hive ACID table
- columns needed
- filters that can be pushed down to file format
- read conf
- metadata object
Appends a given dataframe df into the hive acid table
Appends a given dataframe df into the hive acid table
Note: This API is transactional in nature.
- dataframe to insert
Optional. In a same transaction, multiple statements like INSERT/UPDATE/DELETE (like in case of MERGE) can be issued. statementId has to be different for them to ensure delta collision is avoided for them during writes.
Overwrites a given dataframe df onto the hive acid table
Overwrites a given dataframe df onto the hive acid table
Note: This API is transactional in nature.
- dataframe to insert
Optional. In a same transaction, multiple statements like INSERT/UPDATE/DELETE (like in case of MERGE) can be issued. statementId has to be different for them to ensure delta collision is avoided for them during writes.
Returns true if the table is an insert only table
- additional parameters
Create dataframe to read based on hiveAcidTable and passed in filter.
Create dataframe to read based on hiveAcidTable and passed in filter.
Dataframe
- spark session object
Update rows in the hive acid table based on condition and newValues
Update rows in the hive acid table based on condition and newValues
Note: This API is transactional in nature.
- Optional condition string to identify rows which needs to be updated, if not specified then it means complete table.
- Map of (column, value) to set
Update rows in the hive acid table based on condition and newValues
Update rows in the hive acid table based on condition and newValues
Note: This API is transactional in nature.
- condition string to identify rows which needs to be updated
- Map of (column, value) to set
Represents a hive acid table and exposes API to perform operations on top of it