8000 Figure out how to use RetryHelper in insertAll · Issue #470 · googleapis/google-cloud-java · GitHub
[go: up one dir, main page]

Skip to content

Figure out how to use RetryHelper in insertAll #470

@mziccard

Description

@mziccard

Right now bigquery.insertAll does not use RetryHelper. Retrying a failed insertAll operation might insert duplicates into the table unless an ID is associated to each row.

We have 2 options here:

  1. Use RetryHelper and document that unless row IDs are used, duplicates might be inserted
  2. Use RetryHelper and when retrying add a randomUUID() to all rows that have no ID specified

It is worth noting that BigQuery duplicate detection based on row ID is best effort. Opinions/suggestions are welcome!

/cc @jtigani

Metadata

Metadata

Assignees

Labels

api: bigqueryIssues related to the BigQuery API.priority: p2Moderately-important priority. Fix may not be included in next release.triaged for GAtype: feature request‘Nice-to-have’ improvement, new feature or different behavior or design.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions

    0