We’re attempting to use the write_bigquery method to write our pipeline results to BQ. We have an existing table (with the write modes that make sense to use). How can we ensure that the write modes (NULLABLE, REQUIRED … ) inferred from the data? Currently the ray inferred mode is NULLABLE for all fields which is not compatible for our tables. Any suggestions would be super appreciated!
If this is not currently possible, what is the recommend way to introduces our own writes. I see the Datasink Interface, would that be it?