Loading multiple files to BigQuery using tfileList

One Star

Loading multiple files to BigQuery using tfileList

Hi,
I Have few txt files in a folder having different schemas, I am using tfilelist component to load all the files in the Google BigQuery using tBigQueryOutput component.
How can i define schema for this component as it does not support dynamic schema?
I have schema for all the files in the repository.
Is there any way to do it?

Moderator

Re:Loading multiple files to BigQuery using tfileList

Hi,
Could you load multiple files with different schema structure into tFileOutputDelimited first then migrating data from one .csv file(tFileInputFullRow) to tBigQueryOutput component?
Best regards
Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re:Loading multiple files to BigQuery using tfileList

Hi Sabrina,
Thanks for the reply will definitely try the same

Moderator

Re:Loading multiple files to BigQuery using tfileList

Hi,

Feel free to let me know if it is OK with you.
Best regards
Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.