I'm having issues trying to insert the output of a tMap component to a BigQuery table using the tBigQueryOutput component. It appears that the tBigQueryOutput component checks for every field passed by the tMap for null and this comes to an error when a field is of type int in my case. Is there any way to solve/modify this behavior?
Could you please also post your tMap editor screenshot into forum? Which will be helpful for us to understand your setting in tMap.
Currently I've solved the issue by changing the field type to String, but it's not what I'd like to leave as a solution since I may need to make some other modification in the ETL when receiving this output. I've attached the screenshots you've requested, take in consideration that I've highlighted the changes I've made in order for the job to work, all strings were int type fields.
With int, null is not allowed.
Schemas allow you to specify if a column is nullable. This usually determines if it is an int or an Integer. You need to make it nullable.
Ok, so if I understand correctly I either have to mark the field as nullable which is not something I actually want to allow or i have to assign a default value before the data gets into the tMap component? I'll check either approach and see which one is better for our task. Anyway, thank you all for your help, it's really appreciated.
Yeah, that's what I thought as well, but given the circumstances I think I'll go by trying to feed the data to the tMap component with "null integers" as zero.