Five Stars

Spark Dynamic Context

Hi Team

 

I have a scenario like i need to map input and output columns

but my input column names always varies

For example First time when i read the  field names could be like

First_Name->FirstName

Last_Name->LastName

second time the feilds could be like

FName->FirstName

SName->LastName

Third Time it could be like 

FN->FirstName

LN->LastName

 

which means what ever may be the input column i could be able to map with output columns

Can you please help out with this

 

Thanks

Deepthi

 

2 REPLIES
Six Stars

Re: Spark Dynamic Context

are you reading from a file or database table?

Five Stars

Re: Mapping Dynamic Schema to a Fixed Destination Schema

From File