Is it possible to do a NLP like extraction using Data Integration tool

Four Stars

Is it possible to do a NLP like extraction using Data Integration tool

Hi All,

I want to know whether NLP like extraction is possible with Talend Data Integration tool.

My requirement is as follows:

In an excel sheet ,I have a column named 'Description'. It is a lengthy string giving details about a product.

I have a column in DB,named 'Product Type'. Product Type can have values like Product1,Product2,Product3 etc.

I need to analyse the 'Description' field in the excel sheet and find out whether a value like Product1 or Product2 or Product3 is available in that .If its present,extract the value and populate the 'Product Type' column in DB.

 

Please help me to figure out the feasibility of doing  such a task using Talend DI.

Thanks,

Sreedevi

 

Four Stars

Re: Is it possible to do a NLP like extraction using Data Integration tool

of corse, u can do it.

u could use the   equals or conten Equals function to realize this.

Fifteen Stars TRF
Fifteen Stars

Re: Is it possible to do a NLP like extraction using Data Integration tool

IMHO, using just "equals" or "contains" methods may be a little restrictive compared from what you can expect from a NLP method.

I suggest you to include Stanford CoreNLP (or other NLP engine) in your project if you want to take advantage of a real natural language analysis tool.


TRF
Four Stars

Re: Is it possible to do a NLP like extraction using Data Integration tool

Thanks all.

 

Sreedevi

Fifteen Stars TRF
Fifteen Stars

Re: Is it possible to do a NLP like extraction using Data Integration tool

@sreedevi_s, let us know if it helps and what's the next step for your usecase

TRF
Four Stars

Re: Is it possible to do a NLP like extraction using Data Integration tool

Hi,

Yes.It helped to get an idea about the steps to follow.I created a lookup table with possible values and merged it in tmap.

Thanks,

Sreedevi

 

 

15TH OCTOBER, COUNTY HALL, LONDON

Join us at the Community Lounge.

Register Now

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

Agile Data lakes & Analytics

Accelerate your data lake projects with an agile approach

Watch