When we use the tmap Function is allowed 100 rows in the one CSV file upload the data in the MySQL database on the particular table, when we use that table of one column is (int "Auto increment") column. How to solve this insert data in database, i have attached the sample screen shot.
We need to insert the All records into the database.
You probably have a join or a filter in the tMap.
That could be the reason why you have less rows on the output side than on the input side.
Yeah we use the JOIN in tmap, i attached the Screen flow but we create in the database in that particular table we use "Auto increment " in on column, only 100 rows inserted into that table.
Can you guide me the further process,
In Database , we use the one column structure
| salesorderid | int(11) | NO | PRI | NULL | auto_increment |
As you can see from your 1st image, only 100 rows come out from the tMap which means 45 rows don't match with the join condition.
In this case, these rows are rejected and only 100 are pushed to the database.
Its maybe after get 100 rows its auto commit , then after 45 rows is reject when check the database .
But we used commit after the "OnComponentOk" only .
Once again, you have only 100 rows on the tMap output flow which means 45 rows are rejected by the inner join in your tMap.
No other reason to look after.
Yes i accept that , but first time we need insert the all records 145 rows in database,and lookup i check the every row record in the database table . Now no data in that particular table so we insert the all data ,but after every 100 rows data is rejected . why reject after 100 Rows data ,i don't understand that flow ??
I check the another data file also same thing happen.
First time only we insert the all data . can you guide me why correctly 100 rows only accept and other data is reject .
we checked only database in lookup . can you guide me
What's the content of the temp_salesorder_list table?
What's the content of the OD_FILE file?
What's the configuration of the tMap?
Content of the temp_salesorder_list table:
"SELECT distinct(salesorderNo) FROM temp_salesorder_list where salesorderNo='"+((String)globalMap.get("OrderNumber"))+"' and fileName ='"+((String)globalMap.get("FileName"))+"'"
content of the OD_FILE file:
1115|In - INDIA|0000001115|5100408707|20171021|124540|ZOR1|1000|02|0006490025|TEST NAME|SP 7/1476, OUYH|PLCADE|691581|11|INDIA|1115|606|TS41|INDIA|010001|Interior|0100010172|GOLD|000000017210101000|10 L WHITE|10.000|1.000|1975.00
5100408707 - salesorderNo
configuration of the tMap :
below 100 row data is insert successfully,
i don't know how to figure that , i try another file for example also
I try that its return only 2 rows .
mysql> select * from temp_salesorder_list\G
Empty set (0.24 sec)
(100 below OR equal 100 rows ) before we Lookup the database (We check monitored), check 0 rows return
(100 rows )After we Lookup the database (We check monitored) ,check 1 rows return
I share the before pictures return 1 rows from the Lookup (temp_salesorder_list) ,it database we never insert the exit data.
Empty set (0.24 sec) --- No data
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Watch the recorded webinar!
Part 2 of a series on Context Variables
Learn how to do cool things with Context Variables
Find out how to migrate from one database to another using the Dynamic schema