Source: Srinivasan Software Solutions Blog

Srinivasan Software Solutions Blog Loading data from multiple files into single file in talend

Here we use components named tfilelist,tfileinputdelimited,tmap, tfileoutputdelimited We connect all the components as shown below        Here in tfile list we will be giving path where the files folder is present which has multiple files and we will be navigating the path. Then select set of files will be iterated from these tfilelist. Each and every file will be iterated means (copied one by one) to the tfileinputdelimited. àIn tfileinputdelimited we use the global variable to pass the path in the tfileinputdelimited. This global variable will be taken from out line which is present in the left to the tool as shown below So the path will be given in the tfileinputdelimited will be taken from the tfilelist and we will give a connection named iterate so each of the file one by one will be loaded into the  tfileinputdelimited and again it will get sent to tmap. In tmap we will take all the columns which are present in the file and map it to the target. From there we will take the out put delimited file that i.e tfileoutputdelimited. Where we get the data which is present in three of the files in to a single file(I took output file in CSV format but we can take out put in any of the format like txt etc...    

Read full article »
Est. Annual Revenue
$100K-5.0M
Est. Employees
25-100
Rangarajan Kandadai's photo - Managing Director of Srinivasan Software Solutions

Managing Director

Rangarajan Kandadai

CEO Approval Rating

- -/100

Read more