Friday, November 25, 2022

Pentaho Data Integration - Get file names step

 The Get Filenames step allows you to retrieve information associated with filenames in the file system. The obtained file name is added to the stream as a line. Search for files using wildcard (RegExp) fields

 Stepwise illustration on how to use "Get file names" step given below.

Configure File tab

Enter directory name and click add.

Enter ".*.csv" as RegExp Wildcard to get only CSV files.

Configure Filter tab

Select "All Files" to get both files and folders.

Preview Rows

Execution and Results

Complete the flow by adding a dummy step and execute transformation.

2022/11/24 23:57:41 - Spoon - Running transformation using the Kettle execution engine
2022/11/24 23:57:41 - Spoon - Transformation opened.
2022/11/24 23:57:41 - Spoon - Launching transformation [Untitled]...
2022/11/24 23:57:41 - Spoon - Started the transformation execution.
2022/11/24 23:57:41 - Untitled - Dispatching started for transformation [Untitled]
2022/11/24 23:57:41 - Get file names.0 - Finished processing (I=0, O=0, R=0, W=13, U=0, E=0)
2022/11/24 23:57:41 - Dummy (do nothing).0 - Finished processing (I=0, O=0, R=13, W=13, U=0, E=0)
2022/11/24 23:57:41 - Spoon - The transformation has finished!!

Results :

No comments:

Post a Comment