Pentaho Data Integration - Get file names step

 The Get Filenames step allows you to retrieve information associated with filenames in the file system. The obtained file name is added to the stream as a line. Search for files using wildcard (RegExp) fields

 Stepwise illustration on how to use "Get file names" step given below.

Pentaho Data Integration - Community Edition Install for Mac

 Pentaho is an end-to-end data integration and analytics platform designed to manage data at scale for rapid business innovation, ease of use, and self-service automation and orchestration. Pentaho tightly ties data integration and business analytics in a modern platform that connects IT and business users to access, visualize, and explore all the data that impacts business outcomes. Pentaho Kettle enables IT and developers to integrate data from different sources and deliver it to business applications. 

Step wise illustration on how to install Pentaho Data Integration community edition 9.3.0.0 is given below.

Pentaho Data Integration - PDI 7.0 Installation for Windows 64 bit

Pentaho 7 is the latest Pentaho version with powerful features including enhanced big data security features and advanced data exploration functionality.

Step wise illustration on how to install Pentaho Data Integration 7 is given below.

Here are some of the highlights of the new version.

• Inspect Data in the Pipeline.
• Advanced Security features for Bigdata including Kerberos.
• Integrated installation of Business Analytics (BA) and Data Integration (DI) components.
• Spark submit job entry for scala and python.
• Expanded Metadata Injection Support.

Pentaho Data Integration : Aggregation using Group By step

This step can be used to perform various types of aggregations such as sum, average, min, max e.t.c. Input data always need to be sorted for this step to work properly.

This step support following aggregation methods.

1. Sum
2. Average or Mean

Pentaho Data Integration - Data Grid Input step

This step generally used for testing, reference or demo purposes. We can create a static rows in a grid.

• Meta tab : Enter field names and meta data info.
• Data tab : Enter static data in a grid.

Here are the step wise illustrations on how to use Data Grid step.

Pentaho Common Errors : Error converting data while looking up value

Error Message

Stream lookup.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : Unexpected error
Stream lookup.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : org.pentaho.di.core.exception.KettleStepException:
Stream lookup.0 - Error converting data while looking up value
Stream lookup.0 -

Pentaho Data Integration - CSV File Input with parallel execution enabled

CSV file input is a commonly used input step to read delimited files. Options are similar to text file input steps. Here are the general configurable options.

1. File name - Input file name.
2. Delimiter - Support common delimiters like coma, tab, pipe e.t.c
3. Enclosure - Optional enclosures like double quotes.
4. NIO buffer size - Read buffer size.
5. Lazy Conversion - Significant performance improvement by avoiding data type conversions. Check this option only if the logic is mere pass through.