Saturday, September 19, 2015

Pentaho Data Integration - Data Grid Input step

This step generally used for testing, reference or demo purposes. We can create a static rows in a grid.

  • Meta tab : Enter field names and meta data info.
  • Data tab : Enter static data in a grid.

Here are the step wise illustrations on how to use Data Grid step.

Pentaho Common Errors : Error converting data while looking up value

Error Message

Stream lookup.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : Unexpected error
Stream lookup.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : org.pentaho.di.core.exception.KettleStepException:
Stream lookup.0 - Error converting data while looking up value
Stream lookup.0 -

Pentaho Data Integration - CSV File Input with parallel execution enabled

CSV file input is a commonly used input step to read delimited files. Options are similar to text file input steps. Here are the general configurable options.

  1. File name - Input file name.
  2. Delimiter - Support common delimiters like coma, tab, pipe e.t.c
  3. Enclosure - Optional enclosures like double quotes.
  4. NIO buffer size - Read buffer size.
  5. Lazy Conversion - Significant performance improvement by avoiding data type conversions. Check this option only if the logic is mere pass through.