Optimizing Data Storage with Pentaho Data Storage Optimizer

 Hi there! Do you need help managing your company's growing data? More information on your systems makes it more challenging to manage storage costs, assure compliance, and stay viable. What if there was a clever data beast-taming solution? Look at this: Pentaho's Data Storage Optimizer simplifies data management to optimize storage and reduce risk.

This helpful application automatically detects, analyzes, and tags structured, semi-structured, and unstructured cloud and on-prem data. Since data value changes over time, it can automate management based on current value and usage. The optimizer uses policy-based governance to cut costs, improve storage infrastructure, and meet service-level needs. Offloading inactive data helps your sustainability aims.

Pretty nice, huh? Pentaho's Data Storage Optimizer provides a unified, intelligent data storage management solution—the smart choice for performance, cost, compliance, and continuity. You now control your data instead of it controlling you. Continue reading!

Pentaho Data Integration - Get file names step

 The Get Filenames step allows you to retrieve information associated with filenames in the file system. The obtained file name is added to the stream as a line. Search for files using wildcard (RegExp) fields

 Stepwise illustration on how to use "Get file names" step given below.

Pentaho Data Integration - Community Edition Install for Mac

 Pentaho is an end-to-end data integration and analytics platform designed to manage data at scale for rapid business innovation, ease of use, and self-service automation and orchestration. Pentaho tightly ties data integration and business analytics in a modern platform that connects IT and business users to access, visualize, and explore all the data that impacts business outcomes. Pentaho Kettle enables IT and developers to integrate data from different sources and deliver it to business applications. 

Step wise illustration on how to install Pentaho Data Integration community edition 9.3.0.0 is given below.

Pentaho Data Integration - PDI 7.0 Installation for Windows 64 bit

Pentaho 7 is the latest Pentaho version with powerful features including enhanced big data security features and advanced data exploration functionality.

Step wise illustration on how to install Pentaho Data Integration 7 is given below.

Here are some of the highlights of the new version.

• Inspect Data in the Pipeline.
• Advanced Security features for Bigdata including Kerberos.
• Integrated installation of Business Analytics (BA) and Data Integration (DI) components.
• Spark submit job entry for scala and python.
• Expanded Metadata Injection Support.

Pentaho Data Integration : Aggregation using Group By step

This step can be used to perform various types of aggregations such as sum, average, min, max e.t.c. Input data always need to be sorted for this step to work properly.

This step support following aggregation methods.

1. Sum
2. Average or Mean

Pentaho Data Integration - Data Grid Input step

This step generally used for testing, reference or demo purposes. We can create a static rows in a grid.

• Meta tab : Enter field names and meta data info.
• Data tab : Enter static data in a grid.

Here are the step wise illustrations on how to use Data Grid step.

Pentaho Common Errors : Error converting data while looking up value

Error Message

Stream lookup.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : Unexpected error
Stream lookup.0 - ERROR (version 5.4.0.1-130, build 1 from 2015-06-14_12-34-55 by buildguy) : org.pentaho.di.core.exception.KettleStepException:
Stream lookup.0 - Error converting data while looking up value
Stream lookup.0 -