Harnessing the data deluge with automated data preparation.
A week’s worth of manual data preparation in minutes.
The Problem
Data Preparation
Data preparation can take 80% of a data scientist’s time. Preparing data for analysis is so time consuming as it involves specification and coordination of several data selection, integration and cleaning steps.
Programming
Preparing data is essentially a software development activity, that involves writing transformation scripts, configuring components, and connecting these components together.
Commercial Tools
Data preparation tools typically support data scientists by providing a visual programming interface and a library of components. However, both tactical and fine-grained decisions remain with the data scientist.
Describe what you need
Provide data sources, a target structure, quality priorities and example data. The target structure and quality priorities make explicit what you need, and the example data provides evidence that is used by Data Preparer to clean and integrate the data from the sources.
Hand over to Data Preparer
Data Preparer explores how the data sources relate to each other and the target, and populates the target from the sources. In populating the target, data preparer explores different ways in which the sources can be combined, and can reformat data to increase consistency.
Refine the result
Provide feedback on the automatically produced result or revise priorities, and Data Preparer will derive a new result. Data Preparer provides provenance information so that it is clear how every result entry has been produced, and allows you to refine how the data is produced without the need for programming.
Coming Soon ...
A free trial version of Data Preparer will be available for download from this site from 1st September 2019.