Data Conveyer Tutorial

In this short tutorial, we will work on a simple application to transform text data. The tutorial consists of 5 lessons, which can all be finished in as little as 30 minutes. While the 1st lesson may require about 10 minutes, the remaining lessons can generally be completed in about 5 minutes each. Every new lesson picks up where the prior lesson left off.

You will be able to follow the steps of this tutorial using Visual Studio 2012 or above. Illustrations were taken using Visual Studio 2017. All code samples are written in C#. Note that other .NET languages, such as VB.NET, can be used as well.

While following the steps of this tutorial, you will find its accompanying GitHub repository helpful. It contains both C# code samples as well as input data. You can download a zip archive of this repository here.

In these 5 lessons, we have barely scratched the surface of functionality offered by Data Conveyer. Among many other features, Data Conveyer supports:

  • Various kinds of inputs and outputs, not just files, but any kind of streams of text data.
  • Multiple sources and targets with custom merging and routing.
  • Flexible rules for record parsing, filtering, transforming, and formatting.
  • Record clustering into families of related records, so that the entire family/cluster can be transformed as a unit.
  • Variety of transformation patterns.
  • Parallel Processing to take advantage of multi-processor architectures.
  • Buffering (“backpressure” handling) to control the memory use.
  • … and more.

To learn more, please contact us for additional information.