# Consolidate, map and normalize data from multiple sources

## Use cases:
- Data integration
- ETL
- IoT

## About this template

With this project you can:
- Migrate data from multiple source systems to Apache Iceberg
- Standardize data formats across different input sources
- Support both streaming and database change data capture (CDC)
- Process data from IoT devices using MQTT and Telegraf
- Maintain data consistency during migration
- Track resource usage with built-in monitoring
- Scale each component independently with containerized deployment

## Using this template

To use this template, fork the [project repo](https://github.com/quixio/data-integration-quix-example), sign up for a Quix account and create a project based on your new fork. For more details, see this [guide to creating a project](https://quix.io/blog/how-to-create-a-project-from-a-template#learn-more-about-setting-up-project-templates).

To write to S3 you’ll need to provide your AWS credentials as application secrets.

Once you’re set up, you can connect it to whatever data sources you like using one of our [connectors](https://quix.io/docs/quix-streams/connectors/sources/index.html#standalone-sources). Then, adapt the normalization logic to fit your data.

## Main project components

## Technologies used