Import Pipeline
Data import/export automation for e-commerce
Role
Automation developer
Year
2020
Stack
Node.jsPHPMySQLREST APICron
The task
An online store was updating its catalog by hand: prices from supplier spreadsheets, stock from emails, marketplace listings one by one. Every update took days and produced errors that cost real money.
Stages
Feed normalization
Parsers for heterogeneous supplier formats (XML, CSV, XLSX) with validation, deduplication and category mapping into one canonical model.
Sync engine
Scheduled incremental sync with change detection: only touched records hit the database, with rollback on failed batches.
Reporting
Every run produces a human-readable report: what changed, what was skipped and why — trust in the data came back.
The results
products synced automatically
per update, down from days
manual data-entry errors