Key Requirements: Load hundreds of thousands of records weekly, spread across grouped files, and process for insights.
Delivered: SSIS package suite designed in free Visual Studio Community Edition using SSDT.
It was not feasible for administrators to continually use SQL Server Import Wizard as this leads to inconsistencies – and easy potential errors are not easy to spot, especially with many date formatted critical fields.
We installed Visual Studio and latest version of SSDT (SQL Server Data Tools) and designed a suite of full import packages including workflows, base character translations, data transformations and error handling. A user could then follow clear single-click type instructions and review the reports generated by SSIS to ensure correct loading.
Data Inspection & Analysis
Text and Excel CSV integration
SSIS – SQL Server Integration Services
SSDT – SQL Server Data Tools (module for Visual Studio, works on free Community Edition)
Visual Studio package design, workflow and deployment
Documented user instructions for single click processing
Useful report generation to ensure correct operation