Database Archival Process

The Database Archival Process project is designed to efficiently manage large datasets by retaining only the last five years of active records in the primary database. Older data is archived in Azure Storage, ensuring that the main database remains optimized and manageable. To facilitate smooth data management, the database is partitioned by year, allowing for more organized and streamlined archival and retrieval processes. A PowerShell script automates year-based partitioning, transfers data to Azure Storage using the BCP utility, and ensures the seamless movement of data between the storage and the main database as needed. This solution not only simplifies data handling but also enhances the overall performance of the primary database by reducing its size. When archived data is required, the system allows for quick retrieval, ensuring that access to older records is still efficient. The process helps maintain the integrity of the database while optimizing storage costs and performance, making it an essential solution for managing large-scale datasets.