1 week Ago By Sakshi Sadashiv K
Explainer Briefly Slides Delhivery, one of India’s largest third-party logistics providers, has completed a major data migration project, moving over 500 TB of critical data from the US East (Northern Virginia) Region to the Asia Pacific (Mumbai) Region. India’s newly enacted Digital Personal Data Protection (DPDP) Act drove this migration. The law requires companies to store sensitive data within Indian borders.
How Did Delhivery Complete Data Migration? Delhivery, which services over 18,000 pin codes across India, has grown exponentially in recent years, with its data lake powering business and analytics applications. However, with India’s DPDP Act mandating data residency within the country, Delhivery had to migrate over 70 million objects to AWS Regions in India. To meet this compliance requirement, Delhivery partnered with Amazon Web Services (AWS) to migrate its vast data infrastructure to the Asia Pacific (Mumbai) region.
The migration process involved the use of Amazon S3 Cross-Region Replication (CRR) and S3 Batch Operations, tools that allowed Delhivery to replicate data in near real-time and transfer historical data. Delhivery claims that no data was lost during the transfer. What are AWS regions and how do they work? AWS Regions refer to geographic locations around the world where Amazon Web Services (AWS) data centres are located.
Each region consists of multiple, isolated locations known as Availability Zones . These zones are designed to be independent, ensuring high availability and fault tolerance. Users can deploy their applications across multiple zones for enhanced resilience.
To manage the large-scale migration, Delhivery used AWS’s cloud capabilities, including Amazon S3 CRR and S3 Batch Operations. These tools ensured minimal disruption to operations while executing data replication. Delhivery’s existing data infrastructure included over 800 data pipelines, processing 60,000 messages per second.
The system ingested 350 GB of data daily. Compliance with India’s Digital Personal Data Protection (DPDP) Act, 2023 The DPDP Act, enacted in 2023, mandates that all critical personal data of Indian citizens must be stored within India’s geographical boundaries. The Act mandates rules on how organizations handle people’s personal data.
It requires companies to keep certain types of data within India. This ensures that Indian citizens’ data stays within the country’s borders. The DPDP Act is part of India’s efforts to comply with data privacy protections and control over personal data.
Organisations like Delhivery handle large volumes of personal data. They must comply with the act to continue operating in the country. Concerns around DPDP Act, 2023 The DPDP Act introduced several concerns, including the government’s broad powers to exempt itself from the law.
The bill allows the scraping of publicly available personal data and gives the government power to block content. It imposes a compliance burden on companies processing data and lacks clarity on data breach safeguards. Furthermore, it could also undermine the RTI Act.
As India and other nations introduce more data protection laws, this migration highlights a growing trend where technology must adapt to comply with national regulations to maintain operations. Read More:.
