SQL Data Sync Retirement: Migration Insights and Modern Alternatives
What began as an ordinary chat with a customer turned into a significant discussion about modernising their systems. A long-standing service, which had seamlessly managed critical business data for years, is now nearing its end. This raises a crucial question: What should companies do next?
Every time a service comes to an end, it presents a chance to revisit the architecture, lessen the technical burden, and prepare for the future.
Recently, while collaborating with a client, we took a closer look at their Azure SQL Database setup and noticed a key reliance on SQL Data Sync.
This service had reliably facilitated data synchronisation across various databases, supporting applications, reporting tasks, and distributed processes.
Like many companies, our customer viewed Data Sync as an unnoticeable infrastructure component. However, our conversation took a pivotal turn when we examined Microsoft’s announcement about its retirement:
Azure SQL Data Sync will be retired on September 30, 2027.
What seemed to be a challenging migration issue quickly transformed into a chance to upgrade the client’s data movement strategy, aligning it with Microsoft’s forthcoming investments in data integration, analytics, and cloud-native services.
Azure SQL Data Sync was designed to synchronise specific data between Azure SQL Databases and sometimes even between Azure and on-premises databases.
Organisations commonly used Data Sync for:
- Hybrid data synchronisation
- Distributed application frameworks
- Globally distributed applications
- Bi-directional data synchronisation
While the service has been dependable for many, organisations should start contemplating alternative solutions to allow ample time for planning, testing, and smooth transitions before the shutdown.
Given that both databases were already hosted on Azure, our focus shifted towards pinpointing strategic alternatives.
Customer’s Configuration
This particular client maintained a straightforward configuration: one Azure SQL Database linked to another, both entirely on Azure, using SQL Data Sync. There were no on-premises complexities—just two cloud databases that needed to remain synchronised.
Their needs were equally clear-cut, resembling what many teams typically request:
- Reliable, consistent synchronisation
- Minimal operational overhead — nobody desired a new system requiring constant supervision
- A long-term solution, not just another service on a retirement list
- Scalability as data volumes increase
- An Azure-native solution, not an external tool
Since both databases resided in Azure, we quickly explored the platform’s native options—starting with the option that turned out to be the best fit.
Option 1: Azure Data Factory (Recommended Approach)
For clients synchronising Azure SQL Database to another Azure SQL Database, Azure Data Factory (ADF) emerged as the most compelling recommendation.
Why ADF?
Azure Data Factory offers:
- Fully managed Azure-native data movement
- Enterprise-grade monitoring capabilities
- Flexible orchestration options
- Scalability from development to production environments
- Ongoing Microsoft support and investment
The migration plan we usually suggest consists of the following phases:
Phase 1: Initial Full Load
To ensure synchronisation, both databases must begin from a common point. Phase 1 involves a one-time bulk copy: Azure Data Factory reads all data from the source and uploads it to the target, creating a clean starting point.
Phase 1: Initial Full Load, establishing baseline parity between Database A and Database B
Phase 2: Incremental Synchronisation
Once both databases are aligned, there’s no need to keep copying everything—just the changes. This is where Change Tracking (CT) or Change Data Capture (CDC) becomes useful: SQL Server features that identify which records have been added, updated, or deleted since the last sync. ADF’s incremental pipeline reads only those changes and applies them, according to the required schedule—be it every few minutes, hours, or daily.
Phase 2: Incremental Synchronization using Change Tracking / Change Data Capture, running on a repeating schedule
Phase 3: Scheduling and Monitoring
Once both phases are operational, ADF manages the rest: scheduling runs, monitoring performance, reattempting failed processes automatically, and notifying your team when an issue arises. This level of oversight is far superior to what SQL Data Sync offered.
A DeF handles:
- Scheduling
- Pipeline execution
- Monitoring
- Retry mechanisms
- Alert notifications
This approach enhances visibility and operational management compared to traditional SQL Data Sync setups.
During the discussions, one significant question reshaped our entire approach: do we really need bi-directional synchronisation, or do we just seek a readable version of the database elsewhere? This distinction is crucial and leads to three additional options worth considering.
If the goal is disaster recovery, reducing read latency for users, or keeping business operations intact during regional outages, Active Geo-Replication is often a more suitable choice than redesigning sync processes. It provides a continuously updated, readable secondary database—not a bi-directional sync.
- For disaster recovery purposes
- In read-heavy applications
- When catering to global users
- For secondary readable databases
- Where complex data transformations are needed
- For bi-directional updates
Option 2: Database Copies and Read Replicas
Some businesses might not need continuous synchronisation at all.
In such scenarios:
- Read Replicas
- Database Copy feature
Key Scenarios
- Creation of reporting databases
- Building analytics environments
- Refreshing staging systems
- Working with read-only workloads
This method greatly simplifies the architecture, fulfilling many operational needs.
As Microsoft Fabric becomes more popular, another viable alternative is Fabric Mirrored Databases.
This choice is especially beneficial for organisations already investing in:
- Microsoft Fabric technology
- OneLake
- Real-time analytics
- Modernisation of AI and data platforms
Advantages include:
- Data available almost in real-time
- Simplified analytical architecture
- Seamless integration with Fabric workloads
- Reduction of data silos
For clients revitalising both operational and analytical systems, this is a perfect chance to rethink data architecture without being limited to mere synchronisation.
Not every organisation needs a large coordination platform.
For light or application-specific sync requirements, Azure Functions might provide a more nimble approach.
Example Use Cases
- Event-driven updates
- Custom business processes
- Microservices frameworks
- Low-volume sync needs
The trade-off here is that customers take on more development and operational responsibilities.
Key Takeaways from the Customer Engagement
Our collaboration reinforced several important lessons:
- Don’t Wait Until 2027
Even though there’s still time before the retirement date, large organisations typically require extensive planning, testing, governance approvals, and deployment cycles.
Getting started early mitigates risks.
- No One-Size-Fits-All Replacement
The best solution varies based on factors like:
- Latency demands
- Load specifics (read vs write)
- The direction of synchronisation
- Operational complexity
- Disaster recovery needs
- Budget constraints
Different scenarios indicate unique migration strategies.
3. Migration as an Opportunity
Instead of merely swapping out SQL Data Sync, organisations should consider:
- Modernising data architecture
- Enhancing observability
- Simplifying operations
- Evaluating opportunities for Fabric adoption
- Planning an enduring cloud strategy
Final Recommendations
For the majority of clients currently utilising Azure SQL Database to Azure SQL Database synchronisation:
Requirement | Recommended Solution |
Continuous synchronisation | Azure Data Factory + CDC/Change Tracking |
Read-only copy | Active Geo-Replication |
Basic duplication | Database Copy or Read Replica |
Analytics modernisation | Fabric Mirrored Databases |
Custom event-driven logic | Azure Functions |
In my customer’s scenario, opting for Azure Data Factory with incremental changes (CDC) stood out as the ideal approach because it’s Azure-native, easily scalable, supported over the long term, and aligns with Microsoft’s future outlook for data movement and integration.
Final Thoughts
While technology retirements often prompt a rush, they also provide opportunities. The retirement of SQL Data Sync isn’t just about migrating; it’s about re-evaluating data movement strategies, enhancing resilience, reducing technical burdens, and adopting cutting-edge Azure-native services.
If your organisation is still using SQL Data Sync, now is the perfect time to assess your sync groups, identify dependencies, and start exploring alternative architectures before September 30, 2027.
Frequently Asked Questions
- What is Azure SQL Data Sync?
Azure SQL Data Sync is a service that syncs data between Azure SQL Databases, allowing for distributed applications and reporting tasks. - Why is SQL Data Sync being retired?
Microsoft has decided to retire SQL Data Sync to shift focus to more modern data integration services. - What are the best alternatives to SQL Data Sync?
Top alternatives include Azure Data Factory, Active Geo-Replication, and Azure Functions, depending on specific business needs. - How can I prepare for the retirement of SQL Data Sync?
Organisations should start assessing their current setups, identify dependencies, and begin exploring alternative architectures as soon as possible. - When is SQL Data Sync retirement date?
SQL Data Sync will be officially retired on September 30, 2027.
References
Share this content:
Discover more from Qureshi
Subscribe to get the latest posts sent to your email.