Lookback window
The lookback window defines the time period that a connector will retrieve data for during each synchronization, relative to the reference date.
Example with a 7-day lookback window
Today's date: 2025-01-22 Reference date: 2025-01-15 Lookback window: 7 days
Data retrieved for dates:
2025-01-15 (reference date)
2025-01-14
2025-01-13
2025-01-12
2025-01-11
2025-01-10
2025-01-09 (reference date - 6 days)
All data for these 7 days is retrieved and synchronized, ensuring any retroactive updates are captured.
Impact by insertion method
The lookback window interacts differently with each insertion method:
REPLACE Mode: Previous data within the lookback window is deleted and replaced with fresh data from the source.
UPSERT Mode: Rows are updated with new values, preserving history if configured.
INSERT Mode: May create duplicates if the same data is retrieved multiple times (not recommended with lookback).
Typical lookback window values
Advertising platforms (Google Ads, Meta)
3-7 days
Attribution windows, conversion delays
Analytics platforms (GA4)
1-3 days
Processing delays, session completion
CRM/Sales (Salesforce, HubSpot)
1-2 days
Data entry delays, batch updates
E-commerce (Shopify, WooCommerce)
1-2 days
Order updates, refunds
Trade-offs
Data completeness
✅ More complete and accurate data
⚠️ Risk of missing retroactive updates
Retroactive changes
✅ Captures all platform corrections
❌ May miss late attribution or corrections
Synchronization time
❌ Longer processing time
✅ Faster synchronizations
Data warehouse costs
❌ Higher (more partitions scanned/written)
✅ Lower (fewer partitions affected)
Data consistency
✅ More reliable for reporting
⚠️ Potential inconsistencies over time
Use case
Critical metrics, attribution analysis
High-volume data, stable metrics
Best practices
Configure the lookback window based on the platform's attribution window.
Monitor data stability: if values change significantly after several days, increase the lookback.
For critical metrics, prefer a longer lookback window to ensure data accuracy.
For high-volume tables with stable data, a shorter lookback may be sufficient.
Last updated