Lessons in this course (13)

7. Lookup transformation and cache modes

Intermediate★ Must knowLesson 7 of 13

Lookup matches each input row against a reference dataset (e.g. get CustomerKey from DimCustomer by CustomerId).

Cache modeHowWhen
Full cache (default)Loads the entire reference query into memory before rows flowReference fits in memory — fastest
Partial cacheQueries DB on cache miss, caches resultsLarge reference, few distinct keys used
No cacheQueries DB for every rowReference changes during the load; tiny inputs
Cache Connection ManagerCache built once (Cache Transform), reused by several lookups/packagesSame reference used many times

Outputs: Match, No Match (configure "Redirect rows to no match output" — e.g. to insert new dimension members), Error. Lookups are case-sensitive and type-sensitive in full cache mode — trim/upper both sides. Use a SQL query selecting only key + needed columns.