none
Fuzzy Matching in Power Query - Limits RRS feed

  • Question

  • Hello guys,

    I've recently discovered the fuzzy matching tool within the power query merging option. I tested it with a small data set (2K vs  200k rows) and it worked quite well. Quite impressed on how the algorithm is working. 

    Now I have two connections to two different external data sets and I'm running a fuzzy matching merge between them (It's approx a 100K against 300k rows to return a left outer join match)

    After some time seems that the tool finds the matches but when I try to expand the info from the right table it crushes due to a memory error. I've used the excel add-inn before but I guess this function integrated within the power query environment is meant to work with bigger data sets right? Have you explored the limits of this tool? Anything I could do avoid the memory error? For me it doesn't really matter ho long it takes as long as doesn't crush. 

    Many thanks for your help, 

    Jq

    Thursday, August 15, 2019 10:42 AM

Answers