I have a stream with 250.000 records, which I need to join with another one that has the same number of records but different fields. They are connected through a key that is a string.

In order to join the streams I'm using a Merge Join (inner join). The problem is that the Merge Join requires the records to be sorted on the key. When I try to sort 250.000 records basen on a string, spoon crashes because it's too much of a heavy load performing such an operation.

I also tried Stream Lookup but it's even worse...

Any bright ideas?