The DF fails on the first query transform which joins,distinct,and ifthenelse(),ltrim(),rtrim(), as seen from Monitor Log query_location1 and query_location2 did not start yet.
After I move the select distinct and ifthenelse() to newquery4 (after Merge but before load to target table3), it fails halfway in query4.
Either ifthenelse() or select distinct is the bottleneck then. To which, I made following changes: move back ifthenelse() to queryjoin, and keeps select distinct to query4. the DF fails during select distinct.
Does it help to add Data_Transfer (type:Table) before select distinct (after merge transform)?
Even simple join table1 and table2 (only keep the mapping of 1 field to $param1 and where clause person_id and $param2) to target table3 did not become INSERT INTO optimized SQL.