If daytrip, leave early on Sat morning. Preferably 6/630

Then depart back on Sat night.
sun afternoon usually heavy traffic at the usual choke points like Tapah, Sungkai