Not just at the library, in most highly-trafficed public areas.

http://www.ida.gov.sg/Programmes/20061027174147.aspx

900 hotspots when the programme started at the end of 2006, planning on 5000 by the end of next year.

But yes, we do have free wifi at Starbucks. And it does seem like there are 5000 Starbucks in KL.