QUOTE(Mavik @ Feb 28 2022, 08:46 PM)
Malaysia is a greenfield in this space especially with data (from governance, to business knowledge, to the maths and finally programming). It is ripe for the taking and you can definitely make a name for yourself here locally. I used to talk to the chief data scientist at my past company (bank) where he used to tell me that data folks have 3 bubbles of skills, maths, programming and business. Most of them tend to be strong in 2/3 but its very rare to find someone who is strong in all 3 (he was one of them but depending on your experience and field of expertise). At the end of the day, he used to tell me that it was through building things up from scratch is when you truly get to know and grow yourself to fill out the 3 bubbles.
Personally I’ve worked in start-up tier company and e-commerce with Alibaba backend support (worked closely with Alibaba team actually) and currently with one of the largest international bank with strong Asia presence.
I would say I have experienced through 3 tier of analytic infra. First is the messy but are working toward proper datalake/data warehousing. They have the data and you can get the data easily if you know the right place to ask for. Most of the SME/startup are currently in this stage.
Second is one with strong backend support (Alicloud) with proper data governance. Something FAANGs would have. The more established companies I can see in Malaysia with this sort of infra that isn’t FAANG is Shopee, Lazada, Grab, AirAsia and probably some telco like Axiata. There are more choices in SG as well such as Gojek and bytedance, but still very limited by nature.
Third is one with huge amount of data, but with all the legacy tool and the massive amount effort needed to consolidate them causing it to move extremely slowly. On top of that, regulated industry makes it even harder. This type of company requires a huge amount of time dealing with bureaucracy. Most international companies is at this stage.
Personally I still prefer the second type because of the ease of access to data and tooling, where you can achieve the most with the least effort in trying to hack through everything just to get the result.
Currently I’m looking to develop my skill set on building ML model that can productionize, which is the main reason why I’m looking for FAANGs as the next career jump.
Most of the existing SME does not need this level of model and do not have the proper data pipeline that can make it work as well. BI would be a better use of their resource as compared to data science. This leaves me with second and third type and bureaucracy is an unnecessary blocker for technical development.
Sorry TS might have swayed away from your AMA.
This post has been edited by LovelyPotato: Feb 28 2022, 10:06 PM