Feb 7 2021, 09:42 PM
QUOTE(Josh95 @ Feb 7 2021, 03:44 PM)
My two cents on this. It depends on how you evaluate the benchmark scores. To me benchmarking apps is just another supporting evidence to indicate the overall performance of a device. It does not paint the complete picture as the benchmarking app itself could be flawed or skewed whether intentionally (to get great score to show off) or unintentionally (due to new SoC hence less optimization or just pure buggy code that leads in inaccurate score).
Using real apps to test device performance is still considered as benchmark if you are using it to test and compare different devices using the same app while trying to reproduce the result you want using the same task or condition set by either yourself or other people.
It is best you use other people's review as just a standard reference point and you do the benchmark again yourself to see if it does reach to your expectation. But then again, benchmark results can vary due to various condition or circumstances beyond your control. Even yourself testing it could be flawed as you might not have realised some mistakes you do before you start the process.
Conditions such as:
1. The room temperature you used to test which can affect your device initial temperature (whether you test in an aircond vs normal temp room)
2. Apps installed/running in background (The best way to use a benchmarking app is with its stock configuration aka only benchmark it when the phone is just newly setup finished after factory reset)
Even then we can argued that, but hey Samsung came preloaded with lots of bloatwares which can skewed benchmark score in some ways. If that's the case might as well strip and disable all unnecessary services and apps but that requires the devices to be rooted if you wanna go for the extreme to get the best out of your devices
Circumstances such as:
1. The SoC itself (whether you get the golden sample or not aka silicone lottery) eg. like how some Intel i9-10900K series (unlocked) can overclock beyond 5.3GHz stable with lower voltages required.
2. SoC manufacturing flaw (again based on 1st point but you get the worse silicone which performs below average standard)
Antutu will give greater scores if the device have larger RAM and storage size even if the speed/bandwidth is not increase, which means that capacity alone contribute to more score, did you know that?
To me, 3DMark is quite an accurate bencmark to be used to evaluate GPU performance only since it does show real time FPS while it performs benchmarking.
Geekbench, I can't comment this much as I did not really use it plus some people say it is not accurate or skewed in some ways.
For me personally, I will benchmark using both synthetic and real world apps to gauge the device performance.
Ok, back to the topic that I wish to discuss. Mr.whosetheboss phone could be getting the flawed SoC phone which result in below average performance, we can't say for sure until we have further validation. Plus I don't agree with the way he tested sustained performance, no real world apps will stress both CPU and GPU to the max at all times, I mean literally NEVER so do not take this as a good indicator of real world performance. Those test are on the extreme side which means the worst possible scenario. It is good when you use it to test stability NOT performance. What I'm trying to emphasize here is his testing methodology is not wrong by any means, it is just that do not put this type of test as a very important metric when compared to other types of testing such as real world sustained performance which is by far more important aspect.
For Booredatwork.com, his testing methodology seems fine for a normal average consumer that is, personally I will not use his because his testing lack of details I want to know such as frame pacing (does it micro stutter?), power consumption used (an important factor to estimate battery life while gaming) and etc. There is only one thing I wanna highlight here, Genshin Impact at Max settings can maintain 60 FPS with 99% stability with SD 888? I call that BS. Not blaming the reviewer here as he himself might not have realise this but I think the app he use to test Genshin Impact is bugged for unknown reason.
"But in real life performance, both of them are almost the same." I have to disagree on this. It looks almost the same to you because you have not use any real world heavy apps that can enable you to see the real life performance differences. I do not have SD 888 devices with me so I can't test it but I can say one thing for sure. In gaming alone, games is always more optimized in SD counterpart compared to Exynos. Also, Snapdragon 888 introduce a new feature call as Variable Rate Shading (VRS), that can impact the game FPS quite significantly along with extra battery life due to the said optimization. Unfortunately for Mali GPU, VRS is still not present yet.
To be honest Mali G78 MP14 GPU still does not meet my performance expectation. Let's take Asphalt 9 as an example. A 2.5 years old game released around July 2018 still cannot maintained lock 60 FPS at High settings on my S21 Ultra. It is much better than my predecessor phone though S10 and S20+ (which can drop to below 40 FPS a lot of times). This is still not so bad. The game I also play which is Pokemon Masters EX. This game's performance experience is so atrocious, can say it is much more worse than Genshin Impact. In battles average around 22 FPS (S10 average around 17 FPS). The UI with a lot of characters can drop to as low as 8 FPS (mind you this is the lowest graphic setting you can go), my God can you imagine that even on S21 Ultra (S10 was 5 FPS ...). I saw so many YouTube game play and their phone seems to be smooth at around 30 FPS, I have no idea if they used the SD counterpart phone, but I believe so.
Sorry for the super long text. I might change or add new info if I sees fit.
benchmark doesn't represent actual usage. it's not possible.Using real apps to test device performance is still considered as benchmark if you are using it to test and compare different devices using the same app while trying to reproduce the result you want using the same task or condition set by either yourself or other people.
It is best you use other people's review as just a standard reference point and you do the benchmark again yourself to see if it does reach to your expectation. But then again, benchmark results can vary due to various condition or circumstances beyond your control. Even yourself testing it could be flawed as you might not have realised some mistakes you do before you start the process.
Conditions such as:
1. The room temperature you used to test which can affect your device initial temperature (whether you test in an aircond vs normal temp room)
2. Apps installed/running in background (The best way to use a benchmarking app is with its stock configuration aka only benchmark it when the phone is just newly setup finished after factory reset)
Even then we can argued that, but hey Samsung came preloaded with lots of bloatwares which can skewed benchmark score in some ways. If that's the case might as well strip and disable all unnecessary services and apps but that requires the devices to be rooted if you wanna go for the extreme to get the best out of your devices
Circumstances such as:
1. The SoC itself (whether you get the golden sample or not aka silicone lottery) eg. like how some Intel i9-10900K series (unlocked) can overclock beyond 5.3GHz stable with lower voltages required.
2. SoC manufacturing flaw (again based on 1st point but you get the worse silicone which performs below average standard)
Antutu will give greater scores if the device have larger RAM and storage size even if the speed/bandwidth is not increase, which means that capacity alone contribute to more score, did you know that?
To me, 3DMark is quite an accurate bencmark to be used to evaluate GPU performance only since it does show real time FPS while it performs benchmarking.
Geekbench, I can't comment this much as I did not really use it plus some people say it is not accurate or skewed in some ways.
For me personally, I will benchmark using both synthetic and real world apps to gauge the device performance.
Ok, back to the topic that I wish to discuss. Mr.whosetheboss phone could be getting the flawed SoC phone which result in below average performance, we can't say for sure until we have further validation. Plus I don't agree with the way he tested sustained performance, no real world apps will stress both CPU and GPU to the max at all times, I mean literally NEVER so do not take this as a good indicator of real world performance. Those test are on the extreme side which means the worst possible scenario. It is good when you use it to test stability NOT performance. What I'm trying to emphasize here is his testing methodology is not wrong by any means, it is just that do not put this type of test as a very important metric when compared to other types of testing such as real world sustained performance which is by far more important aspect.
For Booredatwork.com, his testing methodology seems fine for a normal average consumer that is, personally I will not use his because his testing lack of details I want to know such as frame pacing (does it micro stutter?), power consumption used (an important factor to estimate battery life while gaming) and etc. There is only one thing I wanna highlight here, Genshin Impact at Max settings can maintain 60 FPS with 99% stability with SD 888? I call that BS. Not blaming the reviewer here as he himself might not have realise this but I think the app he use to test Genshin Impact is bugged for unknown reason.
"But in real life performance, both of them are almost the same." I have to disagree on this. It looks almost the same to you because you have not use any real world heavy apps that can enable you to see the real life performance differences. I do not have SD 888 devices with me so I can't test it but I can say one thing for sure. In gaming alone, games is always more optimized in SD counterpart compared to Exynos. Also, Snapdragon 888 introduce a new feature call as Variable Rate Shading (VRS), that can impact the game FPS quite significantly along with extra battery life due to the said optimization. Unfortunately for Mali GPU, VRS is still not present yet.
To be honest Mali G78 MP14 GPU still does not meet my performance expectation. Let's take Asphalt 9 as an example. A 2.5 years old game released around July 2018 still cannot maintained lock 60 FPS at High settings on my S21 Ultra. It is much better than my predecessor phone though S10 and S20+ (which can drop to below 40 FPS a lot of times). This is still not so bad. The game I also play which is Pokemon Masters EX. This game's performance experience is so atrocious, can say it is much more worse than Genshin Impact. In battles average around 22 FPS (S10 average around 17 FPS). The UI with a lot of characters can drop to as low as 8 FPS (mind you this is the lowest graphic setting you can go), my God can you imagine that even on S21 Ultra (S10 was 5 FPS ...). I saw so many YouTube game play and their phone seems to be smooth at around 30 FPS, I have no idea if they used the SD counterpart phone, but I believe so.
Sorry for the super long text. I might change or add new info if I sees fit.
but it is the best comparison on the 2 different chips,
and it proved a few points. malaysia samseng-fags has been pissed on yet again, being given the much inferior chip at a higher price.
it is little improvement to last version of EXSYHTNOT due to 5nm process.
but general weakness of samseng chip design makes it run at higher clock frequency yet still unable to keep up with the snapdragon.
the EXSYHTNOT may be good for abt 6 months until new android come out. then the chip will show out all its weaknesses of poor design.
Quote
0.0315sec
0.48
6 queries
GZIP Disabled