fossilesque@mander.xyzM to Science Memes@mander.xyzEnglish · 10 months agoMagic πmander.xyzimagemessage-square68fedilinkarrow-up1723arrow-down16
arrow-up1717arrow-down1imageMagic πmander.xyzfossilesque@mander.xyzM to Science Memes@mander.xyzEnglish · 10 months agomessage-square68fedilink
minus-squareAdkml [he/him]@hexbear.netlinkfedilinkEnglisharrow-up11arrow-down1·10 months ago“Only” using 15 digits is still pretty insane
minus-squareblind3rdeye@lemm.eelinkfedilinkEnglisharrow-up16·10 months agoYou get that level of precision in a standard “double” floating point number. So that’s basically the normal level of precision you get without trying.
minus-squareradiofreeval@hexbear.netlinkfedilinkEnglisharrow-up9·edit-24 months agodeleted by creator
minus-squareneptune@dmv.sociallinkfedilinkEnglisharrow-up4·10 months agoGoogle suggests that excel uses 15. So even college students working on any old STEM degree are probably using 15 digits.
“Only” using 15 digits is still pretty insane
You get that level of precision in a standard “
double
” floating point number. So that’s basically the normal level of precision you get without trying.deleted by creator
Google suggests that excel uses 15. So even college students working on any old STEM degree are probably using 15 digits.