fossilesque@mander.xyzM to Science Memes@mander.xyzEnglish · 2 months agoPandasmander.xyzimagemessage-square36fedilinkarrow-up1347arrow-down19
arrow-up1338arrow-down1imagePandasmander.xyzfossilesque@mander.xyzM to Science Memes@mander.xyzEnglish · 2 months agomessage-square36fedilink
minus-squaregigachad@sh.itjust.workslinkfedilinkEnglisharrow-up5·2 months agoI guess it’s more of a critique of how bad CSV is for storing large data than pandas being inefficient
minus-squarezaphodlinkfedilinkEnglisharrow-up13·2 months agoCSV is not optimal, but then someone shows up and gives you 60GB of JSON instead of 600MB of CSV.
minus-squareDiplomjodler@lemmy.worldlinkfedilinkEnglisharrow-up4·2 months agoWhy do you have to personally attack me like that?
minus-squarenaught@sh.itjust.workslinkfedilinkEnglisharrow-up3·2 months agoOr they dump their entire 6gb SQL database, customer info and all, into a SQL file that you have to load into a mariadb docker container when you just needed a subset that you were going to turn into csv anyway ☺️
minus-squareikilledlaurapalmer@lemmy.worldlinkfedilinkEnglisharrow-up4·2 months agoFine! .csv.gz ftw!
I guess it’s more of a critique of how bad CSV is for storing large data than pandas being inefficient
CSV is not optimal, but then someone shows up and gives you 60GB of JSON instead of 600MB of CSV.
Why do you have to personally attack me like that?
Or they dump their entire 6gb SQL database, customer info and all, into a SQL file that you have to load into a mariadb docker container when you just needed a subset that you were going to turn into csv anyway ☺️
Fine! .csv.gz ftw!