Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

what are the alternatives to HDF5 then ? (I thought HDF5 was a de facto standard, I feel wrong now :-))


It is a de facto standard: you can tell because the author of that post suggests rolling your own simpler data format as an alternative.

There are indeed a lot of reasons not to use HDF5: if you have a lot of small records, are primarily storing strings, or you don't share your data with many colleagues, there are a lot of better alternatives. But if you just want to dump a few hundred GB into one massive file and have decent IO in a format people can figure out, it works pretty good.




Consider applying for YC's Summer 2026 batch! Applications are open till May 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: