Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Ask HN: Distributed Data Management Solutions?
4 points by trauco on Aug 11, 2023 | hide | past | favorite | 1 comment
I run a small earth sciences research group. I have a need for a good distributed management solution so group members can access data, contribute changes, etc. The aim is to be able to track changes to both data processing scripts, civ-type data text files, and processed binary files (think MatLab .mat files or NetCDF).

I've been experimenting with DataLad (https://www.datalad.org) which is a front-end for git+git-annex. It's ok although painfully slow as we have many small files to put into git-annex. It also requires quite granular understanding of how git-annex and git work, and it doesn't have any nice front-ends.

Are there any other open source solutions for this out there?






Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: