How do you handle version control for large datasets in a research group?
0 hearts0 comments0 replies
Our group keeps producing new versions of the same datasets, and we are losing track of which version produced which result.
Git works for code but not really for multi-terabyte files.
I would like to hear how other groups manage dataset versioning, storage, and provenance in practice.