How do you handle version control for large datasets in a research group?

Created byJarrod Kanizay AvatarJarrod KanizayBig Data

0 hearts0 comments0 replies

Our group keeps producing new versions of the same datasets, and we are losing track of which version produced which result.

Git works for code but not really for multi-terabyte files.

I would like to hear how other groups manage dataset versioning, storage, and provenance in practice.

Comments

No comments yet.