My initial testing though indicates that the data is not needed to actually work w/ restic, do backups, etc - i assume it would only be needed to restore or check the integrity of the repo. a hosted git repo without git-annex support will still contain the relevant metadata of where files managed by git-annex are hosted. To further restrict git-annex-shell to a particular repository, and fully lock it down to read-only mode: commandGITANNEXSHELLDIRECTORY/srv/annex. confirmed incremental deduping works tooĪfter the git annex move data/ -to usbdrive the data/ folder still has symlinks, but they are broken (until the data is restored at a later point). to usbdrive, then things break, since config is no longer present Now the fun part - create a second annex repo as the backup: walkthrough # if you git annex move. But basic stuff seems to work: restic stats The only difference is that every file is a symlink to another file under. It would one need to download lots of data in order to clone your repository and it will be hard to reclaim space if those big files get updated some time. I think you should however consider not to put this in the same repository as the one with your source code. Now, the repo looks like a normal restic repo. Git-annex is a datafile-centric system whereas DVC focuses on providing a workflow for machine learning and reproducible experiments. Git-annex could indeed help you out on big binary blobs of data. Note that the restic repo still ‘looks’ normal: mkdir my_repo Not exactly true, you still leverage all of Git features on DVC (in fact getting on Gitflow is one of the points of data version control in the first place), even merging: dvc. Oddly, git-annex has official support for the opposite approach - committing files to git-annex, and then storing the repo in borg, vs the other way around which I am discussing. git-annex Share Improve this question Follow asked at 13:52 Make42 12k 24 78 153 1. Eg Backing up with borg and git-annex | Blog of Julian Andres Klode and suggest remote backup storage options? I also see some references to people using this workflow with borg, but they are sparse on details. So I tested this out and can confirm that it ‘works’, at least on the surface level.
0 Comments
Leave a Reply. |