I want a build system that:
- is as powerful and flexible as #SCons
- as readable and concise as #SnakeMake
- has a fricking progress bar+ETA
- is 
#datalad / 
#gitannex agnostic (knows that files can be fetched from elsewhere
- remembers how long building things takes
- balances that to decide if rebuilding locally instead of fetching gigabytes via slow internet is favorable
- integrates well with 
#nix for reproducibility
In the latest DataLad blog post I try out two changes which were introduced in git-annex within the last year: git-remote-annex Git remote helper (this is the big one!) and a small change to enabling WebDAV special remotes. They work brilliantly, and combined they enable read-only data publishing on Nextcloud instances.
Join the next upcoming Mannheim Open Science Meetup!
Topic: Reproducible Research Data Management with @datalad 
Speaker: @lnnrtwttkhn 
Date: Wed, Feb 26, 2025
Time: 2:00 PM
Location: Online, sign up here: https://uni-mannheim.zoom-x.de/meeting/register/u5wpc-ygqDIpH9Z8JRmpRDnkMg1Si9uXnx7h
Why Attend?
Learn cutting-edge tools like Git, Docker & DataLad Boost transparency & reproducibility in research
Just set up a new Synology NAS box and installed forgejo-aneksajo (a git web UI with built-in git-annex support) on it: https://effigies.gitlab.io/posts/forgejo-aneksajo-synology/
Just a quick post that highlights what needed to be adapted from this earlier post on the #DataLad blog: https://mas.to/@mih/112880585950408351
@khinsen In the MOOC #ReproducibleResearch II, Do you speak about #DataLad for managing data set?
Well, git-annex is very nice but somehow the plumbing and so which porcelain? ;-)
https://www.fun-mooc.fr/en/courses/reproducible-research-ii-practices-and-tools-for-managing-comput
https://git-scm.com/book/en/v2/Git-Internals-Plumbing-and-Porcelain
@nobodyinperson The `datalad-fuse` extension allows you to use `datalad fsspec-head` to achieve this. I believe it uses git-annex to find a remote URL and then Python's `fsspec` to do the actual fetch. #DataLad
In a new article, I take a look at #Forgejo for hosting laaarge #Datalad datasets. I am talking about datasets with millions of files. Or rather millions of #gitAnnex file pointers.
...and...
It works really nice, right out of the box! Millions of files in thousands of datasets. Not even a reason to switch away from a #SQLite database. A dual-core VM with 2-3GB of RAM should be good enough.
https://blog.datalad.org/posts/forgejo-aneksajo-large-datasets/
A new post on DataLad blog: sharing my experiences from implementing a DataLad workflow, inspired by the existing "FAIRly big" paper, to cut and publish conference videos, on a cluster.
Looking back, everything seems streamlined and logical, but getting there involved discovering the fine details of DataLad, git-annex, HTCondor, bash (and also Matroska metadata and video codecs). Hope it's an useful take.
Have you ever wondered how long it took you to run that command and what was in that stdout/stderr while running it? Please checkout a fresh blog post about a super fresh little helper con-duct. It might be that missing piece for your otherwise already wonderful "datalad run" experience(s).
Here is another blog post on #Forgejo. This time looking into a user-space deployment with #podman and #systemd.
This combination really rocks! It feels like managing any other non-containerized service. The integration with podman v4.4+ (quadlets) is even better.
https://blog.datalad.org/posts/forgejo-aneksajo-podman-deployment/
A post on a missing key piece in the DataLad world: an easy, free and open-source solution for self-hosting DataLad datasets with annex'ed files.
Now there is a #Forgejo variant with built-in git-annex support! Straightforward to deploy (even at home or in a small lab on a #RaspberryPi), and super convenient to use.
A post on one step of my journey to get off of commercial cloud services: A personal music streaming service with #Navisdrome running on a #RaspberryPi at home that does this on the side. All with minimal overhead and powered by #GitAnnex data logistics.
