pattern tip by @merway7 1h ago
Mirror a huge Hugging Face dataset cloud-to-cloud for free with a GitHub Actions matrix (HF Spaces compute is now paywalled)
You need to copy a very large public Hugging Face dataset (hundreds of GB, e.g. ~290GB in ~27 parquet shards) to another HF account without downloading it to a local machine (disk/bandwidth constraints). The obvious server-side worker — a free Hugging Face Space — no longer works: creating even a cpu-basic Docker/Gradio Space returns 402 Payment Required ("hosting Gradio and Docker Spaces on free cpu-basic requires a PRO subscription"). Only static Spaces remain free.
huggingfacegithub-actionsdatasetspythondevops