# Stream backups

**Project:** Servers | **Board:** Closed | **Votes:** 29
**URL:** https://roadmap.ploi.io/projects/1-server-level-requests/items/14-stream-backups

---

This will save some space on the server by directly upload it to the backup server.

---

## Comments

**Webtica** (2022-05-26T13:07:48+00:00):
[@Robindirksen1](/user/Robindirksen1) [@Dennis](/user/Dennis) Isn't this the same as SFTP Driver?

**Dennis** (2022-05-27T17:10:21+00:00):
[@Webtica](/user/Webtica) No it's not the same, streaming is a different way of uploading the file to the remote server.

**Saeed Rehman** (2022-08-04T13:56:39+00:00):
Piping to drivers using rclone, rsync may help


**Fred Drouven** (2022-10-10T08:53:41+00:00):
The current backup method generates big backup files that are stored in the .ploi folder.
If a backup fails the failed file remains sitting in that folder.
When a few backups fail it might end up in filling the storage completely.

Also if the total backup size is bigger than the free space you cannot make a backup via Ploi at all right now.

If you want a better solution you need to do something with chunks imo. Only streaming won't really help.

**Stevens miguel** (2022-12-01T10:11:44+00:00):
Is the current backup method incremental? Or do you get a full file of the complete site every time you take a backup?

**Webtica** (2022-12-11T15:53:19+00:00):
Got the same issue with some big sites. 
Streaming or chunking would help. 

**Green17** (2023-05-07T10:09:58+00:00):
It would also be good to have failed backups removed after x days or something.

**Carlos  Devia** (2024-03-16T21:41:47+00:00):
I hope you are talking here about incremental backups. That's really required ala JetBackup.

**Marin Delija** (2024-12-20T08:40:41+00:00):
It would be good if one could also limit the amount of concurrent Streams, as for example some storage providers like Hetzner Storage Box only allow X amount of concurrent connections

**Dennis** (2025-02-11T15:50:44+00:00):
This is coming, no more bloaty files on your server: direct uploads to the external driver 🥰

**Dennis** (2025-02-12T08:33:36+00:00):
OK, quick update: The S3 and Custom S3 uploads are now streamed, they do not take any space up on your server anymore. Other drivers will be next! 🥳

**Green17** (2025-02-12T08:46:41+00:00):
Dennis, is Google Drive one of the ones on the list to do?

**Green17** (2025-02-12T10:00:08+00:00):
Fantastic news Dennis, has been a problem for us on a few site. :-)

**Fred Drouven** (2025-02-12T10:54:21+00:00):
Hi Dennis, does this include Digital Oceans Spaces? What you already support?

**Webtica** (2025-05-04T10:28:11+00:00):
Any news here on the Hetzner storage SFTP Stream? Thanks [@Dennis](/user/Dennis)

**Dennis** (2025-12-03T11:26:31+00:00):
Sadly, I have to turn this down.

I tried many ways, the way Ploi creates backups doesn't work well with zipping/tarring and streaming for some reason. (For example, SQL files are called `-` inside a ZIP or TAR file which is strange, it still holds the content) It just doesn't play nice when streaming directly into a archive file and sending it to the remote driver.

Other than that, most drivers, don't even allow this. We'll look at this at a later stage again that we could do it driver-specific, but for now, no go sadly.

