Robin Dirksen

Robin Dirksen

In progress

This will save some space on the server by directly upload it to the backup server.

Webtica

Webtica

·
·

@Robindirksen1 @Dennis Isn't this the same as SFTP Driver?

no votes yet
Dennis

Dennis

·
·

@Webtica No it's not the same, streaming is a different way of uploading the file to the remote server.

no votes yet
Saeed Rehman

Saeed Rehman

·
·

Piping to drivers using rclone, rsync may help

no votes yet
Fred Drouven

Fred Drouven

· · Edited
·

The current backup method generates big backup files that are stored in the .ploi folder. If a backup fails the failed file remains sitting in that folder. When a few backups fail it might end up in filling the storage completely.

Also if the total backup size is bigger than the free space you cannot make a backup via Ploi at all right now.

If you want a better solution you need to do something with chunks imo. Only streaming won't really help.

7 total votes
Stevens miguel

Stevens miguel

·
·

Is the current backup method incremental? Or do you get a full file of the complete site every time you take a backup?

no votes yet
Webtica

Webtica

· · Edited
·

Got the same issue with some big sites. Streaming or chunking would help.

2 total votes
Malte Horstmann Fred Drouven
Green17

Green17

· · Edited
·

It would also be good to have failed backups removed after x days or something.

4 total votes
Pegaso Malte Horstmann Dennis Oderwald Fred Drouven
Carlos  Devia

Carlos Devia

·
·

I hope you are talking here about incremental backups. That's really required ala JetBackup.

no votes yet
Marin Delija

Marin Delija

·
·

It would be good if one could also limit the amount of concurrent Streams, as for example some storage providers like Hetzner Storage Box only allow X amount of concurrent connections

no votes yet
Dennis

Dennis

· · Edited
·

This is coming, no more bloaty files on your server: direct uploads to the external driver 🥰

2 total votes
Cristian Balan Alex
Dennis

Dennis

· · Edited
·

OK, quick update: The S3 and Custom S3 uploads are now streamed, they do not take any space up on your server anymore. Other drivers will be next! 🥳

2 total votes
Fred Drouven Green17
Green17

Green17

· · Edited
·

Dennis, is Google Drive one of the ones on the list to do?

1 total vote
Cristian Balan
Dennis

Dennis

· · Edited
·

Yes, and Dropbox too and such :)

1 total vote
Green17
Green17

Green17

· · Edited
·

Fantastic news Dennis, has been a problem for us on a few site. :-)

1 total vote
Dennis
Fred Drouven

Fred Drouven

· · Edited
·

Hi Dennis, does this include Digital Oceans Spaces? What you already support?

no votes yet
Dennis

Dennis

·
·

All S3 drivers stream it now. (So custom S3, AWS S3 and DigitalOcean Spaces).

no votes yet
Fred Drouven

Fred Drouven

· · Edited
·

Great!!!! We will set up some test backups first.

1 total vote
Dennis

Stream backups

25 total votes
  • Dennis moved item to board In progress

    1 week ago
  • Dennis opened

    2 years ago