backup-manager

[Soter]

Hello. I have an EVE-ng pro running on a DELL 730 Esxi 7.03
is has 36 vCPU, and 200GB ram. 4 hdd at 300Gb Each

I was trying to upgrade from 5 to 6, and fortunately I had made a clone of the eveng VM. after upgrade I did not have a running eve-ng at all.

So spinning up the backup, and clone again. this time only to upgrade to 5.0.1-144 and adding the backup-manager

sftp server is on the same server, same network
backing up "all"
lot of errors, for example:
â•‘2024/05/04 16:13:05 ERROR : opt/unetlab/addons/qemu/win-10test/virtioa.qcow2: Failed to copy: Update ReadFrom failed: connection lost â•‘2024/05/04 16:13:05 INFO : opt/unetlab/addons/qemu/win-7test/.keepme: Copied (new) â•‘2024/05/04 16:13:06 ERROR : opt/unetlab/addons/qemu/win-10x64-PRO/virtioa.qcow2: Failed to copy: Update ReadFrom failed: connection lost â•‘2024/05/04 16:13:07 INFO : opt/unetlab/addons/qemu/winserver-2022/.keepme: Copied (new) â•‘2024/05/04 16:13:25 ERROR : opt/unetlab/addons/qemu/win-7test/virtioa.qcow2: Failed to copy: Update ReadFrom failed: connection lost â•‘2024/05/04 16:13:25 INFO : opt/unetlab/addons/qemu/windows iso/.keepme: Copied (new) â•‘2024/05/04 16:13:27 ERROR : opt/unetlab/addons/qemu/winserver-2022/virtioa.qcow2: Failed to copy: Update ReadFrom failed: connection lost â•‘2024/05/04 16:13:39 INFO : opt/unetlab/addons/qemu/win-10test/compressedvirtioa.qcow2: Copied (new) â•‘2024/05/04 16:13:45 ERROR : opt/unetlab/addons/qemu/windows iso/win2022cdrom.iso: Failed to copy: Update ReadFrom failed: connection lost â•‘2024/05/04 16:13:45 INFO : opt/unetlab/addons/qemu/cat9kv-17.10.01-prd7/.keepme: Copied (new)

ending with
‘Transferred: 186.881 GiB / 186.881 GiB, 100%, 351.509 MiB/s, ETA 0s â•‘Errors: 23 (retrying may help) 4s â•‘Transferred: 252 / 252, 100% â•‘Elapsed time: 8m21.1s â•‘ â•‘2024/05/04 16:14:25 Failed to copy with 23 errors: last error was: Update ReadFrom failed: connection lost â•‘[Failed] â•‘ â•‘ â• Back to main menu

it looks like it should have transfered 186.881 GB to the sftp server, however it only transfered 37.8GB, and a lot of errors "lost connections"

so any advise would be appreciated

Br.

[Uldis (UD)]

SFTP server lost connection means only thet your sftp server has badly installed or having bad access even it is in same network.
Best same network sftp server is Linux server as sftp server, how to set such up was given in backup manager section

[Soter]

I can asure you that I can continously transfere 100Gb to this sftp server with no disruption.

besides it the same nodes that keeps getting the error. I have tried 5 times now

[Uldis (UD)]

did you stop all on you eve before backup?!
nothing should be running

[Soter]

yes everything is shut down.

I think its strange a Rebex buru sftp/scp server has been running for years, with weekly backups from cisco FMC, ISE and just general Sftp service for all my devices, suddently stops working, when it comes to evengs backup manager.

This is from the server log. 192.168.2.123 is eveng, and the log says it eve that closes the connection.

2024-05-04 20:14:43.240 +02:00 [Information] Session 83: Started on connection from 192.168.2.123:48388.
2024-05-04 20:14:43.246 +02:00 [Information] Session 83: Authentication for 'xxxxx' succeeded.
2024-05-04 20:14:43.247 +02:00 [Information] Session 83: Attempting GetItemInfo FSO Read "/"
2024-05-04 20:14:43.249 +02:00 [Information] Session 83: Attempting DeleteFile FSO Delete "/eve-ng-backup/eve-eve-ng-pro-20240504-200618/images/opt/unetlab/addons/qemu/winserver-2022/virtioa.qcow2.susisuh6.partial"
2024-05-04 20:14:43.392 +02:00 [Information] Session 79: Closed connection from 192.168.2.123:48378.
2024-05-04 20:14:43.552 +02:00 [Information] Session 80: Connection reset by peer.
2024-05-04 20:14:43.552 +02:00 [Warning] An existing connection was forcibly closed by the remote host.
2024-05-04 20:14:43.552 +02:00 [Error] Session 80: Error: Rebex.Net.Protocols.Ssh.SshException: Error while sending packet data.
at rnvax.aklso.tyjjj(xejjn p0, Action p1)
at rnvax.olnhz.csvch(Int32 p0, Byte[] p1, Int32 p2, Int32 p3)
at rnvax.olnhz.fokqd(Byte[] p0, Int32 p1, Int32 p2)
at rnvax.exyss.nedxg(ArraySegment`1 p0, Action`1 p1)
at rnvax.deldt.bafwo(pepkp p0)
at rnvax.deldt.wmbgv(pepkp p0, Int32 p1)
at rnvax.deldt.yxhgp(pepkp p0)
2024-05-04 20:14:43.554 +02:00 [Information] Session 84: Started on connection from 192.168.2.123:48390.
2024-05-04 20:14:43.559 +02:00 [Information] Session 84: Authentication for 'xxxxx' succeeded.
2024-05-04 20:14:43.562 +02:00 [Information] Session 84: Attempting GetItemInfo FSO Read "/"
2024-05-04 20:14:43.564 +02:00 [Information] Session 84: Attempting DeleteFile FSO Delete "/eve-ng-backup/eve-eve-ng-pro-20240504-200618/images/opt/unetlab/addons/qemu/win-10test/compressedvirtioa.qcow2.jelotox5.partial"
2024-05-04 20:14:43.641 +02:00 [Information] Session 80: Closed connection from 192.168.2.123:48380.
2024-05-04 20:14:44.163 +02:00 [Information] Session 82: Attempting GetItemInfo FSO Read "/eve-ng-backup/eve-eve-ng-pro-20240504-200618/images/opt/unetlab/addons/qemu/win-7test/virtioa.qcow2.fotajod8.partial"
2024-05-04 20:14:44.164 +02:00 [Information] Session 82: Attempting GetItemInfo FSO Read "/eve-ng-backup/eve-eve-ng-pro-20240504-200618/images/opt/unetlab/addons/qemu/win-10test"
2024-05-04 20:14:44.166 +02:00 [Information] Session 82: Attempting OpenFile FSO Write, Create "/eve-ng-backup/eve-eve-ng-pro-20240504-200618/images/opt/unetlab/addons/qemu/win-10test/virtioa.qcow2.nokisid5.partial"
2024-05-04 20:14:45.056 +02:00 [Information] Session 83: Attempting GetItemInfo FSO Read "/eve-ng-backup/eve-eve-ng-pro-20240504-200618/images/opt/unetlab/addons/qemu/winserver-2022/virtioa.qcow2.susisuh6.partial"
2024-05-04 20:14:45.059 +02:00 [Information] Session 83: Attempting GetItemInfo FSO Read "/eve-ng-backup/eve-eve-ng-pro-20240504-200618/images/opt/unetlab/addons/qemu/windows iso"
2024-05-04 20:14:45.060 +02:00 [Information] Session 83: Attempting OpenFile FSO Write, Create "/eve-ng-backup/eve-eve-ng-pro-20240504-200618/images/opt/unetlab/addons/qemu/windows iso/win2019cdrom.iso.wufofew7.partial"
2024-05-04 20:14:45.091 +02:00 [Information] Session 84: Attempting GetItemInfo FSO Read "/eve-ng-backup/eve-eve-ng-pro-20240504-200618/images/opt/unetlab/addons/qemu/win-10test/compressedvirtioa.qcow2.jelotox5.partial"
2024-05-04 20:14:45.099 +02:00 [Information] Session 84: Attempting GetItemInfo FSO Read "/eve-ng-backup/eve-eve-ng-pro-20240504-200618/images/opt/unetlab/addons/qemu/windows iso"
2024-05-04 20:14:45.101 +02:00 [Information] Session 84: Attempting OpenFile FSO Write, Create "/eve-ng-backup/eve-eve-ng-pro-20240504-200618/images/opt/unetlab/addons/qemu/windows iso/win2022cdrom.iso.xejaxez2.partial"
2024-05-04 20:15:03.256 +02:00 [Information] Session 83: Connection reset by peer.
2024-05-04 20:15:03.256 +02:00 [Warning] An existing connection was forcibly closed by the remote host.
2024-05-04 20:15:03.256 +02:00 [Error] Session 83: Error: Rebex.Net.Protocols.Ssh.SshException: Error while sending packet data.
at rnvax.aklso.tyjjj(xejjn p0, Action p1)
at rnvax.olnhz.csvch(Int32 p0, Byte[] p1, Int32 p2, Int32 p3)
at rnvax.olnhz.fokqd(Byte[] p0, Int32 p1, Int32 p2)
at rnvax.exyss.nedxg(ArraySegment`1 p0, Action`1 p1)
at rnvax.deldt.bafwo(pepkp p0)
at rnvax.deldt.wmbgv(pepkp p0, Int32 p1)
at rnvax.deldt.yxhgp(pepkp p0)
2024-05-04 20:15:03.257 +02:00 [Information] Session 85: Started on connection from 192.168.2.123:48392.
2024-05-04 20:15:03.257 +02:00 [Information] Session 83: Closed connection from 192.168.2.123:48388.
2024-05-04 20:15:03.261 +02:00 [Information] Session 85: Authentication for 'xxxxx' succeeded.
2024-05-04 20:15:03.262 +02:00 [Information] Session 85: Attempting GetItemInfo FSO Read "/"
2024-05-04 20:15:03.264 +02:00 [Information] Session 85: Attempting DeleteFile FSO Delete "/eve-ng-backup/eve-eve-ng-pro-20240504-200618/images/opt/unetlab/addons/qemu/windows iso/win2019cdrom.iso.wufofew7.partial"
2024-05-04 20:15:03.569 +02:00 [Information] Session 86: Started on connection from 192.168.2.123:48394.
2024-05-04 20:15:03.570 +02:00 [Warning] An existing connection was forcibly closed by the remote host.
2024-05-04 20:15:03.570 +02:00 [Warning] An existing connection was forcibly closed by the remote host.
2024-05-04 20:15:03.574 +02:00 [Information] Session 85: Attempting GetItemInfo FSO Read "/eve-ng-backup/eve-eve-ng-pro-20240504-200618/images/opt/unetlab/addons/qemu/windows iso/win2019cdrom.iso.wufofew7.partial"
2024-05-04 20:15:03.577 +02:00 [Information] Session 86: Authentication for 'xxxxx' succeeded.
2024-05-04 20:15:03.578 +02:00 [Information] Session 86: Attempting GetItemInfo FSO Read "/"
2024-05-04 20:15:03.579 +02:00 [Information] Session 86: Attempting DeleteFile FSO Delete "/eve-ng-backup/eve-eve-ng-pro-20240504-200618/images/opt/unetlab/addons/qemu/windows iso/win2022cdrom.iso.xejaxez2.partial"
2024-05-04 20:15:03.663 +02:00 [Information] Session 85: Attempting DeleteFile FSO Delete "/eve-ng-backup/eve-eve-ng-pro-20240504-200618/images/opt/unetlab/addons/qemu/windows iso/win10PROcdrom.iso.poyezix6.partial"
2024-05-04 20:15:03.663 +02:00 [Warning] An existing connection was forcibly closed by the remote host.
2024-05-04 20:15:03.664 +02:00 [Error] Session 81: Error: Rebex.Net.Protocols.Ssh.SshException: Error while sending packet data.
at rnvax.aklso.tyjjj(xejjn p0, Action p1)
at rnvax.olnhz.csvch(Int32 p0, Byte[] p1, Int32 p2, Int32 p3)
at rnvax.olnhz.fokqd(Byte[] p0, Int32 p1, Int32 p2)
at rnvax.exyss.nedxg(ArraySegment`1 p0, Action`1 p1)
at rnvax.deldt.bafwo(pepkp p0)
at rnvax.deldt.wmbgv(pepkp p0, Int32 p1)
at rnvax.deldt.yxhgp(pepkp p0)
2024-05-04 20:15:03.664 +02:00 [Warning] An existing connection was forcibly closed by the remote host.
2024-05-04 20:15:03.664 +02:00 [Warning] An existing connection was forcibly closed by the remote host.
2024-05-04 20:15:03.664 +02:00 [Warning] An existing connection was forcibly closed by the remote host.
2024-05-04 20:15:03.682 +02:00 [Information] Session 81: Closed connection from 192.168.2.123:48382.
2024-05-04 20:15:03.687 +02:00 [Information] Session 84: Closed connection from 192.168.2.123:48390.
2024-05-04 20:15:04.747 +02:00 [Information] Session 86: Attempting GetItemInfo FSO Read "/eve-ng-backup/eve-eve-ng-pro-20240504-200618/images/opt/unetlab/addons/qemu/windows iso/win2022cdrom.iso.xejaxez2.partial"

[rusty725]

[Warning] An existing connection was forcibly closed by the remote host.

something is cutting the connection on sftp side

[Soter]

I have managed to create a vsftpd on an Alma linux. After a backup for around 550GB of data, an restore on a new eve-ng 6.2 was attempted. It says restore complete after 10 sec. Only the labs are now on the system, but everyhing else is missing. A fail to open stream is listet as a warning.

ftp is testet with Filezilla, with no problems.

Backup is tried 2 times, One with"ALL" and one with "Mirrored" option. all data is backuped (550GB) same outcome with both restore attempt

Restore Backup════════════════════════════════════════════════════════════════╗
║ ║
║ Fixing Permissions ║
║ ------------------ ║
║ PHP Warning: file_get_contents(/opt/unetlab/platform): Failed to open ║
║ stream: No such file or directory in /opt/unetlab/html/includes/init.php ║
║ on line 116 ║
║ Jul 01 17:09:53 Jul 01 17:09:53 Online Check state: Valid ║
║ Please wait, Flushing and data copy is in progress ║
║ Done ║
║ { ║
║ "bytes": 29356, ║
║ "checks": 0, ║
║ "deletedDirs": 0, ║
║ "deletes": 0, ║
║ "elapsedTime": 28.601325669, ║
║ "errors": 0, ║
║ "eta": 0, ║
║ "fatalError": false, ║
║ "renames": 0, ║
║ "retryError": false, ║
║ "serverSideCopies": 0, ║
║ "serverSideCopyBytes": 0, ║
║ "serverSideMoveBytes": 0, ║
║ "serverSideMoves": 0, ║
║ "speed": 1956.6491686069646, ║
║ "totalBytes": 29356, ║
║ "totalChecks": 0, ║
║ "totalTransfers": 6, ║
║ "transferTime": 0.105864947, ║
║ "transfers": 6 ║
║ } ║
║ !!!!!!!!!! Restore complete !!!!!!!!!! ║
║ ║
║ ║
║ Back to main menu ║
║ ║
║ ║
║ ║
║ ║
║ ║
╚══════════════════════════════════════════════════════════════════════════════╝


what is going on here?

[rusty725]

you should've read about Mirroring backup how it works. It wiped your stuff.

[Soter]

well then explain the "all" funktion. it's the same outcome.

Besides the new install is empty, and need a new restore from the backup

[rusty725]

when you check mark "All" it doesn't select Mirroring. Mirroring is what messed up your backup.