Slow performance on Qemu images

[dgaglioni]

Hi all,

I've been trying to use EVE-NG in last few days using the versions 68 and 77, all these versions I had a very slow performance for Qemu images and the same issues below, for IOU and Dynamips it's working very well.

Here are some findings I got to troubleshoot this problem:

• Qemu x86 or i386 process always on 100% CPU

Code: Select all

root@eve-ng:/opt/unetlab/data/Logs# top
top - 09:11:04 up 21:13,  2 users,  load average: 2.13, 2.18, 2.20
Tasks: 179 total,   2 running, 177 sleeping,   0 stopped,   0 zombie
%Cpu(s):  7.8 us, 50.3 sy,  0.0 ni, 41.7 id,  0.1 wa,  0.0 hi,  0.1 si,  0.0 st
KiB Mem : 13745556 total,  5785924 free,  3994060 used,  3965572 buff/cache
KiB Swap:  6291452 total,  6291452 free,        0 used.  9214952 avail Mem

   PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
 11200 root      20   0 1598284 276540  20768 S 100.0  2.0   1263:38 qemu-system-i38
 31716 root      20   0 4825996 2.298g  20400 S  94.4 17.5 773:08.57 qemu-system-x86
  6915 root      20   0 3969592 1.023g  20692 S  29.2  7.8 424:15.74 qemu-system-x86
 11212 root      20   0       0      0      0 R   5.6  0.0  61:46.52 kvm-pit/11200
 32342 root      20   0 2289792 208900  20820 S   3.3  1.5  23:10.13 qemu-system-x86
   135 root      25   5       0      0      0 S   0.7  0.0  15:12.65 uksmd
  3585 root      20   0   93052   6708   5808 S   0.3  0.0   0:29.86 sshd
  6938 root      20   0       0      0      0 S   0.3  0.0   6:58.71 kvm-pit/6915
     1 root      20   0   37744   5652   3936 S   0.0  0.0   0:05.22 systemd
     2 root      20   0       0      0      0 S   0.0  0.0   0:00.08 kthreadd
     3 root      20   0       0      0      0 S   0.0  0.0   0:19.83 ksoftirqd/0
     5 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 kworker/0:0H
     7 root      20   0       0      0      0 S   0.0  0.0   0:26.11 rcu_sched
     8 root      20   0       0      0      0 S   0.0  0.0   0:00.00 rcu_bh
     9 root      rt   0       0      0      0 S   0.0  0.0   0:09.27 migration/0
    10 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 lru-add-drain
    11 root      rt   0       0      0      0 S   0.0  0.0   0:01.62 watchdog/0
    12 root      20   0       0      0      0 S   0.0  0.0   0:00.00 cpuhp/0
    13 root      20   0       0      0      0 S   0.0  0.0   0:00.00 cpuhp/1
    14 root      rt   0       0      0      0 S   0.0  0.0   0:01.87 watchdog/1
    15 root      rt   0       0      0      0 S   0.0  0.0   0:08.22 migration/1
    16 root      20   0       0      0      0 S   0.0  0.0   0:02.69 ksoftirqd/1
    18 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 kworker/1:0H
    19 root      20   0       0      0      0 S   0.0  0.0   0:00.00 cpuhp/2
    20 root      rt   0       0      0      0 S   0.0  0.0   0:02.51 watchdog/2
root@eve-ng:/opt/unetlab/data/Logs#

• IOSv L2, VyOS, IOS-XRv, CSR1000v all logging CPU HOG

Code: Select all

RP/0/0/CPU0:Aug 31 16:17:31.285 : wdsysmon[411]: Process devc-conaux pid 290833 prio 21 using 43 percent is the top user of CPU
RP/0/0/CPU0:Aug 31 16:17:31.285 : wdsysmon[411]: Process devc-conaux pid 290833 tid 5 prio 21 using 43 percent is a CPU Hog and terminated
RP/0/0/CPU0:Aug 31 16:17:38.214 : sysmgr[73]: devc-conaux(1) (jid 52) (pid 290833) (fail_count 1) abnormally terminated, restart scheduled

*Aug 31 17:39:12.753: %EVENTLIB-3-CPUHOG: F0: smand:  read asyncon 0xd68af20: 2144ms, Traceback=1#12a2b644f4e51730da5870f3c96d8c83   binos:F74A2000+BFB9 :F7796000+400 lua:F6FD9000+EECA lua:F6FD9000+F233 lua:F6FD9000+4B2E :8048000+47D11 :8048000+2B3F5 :8048000+2B906 :8048000+2C873 :8048000+2E1E4 :8048000+27370
*Aug 31 17:39:12.753: %EVENTLIB-3-CPUHOG: F0: smand:  read asyncon 0xd68af20: 3220ms, Traceback=1#12a2b644f4e51730da5870f3c96d8c83   binos:F74A2000+BFB9 :F7796000+400 lua:F6FD9000+F24D lua:F6FD9000+4B2E :8048000+47D11 :8048000+2B3F5 :8048000+2B906 :8048000+2C873 :8048000+2E1E4 :8048000+27370 :8048000+33C20
*Sep  1 05:51:44.679: %EVENTLIB-3-CPUHOG: F0: smand:  read asyncon 0xd68af20: 1380ms, Traceback=1#12a2b644f4e51730da5870f3c96d8c83   binos:F74A2000+BFB9 :F7796000+400 lua:F6FD9000+EECA lua:F6FD9000+F233 lua:F6FD9000+4B2E :8048000+47D11 :8048000+2B3F5 :8048000+2B906 :8048000+2C873 :8048000+2E1E4 :8048000+27370
*Sep  1 05:51:52.507: %EVENTLIB-3-CPUHOG: F0: smand:  undefined: 1072ms, Traceback=1#12a2b644f4e51730da5870f3c96d8c83   binos:F74A2000+BFB9 :F7796000+400 lua:F6FD9000+EECA lua:F6FD9000+F233 lua:F6FD9000+4B2E :8048000+47891 :8048000+4D3CC evlib:F74EC000+B02A evlib:F74EC000+D2E2 :8048000+45CDB c:F6CEB000+16670
CSR1000V#

vyos@vyos:~$
z - Process "EEM Server", CPU hog, PC 0x008FD5B5636E5z 37634CAz 375AD50z 36DE8B0

  Invalid command: [-Traceback=]

vyos@vyos:~$
z - Process "EEM Server", CPU hog, PC 0x034764AEE8229z 36D250Dz 36D16A7z 3763AF2

  Invalid command: [-Traceback=]

vyos@vyos:~$
z - Process "EEM Server", CPU hog, PC 063716z 37634CAz 375AD50z 36DE8B0z 36E8229


  Invalid command: [-Traceback=]


Cisco IOS Software, vios_l2 Software (vios_l2-ADVENTERPRISEK9-M), Version 15.2(4                                   .0.55)E, TEST ENGINEERING ESTG_WEEKLY BUILD, synced to  END_OF_FLO_ISP
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2015 by Cisco Systems, Inc.
Compiled Tue 28-Jul-15 18:52 by sasyamal


-Traceback= 1DBB7C8z 8DBFE5z 90522Ez 904F50z 904D5Dz 900F45z 901B7Bz 901B0Fz 3DF                                   2683z 347A3CFz 877DF0z 87FBA9z 34A58EBz 34A5809z 7CC765z 7EA38Bz - Process "Net                                    Background", CPU hog, PC 0x03DF29F5

-Traceback= 1DBB7C8z 8DBFE5z 90522Ez 904F50z 904D5Dz 900F45z 901B7Bz 901B0Fz 345                                   60BEz 345698Ez 34A6255z 34A5C22z 34A5809z 7EA215z 7EA390z - Process "Net Backgro                                   und", CPU hog, PC 0x008FD5AD

-Traceback= 1DBB7C8z 8DBFE5z 90522Ez 904F50z 904D5Dz 900F45z 901B7Bz 901B0Fz 1DA                                   F60Az 1DE0921z 36C8438z 36D0421z 37B9783z 37F2F18z - Process "EEM ED Identity",                                    CPU hog, PC 0x008FD44A

-Traceback= 1DBB7C8z 8DBFE5z 90522Ez 904F50z 904D5Dz 900F45z 901B7Bz 901B0Fz 1DE                                   09DCz 36C8438z 36D0421z 37B9783z 37F2F18z - Process "EEM ED Identity", CPU hog,                                    PC 0x008FD5B5

• All images taking more than 30 minutes do boot (IOS-XRv took about 1h)

• EVE logging "ERROR: QEMU Arch is not set (80015)."

Code: Select all

root@eve-ng:/opt/unetlab/data/Logs# vi unl_wrapper.txt
Aug 31 10:59:29 INFO: tunctl -u unl0 -g root -t vunl0_1_0 2>&1
Aug 31 10:59:29 INFO: tunctl -u unl0 -g root -t vunl0_1_1 2>&1
Aug 31 10:59:29 INFO: tunctl -u unl0 -g root -t vunl0_1_2 2>&1
Aug 31 10:59:29 INFO: tunctl -u unl0 -g root -t vunl0_1_3 2>&1
Aug 31 10:59:33 ERROR: QEMU Arch is not set (80015).
Aug 31 10:59:33 INFO: CWD is /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/1
Aug 31 10:59:33 INFO: starting /opt/unetlab/wrappers/qemu_wrapper -T 0 -D 1 -t "xrv" -F /opt/qemu/bin/qemu-system-x86_64 -d 0 --  -nographic -device virtio-net-pci,netdev=net0,mac=50:00:00:01:00:00 -netdev tap,id=net0,ifname=vunl0_1_0,script=no -device virtio-net-pci,netdev=net1,mac=50:00:00:01:00:01 -netdev tap,id=net1,ifname=vunl0_1_1,script=no -device virtio-net-pci,netdev=net2,mac=50:00:00:01:00:02 -netdev tap,id=net2,ifname=vunl0_1_2,script=no -device virtio-net-pci,netdev=net3,mac=50:00:00:01:00:03 -netdev tap,id=net3,ifname=vunl0_1_3,script=no -smp 1 -m 3072 -name xrv -uuid e97efecd-60bb-4f69-b1ea-544854fea1ce -hda hda.qcow2 -machine type=pc,accel=kvm,usb=off -serial mon:stdio -nographic -nodefconfig -nodefaults -rtc base=utc,driftfix=slew -global kvm-pit.lost_tick_policy=discard -no-hpet -realtime mlock=off -no-shutdown -boot order=c > /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/1/wrapper.txt 2>&1 &
Aug 31 11:02:56 INFO: tunctl -u unl0 -g root -t vunl0_2_0 2>&1
Aug 31 11:02:56 INFO: tunctl -u unl0 -g root -t vunl0_2_1 2>&1
Aug 31 11:02:56 INFO: tunctl -u unl0 -g root -t vunl0_2_2 2>&1
Aug 31 11:02:56 INFO: tunctl -u unl0 -g root -t vunl0_2_3 2>&1
Aug 31 11:02:56 ERROR: QEMU Arch is not set (80015).
Aug 31 11:02:56 INFO: CWD is /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/2
Aug 31 11:02:56 INFO: starting /opt/unetlab/wrappers/qemu_wrapper -T 0 -D 2 -t "Switch" -F /opt/qemu/bin/qemu-system-i386 -d 0 --  -nographic -device e1000,netdev=net0,mac=50:00:00:02:00:00 -netdev tap,id=net0,ifname=vunl0_2_0,script=no -device e1000,netdev=net1,mac=50:00:00:02:00:01 -netdev tap,id=net1,ifname=vunl0_2_1,script=no -device e1000,netdev=net2,mac=50:00:00:02:00:02 -netdev tap,id=net2,ifname=vunl0_2_2,script=no -device e1000,netdev=net3,mac=50:00:00:02:00:03 -netdev tap,id=net3,ifname=vunl0_2_3,script=no -smp 1 -m 768 -name Switch -uuid d992ad03-42ce-439f-be88-52197da972b2 -drive file=virtioa.qcow2,if=virtio,bus=0,unit=0,cache=none -machine type=pc-1.0,accel=kvm -serial mon:stdio -nographic -nodefconfig -nodefaults -rtc base=utc > /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/2/wrapper.txt 2>&1 &
Aug 31 18:34:47 INFO: tunctl -u unl0 -g root -t vunl0_3_0 2>&1
Aug 31 18:34:48 INFO: tunctl -u unl0 -g root -t vunl0_3_1 2>&1
Aug 31 18:34:48 INFO: tunctl -u unl0 -g root -t vunl0_3_2 2>&1
Aug 31 18:34:48 INFO: tunctl -u unl0 -g root -t vunl0_3_3 2>&1
Aug 31 18:34:48 ERROR: QEMU Arch is not set (80015).
Aug 31 18:34:48 INFO: CWD is /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/3
Aug 31 18:34:48 INFO: starting /opt/unetlab/wrappers/qemu_wrapper -T 0 -D 3 -t "CSR" -F /opt/qemu-2.2.0/bin/qemu-system-x86_64 -d 0 --  -nographic -device e1000,netdev=net0,mac=50:00:00:03:00:00 -netdev tap,id=net0,ifname=vunl0_3_0,script=no -device e1000,netdev=net1,mac=50:00:00:03:00:01 -netdev tap,id=net1,ifname=vunl0_3_1,script=no -device e1000,netdev=net2,mac=50:00:00:03:00:02 -netdev tap,id=net2,ifname=vunl0_3_2,script=no -device e1000,netdev=net3,mac=50:00:00:03:00:03 -netdev tap,id=net3,ifname=vunl0_3_3,script=no -smp 1 -m 3072 -name CSR -uuid 9df0796a-38b5-4a73-add8-20cd0cea1725 -drive file=virtioa.qcow2,if=virtio,bus=0,unit=0,cache=none -machine type=pc-1.0,accel=kvm -serial mon:stdio -nographic -nodefconfig -nodefaults -rtc base=utc > /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/3/wrapper.txt 2>&1 &
Aug 31 18:35:23 INFO: tunctl -u unl0 -g root -t vunl0_4_0 2>&1
Aug 31 18:35:23 INFO: tunctl -u unl0 -g root -t vunl0_4_1 2>&1
Aug 31 18:35:23 INFO: tunctl -u unl0 -g root -t vunl0_4_2 2>&1
Aug 31 18:35:23 INFO: tunctl -u unl0 -g root -t vunl0_4_3 2>&1
Aug 31 18:35:23 ERROR: QEMU Arch is not set (80015).
Aug 31 18:35:23 INFO: CWD is /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/4
Aug 31 18:35:23 INFO: starting /opt/unetlab/wrappers/qemu_wrapper -T 0 -D 4 -t "VyOS" -F /opt/qemu/bin/qemu-system-x86_64 -d 0 --  -nographic -device virtio-net-pci,netdev=net0,mac=50:00:00:04:00:00 -netdev tap,id=net0,ifname=vunl0_4_0,script=no -device virtio-net-pci,netdev=net1,mac=50:00:00:04:00:01 -netdev tap,id=net1,ifname=vunl0_4_1,script=no -device virtio-net-pci,netdev=net2,mac=50:00:00:04:00:02 -netdev tap,id=net2,ifname=vunl0_4_2,script=no -device virtio-net-pci,netdev=net3,mac=50:00:00:04:00:03 -netdev tap,id=net3,ifname=vunl0_4_3,script=no -smp 1 -m 512 -name VyOS -uuid 5ee75ec7-1fca-4bd9-8be5-9ed6e7df1856 -drive file=virtioa.qcow2,if=virtio,bus=0,unit=0,cache=none -machine type=pc-1.0,accel=kvm -serial mon:stdio -nographic -nodefconfig -nodefaults -rtc base=utc > /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/4/wrapper.txt 2>&1 &
~

My specs:

Hardware : CPU - i7-4702HQ CPU @ 2.20GHz (4 Cores/8 threads), 16GB RAM, 256SSD and 1TB HDD, using VMnet8 (NAT)

EVE-NG Running on - VM Work Station 12.5.7 build-5813279 (PRO), I tried with a "older" 12 version and different number of processors and cores per processors but didn't work

VT-X - Enabled

Just FYI I tried the solution of this topic, but it didn't work
http://www.eve-ng.net/forum/viewtopic.p ... 0015#p3462

Any help is really appreciated, if you guys need any output just let me know.

Thank you!

[Uldis (UD)]

Q: Why Qemu nodes are slow on my I7 64G ram ?
A: Typically, Antivirus deep inspection slow down Vmware Workstation and Virtual machines. Last observation was that even nodes (vIOS, CSR) running on EVE were under AV inspection. Avoid using AV on Vmware binary.

[dgaglioni]

Q: Why Qemu nodes are slow on my I7 64G ram ?
A: Typically, Antivirus deep inspection slow down Vmware Workstation and Virtual machines. Last observation was that even nodes (vIOS, CSR) running on EVE were under AV inspection. Avoid using AV on Vmware binary.

Hi thank you for help!

Unfortunately it's not applicable, currently I disabled my AV (Avast IS).

I did another test with a ASAv and got the following message:

Code: Select all

(process:4057): GLib-WARNING **: /build/glib2.0-prJhLS/glib2.0-2.48.2/./glib/gmem.c:483: custom memory allocation vtable not supported

[Uldis (UD)]

something is done wrong during upgrade, like when it prompted upgrade kernel or not, probably answered Y
but must be N
One tip in future upgrades whatever it asking on prompt just hit enter...

Very tough to answer why you have such issue.

[dgaglioni]

something is done wrong during upgrade, like when it prompted upgrade kernel or not, probably answered Y
but must be N
One tip in future upgrades whatever it asking on prompt just hit enter...

Very tough to answer why you have such issue.

I thought that was an issue with version 68 then I upgraded it but the issue continued, so I deleted the VM and downloaded the 77 version from eve-ng site, all I did on this version so far was an "apt-get update".

Code: Select all

root@eve-ng:/# uname -a
Linux eve-ng 4.9.40-eve-ng-ukms+ #2 SMP Sat Aug 5 14:35:59 CEST 2017 x86_64 x86_64 x86_64 GNU/Linux
root@eve-ng:/#

[Uldis (UD)]

then need check whats wrong with your PC..because OVA presented in our site is all right.
Personally compiled it and tested a lot..no such issues observed...

regarding Avast, no need it turn off but, go to Avast Settings/Trubleshoot and uncheck Enable hardware-assisted virtualization. Reboot PC is requred.
CPU settings, give 8/1, RAM as much you can afford.
and then lets try.

Our eve OVA v77 even after update command all should be fine.

UD

[dgaglioni]

then need check whats wrong with your PC..because OVA presented in our site is all right.
Personally compiled it and tested a lot..no such issues observed...

regarding Avast, no need it turn off but, go to Avast Settings/Trubleshoot and uncheck Enable hardware-assisted virtualization. Reboot PC is requred.
CPU settings, give 8/1, RAM as much you can afford.
and then lets try.

Our eve OVA v77 even after update command all should be fine.

UD

Looks like I got some progress! The booting time is much better and the images response are good.

With -machine type=pc-1.0,accel=kvm (bad performance for my IOSv)

Code: Select all

top - 12:54:23 up  1:10,  1 user,  load average: 1.02, 1.54, 2.04
Tasks: 160 total,   1 running, 159 sleeping,   0 stopped,   0 zombie
%Cpu(s):  2.5 us, 24.1 sy,  0.0 ni, 73.3 id,  0.2 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem : 13745556 total, 12480160 free,   599408 used,   665988 buff/cache
KiB Swap:  6291452 total,  6291452 free,        0 used. 12779896 avail Mem

   PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
 33761 root      20   0 1339568 178544  20644 S 100.0  1.3   5:17.83 qemu-system-i38 <====== 100%
 33797 root      20   0       0      0      0 S   7.0  0.0   0:10.81 kvm-pit/33761 <================ What is that ?

Without -machine type=pc-1.0,accel=kvm

Code: Select all

root@eve-ng:/# top
top - 13:11:54 up  1:27,  1 user,  load average: 1.46, 1.38, 1.50
Tasks: 170 total,   3 running, 167 sleeping,   0 stopped,   0 zombie
%Cpu(s): 25.6 us,  7.2 sy,  0.0 ni, 67.1 id,  0.0 wa,  0.0 hi,  0.1 si,  0.0 st
KiB Mem : 13745556 total, 11035944 free,  2010628 used,   698984 buff/cache
KiB Swap:  6291452 total,  6291452 free,        0 used. 11347372 avail Mem

   PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
 44867 root      20   0 4419616 999100  21052 S  99.0  7.3   3:28.52 qemu-system-x86
 40384 root      20   0 1540912 438740  20924 R  21.3  3.2   3:51.93 qemu-system-i38 <==== NO HIGH CPU ON i386
 42950 root      20   0 1540912 429380  20904 R  19.3  3.1   3:28.10 qemu-system-i38 <==== NO HIGH CPU ON i386

Keep you guys posted on my next tests for qemu-system-x86_64

[breakintheweb]

Could be beneficial to post the log from /opt/unetlab/data/logs/unl_wrapper.

[dgaglioni]

Could be beneficial to post the log from /opt/unetlab/data/logs/unl_wrapper.

Hi, I've been doing some tests and removing -machine type=pc-1.0,accel=kvm on qemu-system-x86_64 images, current tests:

ASAv - NOK (9.5.1/9.7.1)
CSR1000v - OK (15.6(1)S)
IOS-XRv - OK (6.0.1)

I'll keep testing with other images and let you guys know, below the unl_wrapper logs:

Code: Select all

Sep 01 23:56:54 INFO: stopping fuser -n tcp -k -TERM 32774 > /dev/null 2>&1

Sep 01 23:51:07 INFO: stopping fuser -n tcp -k -TERM 32773 > /dev/null 2>&1

Sep 01 23:51:07 INFO: stopping fuser -n tcp -k -TERM 32769 > /dev/null 2>&1

Sep 01 23:51:07 INFO: stopping fuser -n tcp -k -TERM 32771 > /dev/null 2>&1

Sep 01 23:51:07 INFO: stopping fuser -n tcp -k -TERM 32770 > /dev/null 2>&1

Sep 01 23:50:40 INFO: starting /opt/unetlab/wrappers/qemu_wrapper -T 0 -D 6 -t "ASAv" -F /opt/qemu/bin/qemu-system-x86_64 -d 0 -- -nographic -device e1000,netdev=net0,mac=50:00:00:06:00:00 -netdev tap,id=net0,ifname=vunl0_6_0,script=no -device e1000,netdev=net1,mac=50:00:00:06:00:01 -netdev tap,id=net1,ifname=vunl0_6_1,script=no -device e1000,netdev=net2,mac=50:00:00:06:00:02 -netdev tap,id=net2,ifname=vunl0_6_2,script=no -device e1000,netdev=net3,mac=50:00:00:06:00:03 -netdev tap,id=net3,ifname=vunl0_6_3,script=no -device e1000,netdev=net4,mac=50:00:00:06:00:04 -netdev tap,id=net4,ifname=vunl0_6_4,script=no -device e1000,netdev=net5,mac=50:00:00:06:00:05 -netdev tap,id=net5,ifname=vunl0_6_5,script=no -device e1000,netdev=net6,mac=50:00:00:06:00:06 -netdev tap,id=net6,ifname=vunl0_6_6,script=no -device e1000,netdev=net7,mac=50:00:00:06:00:07 -netdev tap,id=net7,ifname=vunl0_6_7,script=no -smp 1 -m 2048 -name ASAv -uuid 79747b19-d45b-48b5-bbef-f9f8bc834551 -drive file=virtioa.qcow2,if=virtio,bus=0,unit=0,cache=none -machine type=pc-1.0,accel=kvm -serial mon:stdio -nographic -nodefconfig -nodefaults -display none -vga std -rtc base=utc > /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/6/wrapper.txt 2>&1 &

Sep 01 23:50:40 INFO: CWD is /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/6

Sep 01 23:50:40 ERROR: QEMU Arch is not set (80015).

Sep 01 23:50:40 INFO: tunctl -u unl0 -g root -t vunl0_6_7 2>&1

Sep 01 23:50:40 INFO: tunctl -u unl0 -g root -t vunl0_6_6 2>&1

Sep 01 23:50:40 INFO: tunctl -u unl0 -g root -t vunl0_6_5 2>&1

Sep 01 23:50:40 INFO: tunctl -u unl0 -g root -t vunl0_6_4 2>&1

Sep 01 23:50:40 INFO: tunctl -u unl0 -g root -t vunl0_6_3 2>&1

Sep 01 23:50:40 INFO: tunctl -u unl0 -g root -t vunl0_6_2 2>&1

Sep 01 23:50:39 INFO: tunctl -u unl0 -g root -t vunl0_6_1 2>&1

Sep 01 23:50:39 INFO: tunctl -u unl0 -g root -t vunl0_6_0 2>&1

Sep 01 23:50:35 INFO: stopping fuser -n tcp -k -TERM 32772 > /dev/null 2>&1

Sep 01 23:44:47 INFO: starting /opt/unetlab/wrappers/qemu_wrapper -T 0 -D 4 -t "ASAv" -F /opt/qemu/bin/qemu-system-x86_64 -d 0 -- -nographic -device e1000,netdev=net0,mac=50:00:00:04:00:00 -netdev tap,id=net0,ifname=vunl0_4_0,script=no -device e1000,netdev=net1,mac=50:00:00:04:00:01 -netdev tap,id=net1,ifname=vunl0_4_1,script=no -device e1000,netdev=net2,mac=50:00:00:04:00:02 -netdev tap,id=net2,ifname=vunl0_4_2,script=no -device e1000,netdev=net3,mac=50:00:00:04:00:03 -netdev tap,id=net3,ifname=vunl0_4_3,script=no -device e1000,netdev=net4,mac=50:00:00:04:00:04 -netdev tap,id=net4,ifname=vunl0_4_4,script=no -device e1000,netdev=net5,mac=50:00:00:04:00:05 -netdev tap,id=net5,ifname=vunl0_4_5,script=no -device e1000,netdev=net6,mac=50:00:00:04:00:06 -netdev tap,id=net6,ifname=vunl0_4_6,script=no -device e1000,netdev=net7,mac=50:00:00:04:00:07 -netdev tap,id=net7,ifname=vunl0_4_7,script=no -smp 1 -m 2048 -name ASAv -uuid 1985b708-a173-4626-b160-c460e1b92809 -drive file=virtioa.qcow2,if=virtio,bus=0,unit=0,cache=none -machine type=pc-1.0,accel=kvm -serial mon:stdio -nographic -nodefconfig -nodefaults -display none -vga std -rtc base=utc > /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/4/wrapper.txt 2>&1 &

Sep 01 23:44:47 INFO: CWD is /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/4

Sep 01 23:44:47 ERROR: QEMU Arch is not set (80015).

Sep 01 23:44:47 INFO: tunctl -u unl0 -g root -t vunl0_4_7 2>&1

Sep 01 23:44:47 INFO: tunctl -u unl0 -g root -t vunl0_4_6 2>&1

Sep 01 23:44:47 INFO: tunctl -u unl0 -g root -t vunl0_4_5 2>&1

Sep 01 23:44:47 INFO: tunctl -u unl0 -g root -t vunl0_4_4 2>&1

Sep 01 23:44:47 INFO: tunctl -u unl0 -g root -t vunl0_4_3 2>&1

Sep 01 23:44:47 INFO: tunctl -u unl0 -g root -t vunl0_4_2 2>&1

Sep 01 23:44:47 INFO: tunctl -u unl0 -g root -t vunl0_4_1 2>&1

Sep 01 23:44:47 INFO: tunctl -u unl0 -g root -t vunl0_4_0 2>&1

Sep 01 23:43:41 INFO: starting /opt/unetlab/wrappers/qemu_wrapper -T 0 -D 4 -t "ASAv" -F /opt/qemu/bin/qemu-system-x86_64 -d 0 -- -nographic -device e1000,netdev=net0,mac=50:00:00:04:00:00 -netdev tap,id=net0,ifname=vunl0_4_0,script=no -device e1000,netdev=net1,mac=50:00:00:04:00:01 -netdev tap,id=net1,ifname=vunl0_4_1,script=no -device e1000,netdev=net2,mac=50:00:00:04:00:02 -netdev tap,id=net2,ifname=vunl0_4_2,script=no -device e1000,netdev=net3,mac=50:00:00:04:00:03 -netdev tap,id=net3,ifname=vunl0_4_3,script=no -device e1000,netdev=net4,mac=50:00:00:04:00:04 -netdev tap,id=net4,ifname=vunl0_4_4,script=no -device e1000,netdev=net5,mac=50:00:00:04:00:05 -netdev tap,id=net5,ifname=vunl0_4_5,script=no -device e1000,netdev=net6,mac=50:00:00:04:00:06 -netdev tap,id=net6,ifname=vunl0_4_6,script=no -device e1000,netdev=net7,mac=50:00:00:04:00:07 -netdev tap,id=net7,ifname=vunl0_4_7,script=no -smp 1 -m 2048 -name ASAv -uuid 1985b708-a173-4626-b160-c460e1b92809 -drive file=virtioa.qcow2,if=virtio,bus=0,unit=0,cache=none -serial > /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/4/wrapper.txt 2>&1 &

Sep 01 23:43:41 INFO: CWD is /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/4

Sep 01 23:43:41 ERROR: QEMU Arch is not set (80015).

Sep 01 23:43:41 INFO: tunctl -u unl0 -g root -t vunl0_4_7 2>&1

Sep 01 23:43:41 INFO: tunctl -u unl0 -g root -t vunl0_4_6 2>&1

Sep 01 23:43:41 INFO: tunctl -u unl0 -g root -t vunl0_4_5 2>&1

Sep 01 23:43:41 INFO: tunctl -u unl0 -g root -t vunl0_4_4 2>&1

Sep 01 23:43:41 INFO: tunctl -u unl0 -g root -t vunl0_4_3 2>&1

Sep 01 23:43:41 INFO: tunctl -u unl0 -g root -t vunl0_4_2 2>&1

Sep 01 23:43:41 INFO: tunctl -u unl0 -g root -t vunl0_4_1 2>&1

Sep 01 23:43:41 INFO: tunctl -u unl0 -g root -t vunl0_4_0 2>&1

Sep 01 23:42:33 INFO: stopping fuser -n tcp -k -TERM 32772 > /dev/null 2>&1

Sep 01 23:42:00 INFO: starting /opt/unetlab/wrappers/qemu_wrapper -T 0 -D 4 -t "ASAv" -F /opt/qemu/bin/qemu-system-x86_64 -d 0 -- -nographic -device e1000,netdev=net0,mac=50:00:00:04:00:00 -netdev tap,id=net0,ifname=vunl0_4_0,script=no -device e1000,netdev=net1,mac=50:00:00:04:00:01 -netdev tap,id=net1,ifname=vunl0_4_1,script=no -device e1000,netdev=net2,mac=50:00:00:04:00:02 -netdev tap,id=net2,ifname=vunl0_4_2,script=no -device e1000,netdev=net3,mac=50:00:00:04:00:03 -netdev tap,id=net3,ifname=vunl0_4_3,script=no -device e1000,netdev=net4,mac=50:00:00:04:00:04 -netdev tap,id=net4,ifname=vunl0_4_4,script=no -device e1000,netdev=net5,mac=50:00:00:04:00:05 -netdev tap,id=net5,ifname=vunl0_4_5,script=no -device e1000,netdev=net6,mac=50:00:00:04:00:06 -netdev tap,id=net6,ifname=vunl0_4_6,script=no -device e1000,netdev=net7,mac=50:00:00:04:00:07 -netdev tap,id=net7,ifname=vunl0_4_7,script=no -smp 1 -m 2048 -name ASAv -uuid 1985b708-a173-4626-b160-c460e1b92809 -drive file=virtioa.qcow2,if=virtio,bus=0,unit=0,cache=none -serial mon:stdio -nographic -nodefconfig -nodefaults -display none -vga std -rtc base=utc > /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/4/wrapper.txt 2>&1 &

Sep 01 23:42:00 INFO: CWD is /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/4

Sep 01 23:42:00 ERROR: QEMU Arch is not set (80015).

Sep 01 23:42:00 INFO: tunctl -u unl0 -g root -t vunl0_4_7 2>&1

Sep 01 23:41:59 INFO: tunctl -u unl0 -g root -t vunl0_4_6 2>&1

Sep 01 23:41:59 INFO: tunctl -u unl0 -g root -t vunl0_4_5 2>&1

Sep 01 23:41:59 INFO: tunctl -u unl0 -g root -t vunl0_4_4 2>&1

Sep 01 23:41:58 INFO: tunctl -u unl0 -g root -t vunl0_4_3 2>&1

Sep 01 23:41:58 INFO: tunctl -u unl0 -g root -t vunl0_4_2 2>&1

Sep 01 23:41:58 INFO: tunctl -u unl0 -g root -t vunl0_4_1 2>&1

Sep 01 23:41:58 INFO: tunctl -u unl0 -g root -t vunl0_4_0 2>&1

Sep 01 23:32:15 INFO: starting /opt/unetlab/wrappers/qemu_wrapper -T 0 -D 5 -t "NXOS" -F /opt/qemu/bin/qemu-system-x86_64 -d 0 -- -nographic -device e1000,addr=3.0,multifunction=on,netdev=net0,mac=50:00:00:05:00:00 -netdev tap,id=net0,ifname=vunl0_5_0,script=no -device e1000,addr=3.1,multifunction=on,netdev=net1,mac=50:00:00:05:00:01 -netdev tap,id=net1,ifname=vunl0_5_1,script=no -device e1000,addr=3.2,multifunction=on,netdev=net2,mac=50:00:00:05:00:02 -netdev tap,id=net2,ifname=vunl0_5_2,script=no -device e1000,addr=3.3,multifunction=on,netdev=net3,mac=50:00:00:05:00:03 -netdev tap,id=net3,ifname=vunl0_5_3,script=no -smp 1 -m 4096 -name NXOS -uuid a1294f97-cb8c-44f0-bfae-35739a84ef08 -drive file=virtioa.qcow2,if=virtio,bus=0,unit=0,cache=none -machine type=pc-1.0,accel=kvm -serial mon:stdio -nographic -nodefconfig -nodefaults -rtc base=utc > /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/5/wrapper.txt 2>&1 &

Sep 01 23:32:15 INFO: CWD is /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/5

Sep 01 23:32:15 ERROR: QEMU Arch is not set (80015).

Sep 01 23:32:15 INFO: tunctl -u unl0 -g root -t vunl0_5_3 2>&1

Sep 01 23:32:15 INFO: tunctl -u unl0 -g root -t vunl0_5_2 2>&1

Sep 01 23:32:15 INFO: tunctl -u unl0 -g root -t vunl0_5_1 2>&1

Sep 01 23:32:15 INFO: tunctl -u unl0 -g root -t vunl0_5_0 2>&1

Sep 01 23:32:10 INFO: stopping fuser -n tcp -k -TERM 32772 > /dev/null 2>&1

Sep 01 23:25:22 INFO: starting /opt/unetlab/wrappers/qemu_wrapper -T 0 -D 4 -t "ASAv" -F /opt/qemu/bin/qemu-system-x86_64 -d 0 -- -nographic -device e1000,netdev=net0,mac=50:00:00:04:00:00 -netdev tap,id=net0,ifname=vunl0_4_0,script=no -device e1000,netdev=net1,mac=50:00:00:04:00:01 -netdev tap,id=net1,ifname=vunl0_4_1,script=no -device e1000,netdev=net2,mac=50:00:00:04:00:02 -netdev tap,id=net2,ifname=vunl0_4_2,script=no -device e1000,netdev=net3,mac=50:00:00:04:00:03 -netdev tap,id=net3,ifname=vunl0_4_3,script=no -device e1000,netdev=net4,mac=50:00:00:04:00:04 -netdev tap,id=net4,ifname=vunl0_4_4,script=no -device e1000,netdev=net5,mac=50:00:00:04:00:05 -netdev tap,id=net5,ifname=vunl0_4_5,script=no -device e1000,netdev=net6,mac=50:00:00:04:00:06 -netdev tap,id=net6,ifname=vunl0_4_6,script=no -device e1000,netdev=net7,mac=50:00:00:04:00:07 -netdev tap,id=net7,ifname=vunl0_4_7,script=no -smp 1 -m 2048 -name ASAv -uuid 1985b708-a173-4626-b160-c460e1b92809 -drive file=virtioa.qcow2,if=virtio,bus=0,unit=0,cache=none -serial mon:stdio -nographic -nodefconfig -nodefaults -display none -vga std -rtc base=utc > /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/4/wrapper.txt 2>&1 &

Sep 01 23:25:22 INFO: CWD is /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/4

Sep 01 23:25:22 ERROR: QEMU Arch is not set (80015).

Sep 01 23:25:22 INFO: tunctl -u unl0 -g root -t vunl0_4_7 2>&1

Sep 01 23:25:22 INFO: tunctl -u unl0 -g root -t vunl0_4_6 2>&1

Sep 01 23:25:22 INFO: tunctl -u unl0 -g root -t vunl0_4_5 2>&1

Sep 01 23:25:22 INFO: tunctl -u unl0 -g root -t vunl0_4_4 2>&1

Sep 01 23:25:22 INFO: tunctl -u unl0 -g root -t vunl0_4_3 2>&1

Sep 01 23:25:22 INFO: tunctl -u unl0 -g root -t vunl0_4_2 2>&1

Sep 01 23:25:22 INFO: tunctl -u unl0 -g root -t vunl0_4_1 2>&1

Sep 01 23:25:22 INFO: tunctl -u unl0 -g root -t vunl0_4_0 2>&1

Sep 01 23:24:58 INFO: stopping fuser -n tcp -k -TERM 32772 > /dev/null 2>&1

Sep 01 23:24:51 WARNING: Node has no valid image (40025).

Sep 01 23:24:51 WARNING: Attribute ignored, invalid node_image (40006).

Sep 01 23:24:51 WARNING: Node has no valid image (40025).

Sep 01 23:24:51 WARNING: Attribute ignored, invalid node_image (40006).

Sep 01 23:24:51 WARNING: Node has no valid image (40025).

Sep 01 23:24:51 WARNING: Attribute ignored, invalid node_image (40006).

Sep 01 23:24:46 Sep 01 23:24:46 ERROR: Failed to start node (12).

Sep 01 23:24:46 Sep 01 23:24:46 ERROR: Failed to build CMD line (80046).

Sep 01 23:24:46 ERROR: Failed to build CMD line (80046).

Sep 01 23:24:46 ERROR: Image not found (80014).

Sep 01 23:24:46 INFO: tunctl -u unl0 -g root -t vunl0_5_0 2>&1

Sep 01 23:24:46 WARNING: Node has no valid image (40025).

Sep 01 23:24:46 WARNING: Attribute ignored, invalid node_image (40006).

Sep 01 23:24:22 Sep 01 23:24:22 ERROR: Failed to start node (12).

Sep 01 23:24:22 Sep 01 23:24:22 ERROR: Failed to build CMD line (80046).

Sep 01 23:24:22 ERROR: Failed to build CMD line (80046).

Sep 01 23:24:22 ERROR: Image not found (80014).

Sep 01 23:24:22 INFO: tunctl -u unl0 -g root -t vunl0_5_0 2>&1

Sep 01 23:24:22 WARNING: Node has no valid image (40025).

Sep 01 23:24:22 WARNING: Attribute ignored, invalid node_image (40006).

Sep 01 23:21:05 INFO: starting /opt/unetlab/wrappers/qemu_wrapper -T 0 -D 4 -t "ASAv" -F /opt/qemu/bin/qemu-system-x86_64 -d 0 -- -nographic -device e1000,netdev=net0,mac=50:00:00:04:00:00 -netdev tap,id=net0,ifname=vunl0_4_0,script=no -device e1000,netdev=net1,mac=50:00:00:04:00:01 -netdev tap,id=net1,ifname=vunl0_4_1,script=no -device e1000,netdev=net2,mac=50:00:00:04:00:02 -netdev tap,id=net2,ifname=vunl0_4_2,script=no -device e1000,netdev=net3,mac=50:00:00:04:00:03 -netdev tap,id=net3,ifname=vunl0_4_3,script=no -device e1000,netdev=net4,mac=50:00:00:04:00:04 -netdev tap,id=net4,ifname=vunl0_4_4,script=no -device e1000,netdev=net5,mac=50:00:00:04:00:05 -netdev tap,id=net5,ifname=vunl0_4_5,script=no -device e1000,netdev=net6,mac=50:00:00:04:00:06 -netdev tap,id=net6,ifname=vunl0_4_6,script=no -device e1000,netdev=net7,mac=50:00:00:04:00:07 -netdev tap,id=net7,ifname=vunl0_4_7,script=no -smp 1 -m 2048 -name ASAv -uuid 1985b708-a173-4626-b160-c460e1b92809 -drive file=virtioa.qcow2,if=virtio,bus=0,unit=0,cache=none -machine type=pc-1.0,accel=kvm -serial mon:stdio -nographic -nodefconfig -nodefaults -display none -vga std -rtc base=utc > /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/4/wrapper.txt 2>&1 &

Sep 01 23:21:05 INFO: CWD is /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/4

Sep 01 23:21:05 ERROR: QEMU Arch is not set (80015).

Sep 01 23:21:04 INFO: tunctl -u unl0 -g root -t vunl0_4_7 2>&1

Sep 01 23:21:04 INFO: tunctl -u unl0 -g root -t vunl0_4_6 2>&1

Sep 01 23:21:04 INFO: tunctl -u unl0 -g root -t vunl0_4_5 2>&1

Sep 01 23:21:04 INFO: tunctl -u unl0 -g root -t vunl0_4_4 2>&1

Sep 01 23:21:04 INFO: tunctl -u unl0 -g root -t vunl0_4_3 2>&1

Sep 01 23:21:03 INFO: tunctl -u unl0 -g root -t vunl0_4_2 2>&1

Sep 01 23:21:03 INFO: tunctl -u unl0 -g root -t vunl0_4_1 2>&1

Sep 01 23:21:03 INFO: tunctl -u unl0 -g root -t vunl0_4_0 2>&1

Sep 01 23:17:22 INFO: starting /opt/unetlab/wrappers/qemu_wrapper -T 0 -D 3 -t "CSR" -F /opt/qemu-2.2.0/bin/qemu-system-x86_64 -d 0 -- -nographic -device e1000,netdev=net0,mac=50:00:00:03:00:00 -netdev tap,id=net0,ifname=vunl0_3_0,script=no -device e1000,netdev=net1,mac=50:00:00:03:00:01 -netdev tap,id=net1,ifname=vunl0_3_1,script=no -device e1000,netdev=net2,mac=50:00:00:03:00:02 -netdev tap,id=net2,ifname=vunl0_3_2,script=no -device e1000,netdev=net3,mac=50:00:00:03:00:03 -netdev tap,id=net3,ifname=vunl0_3_3,script=no -smp 1 -m 3072 -name CSR -uuid c1dab784-b817-4b19-9c35-3415285f6dcc -drive file=virtioa.qcow2,if=virtio,bus=0,unit=0,cache=none -machine type=pc-1.0,accel=kvm -serial mon:stdio -nographic -nodefconfig -nodefaults -rtc base=utc > /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/3/wrapper.txt 2>&1 &

Sep 01 23:17:22 INFO: CWD is /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/3

Sep 01 23:17:22 ERROR: QEMU Arch is not set (80015).

Sep 01 23:17:22 INFO: tunctl -u unl0 -g root -t vunl0_3_3 2>&1

Sep 01 23:17:21 INFO: tunctl -u unl0 -g root -t vunl0_3_2 2>&1

Sep 01 23:17:21 INFO: tunctl -u unl0 -g root -t vunl0_3_1 2>&1

Sep 01 23:17:21 INFO: tunctl -u unl0 -g root -t vunl0_3_0 2>&1

Sep 01 23:13:23 INFO: starting /opt/unetlab/wrappers/qemu_wrapper -T 0 -D 2 -t "vIOS" -F /opt/qemu/bin/qemu-system-i386 -d 0 -- -nographic -device e1000,netdev=net0,mac=50:00:00:02:00:00 -netdev tap,id=net0,ifname=vunl0_2_0,script=no -device e1000,netdev=net1,mac=50:00:00:02:00:01 -netdev tap,id=net1,ifname=vunl0_2_1,script=no -device e1000,netdev=net2,mac=50:00:00:02:00:02 -netdev tap,id=net2,ifname=vunl0_2_2,script=no -device e1000,netdev=net3,mac=50:00:00:02:00:03 -netdev tap,id=net3,ifname=vunl0_2_3,script=no -smp 1 -m 512 -name vIOS -uuid ffae33c7-cd2a-4e06-9ffa-09b020d29ace -drive file=virtioa.qcow2,if=virtio,bus=0,unit=0,cache=none -machine type=pc-1.0,accel=kvm -serial mon:stdio -nographic -nodefconfig -nodefaults -rtc base=utc > /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/2/wrapper.txt 2>&1 &

Sep 01 23:13:23 INFO: CWD is /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/2

Sep 01 23:13:23 ERROR: QEMU Arch is not set (80015).

Sep 01 23:13:23 INFO: tunctl -u unl0 -g root -t vunl0_2_3 2>&1

Sep 01 23:13:23 INFO: tunctl -u unl0 -g root -t vunl0_2_2 2>&1

Sep 01 23:13:23 INFO: tunctl -u unl0 -g root -t vunl0_2_1 2>&1

Sep 01 23:13:23 INFO: tunctl -u unl0 -g root -t vunl0_2_0 2>&1

Sep 01 23:12:47 INFO: starting /opt/unetlab/wrappers/qemu_wrapper -T 0 -D 1 -t "xrv" -F /opt/qemu/bin/qemu-system-x86_64 -d 0 -- -nographic -device virtio-net-pci,netdev=net0,mac=50:00:00:01:00:00 -netdev tap,id=net0,ifname=vunl0_1_0,script=no -device virtio-net-pci,netdev=net1,mac=50:00:00:01:00:01 -netdev tap,id=net1,ifname=vunl0_1_1,script=no -device virtio-net-pci,netdev=net2,mac=50:00:00:01:00:02 -netdev tap,id=net2,ifname=vunl0_1_2,script=no -device virtio-net-pci,netdev=net3,mac=50:00:00:01:00:03 -netdev tap,id=net3,ifname=vunl0_1_3,script=no -smp 1 -m 3072 -name xrv -uuid 9eaa9ffd-8bc2-4f1f-957e-6918e462a109 -hda hda.qcow2 -machine type=pc,accel=kvm,usb=off -serial mon:stdio -nographic -nodefconfig -nodefaults -rtc base=utc,driftfix=slew -global kvm-pit.lost_tick_policy=discard -no-hpet -realtime mlock=off -no-shutdown -boot order=c > /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/1/wrapper.txt 2>&1 &

Sep 01 23:12:47 INFO: CWD is /opt/unetlab/tmp/0/c10c013e-8f5f-4317-b388-02854046a1c8/1

Sep 01 23:12:47 ERROR: QEMU Arch is not set (80015).

Sep 01 23:12:46 INFO: tunctl -u unl0 -g root -t vunl0_1_3 2>&1

Sep 01 23:12:46 INFO: tunctl -u unl0 -g root -t vunl0_1_2 2>&1

Sep 01 23:12:46 INFO: tunctl -u unl0 -g root -t vunl0_1_1 2>&1

Sep 01 23:12:46 INFO: tunctl -u unl0 -g root -t vunl0_1_0 2>&1

[rebelinux]

Use machine type=q35 better performance!!!