IOL issue - not all nodes are comming up

Before posting something, READ the changelog, WATCH the videos, howto and provide following:
Your install is: Bare metal, ESXi, what CPU model, RAM, HD, what EVE version you have, output of the uname -a and any other info that might help us faster.

Moderator: mike

Post Reply
petrovg
Posts: 5
Joined: Sun May 21, 2017 1:20 pm

IOL issue - not all nodes are comming up

Post by petrovg » Sun May 21, 2017 6:54 pm

Dear Eve-NG Help-Desk,

I am experiencing the issue that when I try to run large-scale topologies (40 IOL nodes) - not all of them are able to start.

Lab setup:

- EVE-NG Running on as a VM on ESXi (v6.0)
- Permissions - fixed:(/opt/unetlab/wrappers/unl_wrapper -a fixpermissions)
- nothing informational in /opt/unetlab/data/Logs/
- searched the forum but could not find similar issue.
- running Eve-NG v.2.0.3-53
- Tried rebooting the VM
- tried changing the vRAM lowering it down to 128 for L3 and 192 for L2.

For the nodes that are able to boot - I can telnet successfully and all is fine.

Thank you in advance for your help.

Best!

Uldis (UD)
Posts: 5177
Joined: Wed Mar 15, 2017 4:44 pm
Location: London
Contact:

Re: IOL issue - not all nodes are comming up

Post by Uldis (UD) » Mon May 22, 2017 9:26 pm

upgrade your eve to v60

kapadi.subhash
Posts: 3
Joined: Tue May 23, 2017 7:30 am

Re: IOL issue - not all nodes are comming up

Post by kapadi.subhash » Tue May 23, 2017 7:05 pm

I am also facing similar issue with large number of routers in setup. My EVE is running on ESXI VM.
CPU, RAM are running fine.

Manually starting each node is also not helping.

root@eve-ng:~# dpkg -l eve-ng
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name Version Architecture Description
+++-===============================-====================-====================-===================================================================
ii eve-ng 2.0.3-60 amd64 A new generation software for networking labs.
root@eve-ng:~#


Thanks/Subhash

kapadi.subhash
Posts: 3
Joined: Tue May 23, 2017 7:30 am

Re: IOL issue - not all nodes are comming up

Post by kapadi.subhash » Tue May 23, 2017 7:17 pm

Also is there any limit on number of nodes EVE can run?
I see, we can't add more than 127 nodes per lab.

-Subhash

Uldis (UD)
Posts: 5177
Joined: Wed Mar 15, 2017 4:44 pm
Location: London
Contact:

Re: IOL issue - not all nodes are comming up

Post by Uldis (UD) » Tue May 23, 2017 7:22 pm

yes and limit on IOL is 64 nodes

petrovg
Posts: 5
Joined: Sun May 21, 2017 1:20 pm

Re: IOL issue - not all nodes are comming up

Post by petrovg » Wed May 24, 2017 4:29 pm

Uldis (UD) wrote:
Mon May 22, 2017 9:26 pm
upgrade your eve to v60
Tried that already but I am stuck on 'update'

root@eve-ng:~# apt-get update
Get:1 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB]
Hit:2 http://us.archive.ubuntu.com/ubuntu xenial InRelease
Hit:3 http://us.archive.ubuntu.com/ubuntu xenial-updates InRelease
Get:4 http://everbx.podzone.net/repo xenial InRelease
Err:4 http://everbx.podzone.net/repo xenial InRelease
Clearsigned file isn't valid, got 'NOSPLIT' (does the network require authentication?)
Fetched 104 kB in 0s (221 kB/s)
Reading package lists... Done
E: Failed to fetch http://everbx.podzone.net/repo/dists/xenial/InRelease Clearsigned file isn't valid, got 'NOSPLIT' (does the network require authentication?)
E: Some index files failed to download. They have been ignored, or old ones used instead.

so I cannot Upgrade to .60 later.

petrovg
Posts: 5
Joined: Sun May 21, 2017 1:20 pm

Re: IOL issue - not all nodes are comming up

Post by petrovg » Wed May 24, 2017 5:12 pm

petrovg wrote:
Wed May 24, 2017 4:29 pm
Uldis (UD) wrote:
Mon May 22, 2017 9:26 pm
upgrade your eve to v60
Tried that already but I am stuck on 'update'

root@eve-ng:~# apt-get update
Get:1 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB]
Hit:2 http://us.archive.ubuntu.com/ubuntu xenial InRelease
Hit:3 http://us.archive.ubuntu.com/ubuntu xenial-updates InRelease
Get:4 http://everbx.podzone.net/repo xenial InRelease
Err:4 http://everbx.podzone.net/repo xenial InRelease
Clearsigned file isn't valid, got 'NOSPLIT' (does the network require authentication?)
Fetched 104 kB in 0s (221 kB/s)
Reading package lists... Done
E: Failed to fetch http://everbx.podzone.net/repo/dists/xenial/InRelease Clearsigned file isn't valid, got 'NOSPLIT' (does the network require authentication?)
E: Some index files failed to download. They have been ignored, or old ones used instead.

so I cannot Upgrade to .60 later.
seems some kind of a proxy issue in the middle. Will try from different networks to see if it makes the difference.

I also lowered the vRAM down to 512 and now I am able to start all nodes. Which is the recommended vRAM for IOL?

Post Reply