Problem following upgrade to Ubuntu 18.04.5 LTS

Before posting something, READ the changelog, WATCH the videos, howto and provide following:
Your install is: Bare metal, ESXi, what CPU model, RAM, HD, what EVE version you have, output of the uname -a and any other info that might help us faster.

Moderator: mike

Post Reply
seanw
Posts: 5
Joined: Wed Jan 01, 2020 11:34 pm

Problem following upgrade to Ubuntu 18.04.5 LTS

Post by seanw » Sun Jan 03, 2021 9:59 pm

Hi all,

I recently renewed my eve-ng pro license and have been running without issue on Ubuntu 16, so decided to upgrade to ver 18 :-( after 18months of faultless service

Since upgrading, I can no login to the GUI


root@eve-ng:~# eve-info
Sun 3 Jan 21:39:57 GMT 2021
---------------Packages Installed----------------
ii eve-ng-dockers 1.25-eve-ng
ii eve-ng-dynamips 2.0.2-2
ii eve-ng-janus 1.2-eve-ng
ii eve-ng-pro 2.0.6-52
ii eve-ng-pro-guacamole 2.0.6-19
ii eve-ng-qemu 2.0.5-24
ii eve-ng-schema 2.0.6-14
ii eve-ng-vpcs 1.0-eve-ng
ii linux-headers-4.9.40-eve-ng-ukms+ 4.9.40-eve-ng-ukms-brctl
ii linux-image-4.20.17-eve-ng-ukms+ 4.20.17-eve-ng-ukms-brctl

---------------Hostname--------------------------
Static hostname: eve-ng
Operating System: Ubuntu 18.04.5 LTS
Kernel: Linux 4.20.17-eve-ng-ukms+
Architecture: x86-64
---------------Disk Usage------------------------
Filesystem Size Used Avail Use% Mounted on
udev 63G 0 63G 0% /dev
tmpfs 13G 15M 13G 1% /run
/dev/mapper/eve--ng--vg-root 915G 719G 150G 83% /
tmpfs 63G 0 63G 0% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 63G 0 63G 0% /sys/fs/cgroup
/dev/sdb2 473M 161M 288M 36% /boot
/dev/sda1 96M 48M 49M 50% /boot/efi
tmpfs 13G 0 13G 0% /run/user/0

---------------CPU Info--------------------------
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 48
On-line CPU(s) list: 0-47
Thread(s) per core: 2
Core(s) per socket: 12
Socket(s): 2
NUMA node(s): 2
Vendor ID: GenuineIntel
CPU family: 6
Model: 63
Model name: Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz
Stepping: 2
CPU MHz: 1197.558
CPU max MHz: 2500.0000
CPU min MHz: 1200.0000
BogoMIPS: 4988.47
Virtualisation: VT-x
L1d cache: 32K
L1i cache: 32K
L2 cache: 256K
L3 cache: 30720K
NUMA node0 CPU(s): 0-11,24-35
NUMA node1 CPU(s): 12-23,36-47
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm cpuid_fault epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm arat pln pts flush_l1d

---------------Memory Info-----------------------
total used free shared buff/cache available
Mem: 125G 884M 124G 23M 636M 124G
Swap: 3.2G 0B 3.2G

---------------Nic Info--------------------------
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel master pnet0 state UP mode DEFAULT group default qlen 1000

---------------IP Info---------------------------
● State: n/a
172.29.129.254 on nat0
172.17.0.1 on docker0

---------------Bridge Info-----------------------
pnet0 8000.5065f321d2be no eth0
pnet1 8000.000000000000 no
pnet2 8000.000000000000 no
pnet3 8000.000000000000 no
pnet4 8000.000000000000 no
pnet5 8000.000000000000 no
pnet6 8000.000000000000 no
pnet7 8000.000000000000 no
pnet8 8000.000000000000 no
pnet9 8000.000000000000 no

---------------H/W Accel-------------------------
INFO: /dev/kvm exists
KVM acceleration can be used

---------------Service Info----------------------
-------------------------------------------------
--------------Guacamole--------------------------
● guacd.service - LSB: Guacamole proxy daemon
Loaded: loaded (/etc/init.d/guacd; generated)
Active: active (running) since Sun 2021-01-03 21:35:19 GMT; 4min 38s ago

--------------Tomcat-----------------------------
● tomcat8.service - LSB: Start Tomcat.
Loaded: loaded (/etc/init.d/tomcat8; generated)
Active: active (running) since Sun 2021-01-03 21:35:24 GMT; 4min 33s ago

--------------Mysql------------------------------
● mysql.service - MySQL Community Server
Loaded: loaded (/lib/systemd/system/mysql.service; enabled; vendor preset: enabled)
Active: active (running) since Sun 2021-01-03 21:35:20 GMT; 4min 37s ago

--------------Apache-----------------------------
● apache2.service - The Apache HTTP Server
Loaded: loaded (/lib/systemd/system/apache2.service; enabled; vendor preset: enabled)
Drop-In: /lib/systemd/system/apache2.service.d
└─apache2-systemd.conf
Active: active (running) since Sun 2021-01-03 21:35:19 GMT; 4min 38s ago

root@eve-ng:~#

tail -f /var/log/Syslog i can see licserver.service: I can see the license service looping and crashing every 5 seconds.


Jan 3 21:44:51 eve-ng licserver[10007]: p0fKcoOa74EqzMG636Qa+o5AbwQfHE6Zrk8U39Qf+dGc4cLkIzDVnE/kskU/QD6YrlPKriNEUJBI
Jan 3 21:44:51 eve-ng licserver[10007]: huQwJEKd2ubKqj9FyhtHSxNGvQwAQgWQV1fGx9IHgc1F6zTCxXHzKngXueCjN+/VWA84InNx8JFY
Jan 3 21:44:51 eve-ng licserver[10007]: gE00K75v7y4oQYUKUyJx/zkgTrJh1ZztLrxe2+SDlc5uUZ8IBT4na7bteIAF6BRZmxSeJtao8GuV
Jan 3 21:44:51 eve-ng licserver[10007]: be5AFSVFARopOj3z2rnPUVndlF6yKeMQoDlk0K5UOuuGVAm/ON1NjLyovvZ50+UcDPjSyoCVwmzW
Jan 3 21:44:51 eve-ng licserver[10007]: GfM1jadZSoS2CCIR8fs6ZT6Iz4NgTx8WAL3PXjlIq0KLdPUIDpCVxxjiZiuQl5eeEVlCj27i9RsT
Jan 3 21:44:51 eve-ng licserver[10007]: PO6dnzsEXSLbDTz6cYS4E0vfvk8+MnZsR0S+ZfKSOmWwGHafAp/402FYG+UF9/tnwUo7TprjqmXV
Jan 3 21:44:51 eve-ng licserver[10007]: TaXOR+Qsm3IOX0g7ZLknn8HxdGysEnJWes7iWLvxGLMVmzgxjJZxb7q=
Jan 3 21:44:51 eve-ng killall[10016]: licserver: no process found
Jan 3 21:44:51 eve-ng systemd[1]: licserver.service: Control process exited, code=exited status=1
Jan 3 21:44:51 eve-ng systemd[1]: licserver.service: Failed with result 'exit-code'.


root@eve-ng:~# systemctl status licserver.service
● licserver.service - EVE Lic server
Loaded: loaded (/etc/systemd/system/licserver.service; enabled; vendor preset: enabled)
Active: activating (auto-restart) (Result: exit-code) since Sun 2021-01-03 21:54:02 GMT; 186ms ago
Process: 13958 ExecStop=/usr/bin/killall -9 licserver (code=exited, status=1/FAILURE)
Process: 13949 ExecStart=/opt/unetlab/wrappers/licserver & (code=exited, status=0/SUCCESS)
Main PID: 13949 (code=exited, status=0/SUCCESS)
root@eve-ng:~#



Also on the consoles, it now states "No ip address on interface pnet0" however, I can see a static address on the interface and can access through ssh..

root@eve-ng:~# ifconfig pnet0
pnet0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 172.25.146.170 netmask 255.255.255.0 broadcast 172.25.146.255
ether 50:65:f3:21:d2:be txqueuelen 1000 (Ethernet)
RX packets 11762 bytes 681178 (681.1 KB)
RX errors 0 dropped 1694 overruns 0 frame 0
TX packets 15617 bytes 5478650 (5.4 MB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

root@eve-ng:~#

DNS is good
root@eve-ng:~# ping www.google.com
PING www.google.com (216.58.210.196) 56(84) bytes of data.
64 bytes from lhr48s11-in-f4.1e100.net (216.58.210.196): icmp_seq=1 ttl=119 time=8.95

I've tried all the normal tricks "/opt/unetlab/wrappers/unl_wrapper -a fixpermissions" which just displays a load of encrypted text.

I'm hoping its something simple so would appreciate your advice on how to proceed.

Regards
Seanw


Further to the above seems could be related to PHP

[03-Jan-2021 22:27:51 UTC] PHP Fatal error: Uncaught Error: Call to a member function prepare() on boolean in /opt/unetlab/html/includes/functions.php:1028
Stack trace:
#0 /opt/unetlab/html/api.php(101): updateDatabase(false)
#1 {main}
thrown in /opt/unetlab/html/includes/functions.php on line 1028
[03-Jan-2021 22:27:58 UTC] Jan 03 22:27:58 ERROR: Database error (90003).
[03-Jan-2021 22:27:58 UTC] Jan 03 22:27:58 PDOException: could not find driver in /opt/unetlab/html/includes/functions.php:54
Stack trace:
#0 /opt/unetlab/html/includes/functions.php(54): PDO->__construct('mysql:host=loca...', 'eve-ng', 'eve-ng')
#1 /opt/unetlab/html/api.php(74): checkDatabase()
#2 {main}
[03-Jan-2021 22:27:58 UTC] Jan 03 22:27:58 ERROR: Database error (90003).
[03-Jan-2021 22:27:58 UTC] Jan 03 22:27:58 PDOException: could not find driver in /opt/unetlab/html/includes/functions.php:1706
Stack trace:
#0 /opt/unetlab/html/includes/functions.php(1706): PDO->__construct('mysql:host=loca...', 'guacuser', 'eve-ng')
#1 /opt/unetlab/html/api.php(87): html5_checkDatabase()
#2 {main}
[03-Jan-2021 22:27:58 UTC] PHP Fatal error: Uncaught Error: Call to a member function prepare() on boolean in /opt/unetlab/html/includes/functions.php:1028
Stack trace:
#0 /opt/unetlab/html/api.php(101): updateDatabase(false)
#1 {main}
thrown in /opt/unetlab/html/includes/functions.php on line 1028

Uldis (UD)
Posts: 5067
Joined: Wed Mar 15, 2017 4:44 pm
Location: London
Contact:

Re: Problem following upgrade to Ubuntu 18.04.5 LTS

Post by Uldis (UD) » Mon Jan 04, 2021 2:34 pm

it is because you had used custom repo adding in the eve,
Advice install fresh new eve and migrate content:
https://www.eve-ng.net/index.php/backup-eve-ng-content/


seanw
Posts: 5
Joined: Wed Jan 01, 2020 11:34 pm

Re: Problem following upgrade to Ubuntu 18.04.5 LTS

Post by seanw » Mon Jan 04, 2021 10:41 pm

This seems abnormally troublesome

root@eve-ng:~# lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 18.04.5 LTS
Release: 18.04
Codename: bionic
root@eve-ng:~#


Fresh build installed twice without issue, and both times no eve-ng repo sources

root@eve-ng:~# apt install eve-ng-dockers
Reading package lists... Done
Building dependency tree
Reading state information... Done
E: Unable to locate package eve-ng-dockers

Any ideas???

Uldis (UD)
Posts: 5067
Joined: Wed Mar 15, 2017 4:44 pm
Location: London
Contact:

Re: Problem following upgrade to Ubuntu 18.04.5 LTS

Post by Uldis (UD) » Tue Jan 05, 2021 8:47 am

but does your eve is installed?

dpkg -l eve-ng-pro

>>

seanw
Posts: 5
Joined: Wed Jan 01, 2020 11:34 pm

Re: Problem following upgrade to Ubuntu 18.04.5 LTS

Post by seanw » Tue Jan 05, 2021 11:58 am

Unfortunately not

dpkg -l eve-ng-pro
dpkg-query: no packages found matching eve-ng-pro
root@eve-ng:~#

I'm assuming I can pull this package over the internet, as opposed to re-running another installation that will inevitably yield similar failure?

Let me know.

Thanx again

seanw
Posts: 5
Joined: Wed Jan 01, 2020 11:34 pm

Re: Problem following upgrade to Ubuntu 18.04.5 LTS

Post by seanw » Tue Jan 05, 2021 12:14 pm

Fixed by re-running eve-ng script


sed -i -e "s/.*PermitRootLogin .*/PermitRootLogin yes/" /etc/ssh/sshd_config
sed -i -e 's/.*DefaultTimeoutStopSec=.*/DefaultTimeoutStopSec=5s/' /etc/systemd/system.conf
systemctl restart ssh
apt-get update
apt-get -y install software-properties-common
wget -O - http://www.eve-ng.net/repo/eczema@ecze.com.gpg.key | sudo apt-key add -
#sudo add-apt-repository "deb [arch=amd64] http://www.eve-ng.net/repo-testing-new bionic main"
sudo add-apt-repository "deb [arch=amd64] http://www.eve-ng.net/repo-bionic bionic main"
apt-get update
DEBIAN_FRONTEND=noninteractive apt-get -y install eve-ng-pro
/etc/init.d/mysql restart
DEBIAN_FRONTEND=noninteractive apt-get -y install eve-ng-pro
#sed -i -e 's/.*eve-setup.*//' /root/.bashrc
mv /etc/rc.local /etc/eve-setup.sh
mv /etc/rc.local.ori /etc/rc.local
reboot

Post Reply