OS/Distribution support question?

Questions and Answers : Unix/Linux : OS/Distribution support question?
Message board moderation

To post messages, you must log in.

AuthorMessage
pianoman [MLC@Home Admin]
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Jun 20
Posts: 454
Credit: 14,284,704
RAC: 3,190
Message 369 - Posted: 22 Aug 2020, 18:43:25 UTC
Last modified: 22 Aug 2020, 19:46:49 UTC

Can w ask for an informal poll as to what distribution you're running on which architectures? I'm talking core distribution and GLIBC version, I don't care about which variant of Ubuntu, for example, just that its ubuntu 18.04 or Debian 9).

This matters because we can't statically link the client.

Currently, the amd64 app is compiled on a Ubuntu 14.04 system, with gcc 9 installed via PPA. Ubuntu 14.04 uses GLIBC 2.19, which marks the floor of the distributions can support. This means that, based on this fantastic chart maintained by Mozilla (link), MLDS has has a good chance of running on:

AMD64

  • Ubuntu 14.04+
  • Debian 8+
  • Fedora 21+
  • RHEL/CentOS 8+
  • SUSE SLE 12+ , OpenSUSE 13.2+



The ARM apps are compiled on Debian 10 (glibc 2.28)

ARM32/64


  • Ubuntu 20.04+
  • Debian 10+
  • Fedora 29+
  • RHEL/CentOS 8+



To me, the only notable distro missing from this list is centos 7, and when I tried to build an app on centos 7 the resulting app was much more unstable on other systems, so sadly I moved back to building on 14.04 and up.

I like building on Ubuntu, as there's a nice PPA that allows easy installation of gcc/g++ 9 paired with an older glibc. However, 14.04 is no longer supported, and it may be time to switch to a newer release. I'd like to know how many people are running older releases and how moving to, say, building on Debian 9 or Ubuntu 16.04 (raising the minimum required glibc version) would effect those people.

For the record, the current database breakdown for libc versions looks like:

glibc 2.17: 9
glibc 2.19: 2
glibc 2.24: 2
glibc 2.26: 2
glibc 2.27: 311
glibc 2.28: 87
glibc 2.29: 4
glibc 2.30: 15
glibc 2.31: 222


Thanks for your input!
ID: 369 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
PoppaGeek

Send message
Joined: 3 Jul 20
Posts: 13
Credit: 10,301,199
RAC: 1
Message 372 - Posted: 22 Aug 2020, 20:56:28 UTC - in response to Message 369.  
Last modified: 22 Aug 2020, 20:58:46 UTC

Oldest I'm running is 1 Ubuntu 16.04 x86-64

All ARM are 18.04 or 20.04 or Deb 10
ID: 372 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
floyd

Send message
Joined: 24 Jul 20
Posts: 30
Credit: 3,485,605
RAC: 0
Message 384 - Posted: 23 Aug 2020, 11:16:52 UTC - in response to Message 369.  

For the record, the current database breakdown for libc versions looks like:
glibc 2.17: 9
glibc 2.19: 2
glibc 2.24: 2
glibc 2.26: 2
glibc 2.27: 311
glibc 2.28: 87
glibc 2.29: 4
glibc 2.30: 15
glibc 2.31: 222
Does this mean the survey is over before it has started? This is probably better than any survey result and it clearly shows where you can make a cut without much loss. I'd suggest you check for hosts without glibc information though, it could mean they're running old BOINC clients and possibly old glibc.
Anyway, Debian 10, glibc 2.28, amd64 for me. The 9.50 application is running fine on my Ryzens and faster than 9.20.
ID: 384 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
pianoman [MLC@Home Admin]
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Jun 20
Posts: 454
Credit: 14,284,704
RAC: 3,190
Message 389 - Posted: 23 Aug 2020, 14:41:27 UTC - in response to Message 384.  

I think its still useful to head what people are running, especially since not all hosts' descriptions include that info.
ID: 389 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Conan
Avatar

Send message
Joined: 1 Jul 20
Posts: 5
Credit: 593,744
RAC: 2,719
Message 416 - Posted: 27 Aug 2020, 12:25:51 UTC

AMD64 with Fedora 23.

Has been working fine, but as of today it no longer works as the latest WUs need GLIBC 2.23 which apparently I don't have.

Conan.
ID: 416 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Gunnar Hjern

Send message
Joined: 12 Aug 20
Posts: 21
Credit: 44,815,562
RAC: 28,483
Message 418 - Posted: 27 Aug 2020, 17:34:15 UTC

Hi!

I'm running 26 computers, see the list below.
I made a run-down of the OS:s and the libc-versions:

The OS:s are:
9 Ubuntu 14.04,
2 Ubuntu 16.04,
14 Ubuntu 18.04,
1 Linux mint 18.3,

libc versions are:
9 libc 2.19
3 libc 2.23
14 libc 2.27

I have noticed that none of the Ubuntu 14 machines can run any 9.55 tasks,
but they all end in computation error as the tasks demand for the libc 2.23 to be present! :-(


//Gunnar

List:
ID: 1975, CPU: Intel(R) Core(TM) i5-3470S CPU @ 2.90GHz [Family 6 Model 58 Stepping 9] (4 cpu), OS: Linux Ubuntu 18.04.2 LTS [5.3.0-61-generic|libc 2.27 (Ubuntu GLIBC 2.27-3ubuntu1)]

ID: 1988, CPU: Intel(R) Core(TM)2 Duo CPU T7500 @ 2.20GHz [Family 6 Model 15 Stepping 11] (2 cpu), OS: Linux Ubuntu 18.04.2 LTS [4.18.0-25-generic|libc 2.27 (Ubuntu GLIBC 2.27-3ubuntu1)]

ID: 1996, CPU: Intel(R) Xeon(R) CPU E3-1245 V2 @ 3.40GHz [Family 6 Model 58 Stepping 9] (8 cpu), OS: Linux Ubuntu 14.04 LTS, 4.4.0-148-generic, libc 2.19

ID: 2004, CPU: Intel(R) Xeon(R) CPU E3-1245 V2 @ 3.40GHz [Family 6 Model 58 Stepping 9] (8 cpu), OS: Linux Ubuntu 18.04.2 LTS [5.0.0-23-generic|libc 2.27 (Ubuntu GLIBC 2.27-3ubuntu1)]

ID: 2005, CPU: Intel(R) Core(TM) i5-3470 CPU @ 3.20GHz [Family 6 Model 58 Stepping 9] (4 cpu), OS: Linux Ubuntu 18.04.2 LTS [5.3.0-61-generic|libc 2.27 (Ubuntu GLIBC 2.27-3ubuntu1)]

ID: 2006, CPU: Intel(R) Core(TM) i5-4570 CPU @ 3.20GHz [Family 6 Model 60 Stepping 3] (4 cpu), OS: Linux Ubuntu 18.04.2 LTS [5.3.0-61-generic|libc 2.27 (Ubuntu GLIBC 2.27-3ubuntu1)]

ID: 2007, CPU: Intel(R) Core(TM) i5-3570 CPU @ 3.40GHz [Family 6 Model 58 Stepping 9] (4 cpu), OS: Linux Ubuntu 18.04.2 LTS [5.3.0-61-generic|libc 2.27 (Ubuntu GLIBC 2.27-3ubuntu1)]

ID: 2008, CPU: Intel(R) Core(TM) i5-2500 CPU @ 3.30GHz [Family 6 Model 42 Stepping 7] (4 cpu), OS: Linux Ubuntu 14.04 LTS, 4.4.0-184-generic, libc 2.23

ID: 2009, CPU: Intel(R) Core(TM) i5-2500 CPU @ 3.30GHz [Family 6 Model 42 Stepping 7] (4 cpu), OS: Linux Ubuntu 18.04.2 LTS [5.3.0-61-generic|libc 2.27 (Ubuntu GLIBC 2.27-3ubuntu1)]

ID: 2010, CPU: Intel(R) Core(TM) i5-4590 CPU @ 3.30GHz [Family 6 Model 60 Stepping 3] (4 cpu), OS: Linux Ubuntu 18.04.2 LTS [4.18.0-15-generic|libc 2.27 (Ubuntu GLIBC 2.27-3ubuntu1)]

ID: 2011, CPU: Intel(R) Core(TM) i5-3470S CPU @ 2.90GHz [Family 6 Model 58 Stepping 9] (4 cpu), OS: Linux Ubuntu 18.04.2 LTS [4.18.0-15-generic|libc 2.27 (Ubuntu GLIBC 2.27-3ubuntu1)]

ID: 2020, CPU: Intel(R) Core(TM)2 Duo CPU P8600 @ 2.40GHz [Family 6 Model 23 Stepping 10] (2 cpu), OS: Linux Ubuntu 14.04 LTS, 4.4.0-62-generic, libc 2.19

ID: 2051, CPU: Intel(R) Core(TM)2 Duo CPU P8700 @ 2.53GHz [Family 6 Model 23 Stepping 10] (2 cpu), OS: Linux Ubuntu 18.04.4 LTS [5.3.0-51-generic|libc 2.27 (Ubuntu GLIBC 2.27-3ubuntu1)]

ID: 2062, CPU: Intel(R) Core(TM) i5 CPU M 520 @ 2.40GHz [Family 6 Model 37 Stepping 2] (4 cpu), OS: Linux Mint, 4.10.0-38-generic, libc 2.23

ID: 2063, CPU: Intel(R) Core(TM)2 Duo CPU P8700 @ 2.53GHz [Family 6 Model 23 Stepping 10] (2 cpu), OS: Linux Ubuntu 18.04.2 LTS [5.0.0-23-generic|libc 2.27 (Ubuntu GLIBC 2.27-3ubuntu1)]

ID: 2064, CPU: Intel(R) Core(TM)2 Duo CPU E8500 @ 3.16GHz [Family 6 Model 23 Stepping 10] (2 cpu), OS: Linux Ubuntu 14.04 LTS, 3.13.0-67-generic, libc 2.19

ID: 2065, CPU: Intel(R) Core(TM)2 Duo CPU E8500 @ 3.16GHz [Family 6 Model 23 Stepping 10] (2 cpu), OS: Linux Ubuntu 14.04 LTS, 3.13.0-67-generic, libc 2.19

ID: 2066, CPU: Intel(R) Core(TM)2 Duo CPU T7500 @ 2.20GHz [Family 6 Model 15 Stepping 11] (2 cpu), OS: Linux Ubuntu 14.04 LTS, 4.4.0-31-generic, libc 2.19

ID: 2067, CPU: Intel(R) Core(TM)2 Duo CPU E7400 @ 2.80GHz [Family 6 Model 23 Stepping 10] (2 cpu), OS: Linux Ubuntu 14.04 LTS, 4.4.0-79-generic, libc 2.19

ID: 2118, CPU: Intel(R) Core(TM) i5 CPU M 520 @ 2.40GHz [Family 6 Model 37 Stepping 5] (4 cpu), OS: Linux Ubuntu 18.04.2 LTS [5.0.0-23-generic|libc 2.27 (Ubuntu GLIBC 2.27-3ubuntu1)]

ID: 2119, CPU: Intel(R) Core(TM) i5 CPU M 540 @ 2.53GHz [Family 6 Model 37 Stepping 2] (4 cpu), OS: Linux Ubuntu 14.04 LTS, 4.4.0-148-generic, libc 2.19

ID: 2123, CPU: Intel(R) Core(TM)2 Duo CPU T6570 @ 2.10GHz [Family 6 Model 23 Stepping 10] (2 cpu), OS: Linux Ubuntu 14.04 LTS, 3.13.0-170-generic, libc 2.19

ID: 2137, CPU: Intel(R) Core(TM)2 Duo CPU P8600 @ 2.40GHz [Family 6 Model 23 Stepping 6] (2 cpu), OS: Linux Ubuntu 18.04.2 LTS [4.18.0-15-generic|libc 2.27 (Ubuntu GLIBC 2.27-3ubuntu1)]

ID: 2214, CPU: Intel(R) Core(TM)2 Duo CPU T7300 @ 2.00GHz [Family 6 Model 15 Stepping 10] (2 cpu), OS: Linux Ubuntu 16.04 LTS, 4.4.0-157-generic, libc 2.23

ID: 2228, CPU: Intel(R) Core(TM) i7 CPU L 640 @ 2.13GHz [Family 6 Model 37 Stepping 5] (4 cpu), OS: Linux Ubuntu 14.04 LTS, 4.4.0-31-generic, libc 2.19

ID: 2230, CPU: Intel(R) Core(TM)2 Duo CPU T5870 @ 2.00GHz [Family 6 Model 15 Stepping 13] (2 cpu), OS: Linux Ubuntu, 18.04.3 LTS [5.4.0-42-generic|libc 2.27 (Ubuntu GLIBC 2.27-3ubuntu1.2)]
ID: 418 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
pianoman [MLC@Home Admin]
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Jun 20
Posts: 454
Credit: 14,284,704
RAC: 3,190
Message 419 - Posted: 27 Aug 2020, 21:44:58 UTC

A few things:

9.55 was built with a higher glibc requirement for two reasons: 1) to get an newer version of openblas and binutils that support AVX512, and 2) the DB indicated a very small number of hosts running older libc's than those in ubuntu 16.04, so I hoped moving to a new libc base would provide more stability and features without hurting too many systems, and the move to openblas would be equivalent perf on the high end while being much faster on lower-end hardware.

It appears both those reasons are flawed.

I will spin a new release over the next day or so that A) reverts back to compiling on ubuntu 14,04, and b) reverts to using the pre-compiled pytorch packages with embedded mkl instead of compiling myself with openblas. That leaves some performance on the table and bloats the client somewhat, but seems to be more universally stable.

Also, my day job just dumped a weeks worth of work on me with a deadline of a few days, so I may be a little slower to respond than usual.
ID: 419 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Gunnar Hjern

Send message
Joined: 12 Aug 20
Posts: 21
Credit: 44,815,562
RAC: 28,483
Message 420 - Posted: 27 Aug 2020, 22:03:22 UTC - in response to Message 419.  

Hi!

Thanks for a fast response!
I'll be patient, and wait for the new version.
Have a nice week, and again:
Thanks for the excellent project administration!!!

//Gunnar
ID: 420 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
PoppaGeek

Send message
Joined: 3 Jul 20
Posts: 13
Credit: 10,301,199
RAC: 1
Message 421 - Posted: 28 Aug 2020, 4:44:11 UTC - in response to Message 420.  

Hi!

Thanks for a fast response!
I'll be patient, and wait for the new version.
Have a nice week, and again:
Thanks for the excellent project administration!!!

//Gunnar


+1
ID: 421 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
seronegativo

Send message
Joined: 22 Jul 20
Posts: 3
Credit: 7,138,698
RAC: 0
Message 422 - Posted: 28 Aug 2020, 16:26:06 UTC

7.9.3
Intel(R) Core(TM) i5 CPU M 520 @ 2.40GHz [Family 6 Model 37 Stepping 5]
(4 procesadores) ---

Linux LinuxMint
Linux Mint 19.3 Tricia [5.4.0-42-generic|libc 2.27 (Ubuntu GLIBC 2.27-3ubuntu1.2)]

Hi ^^
ID: 422 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
pianoman [MLC@Home Admin]
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Jun 20
Posts: 454
Credit: 14,284,704
RAC: 3,190
Message 447 - Posted: 2 Sep 2020, 0:00:15 UTC - in response to Message 422.  

Newest x86_64 client released today is compiled against ubuntu 14.04 again, so glibc requirement dropped back to 2.19. Should also work on non-sse4 systems again.
ID: 447 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote

Questions and Answers : Unix/Linux : OS/Distribution support question?

©2021 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)