Cloudflare CDN

Questions and Answers : Issue Discussion : Cloudflare CDN
Message board moderation

To post messages, you must log in.

AuthorMessage
pianoman [MLC@Home Admin]
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Jun 20
Posts: 462
Credit: 21,406,548
RAC: 0
Message 955 - Posted: 23 Dec 2020, 7:27:36 UTC

Today we enabled Cloudflare CDN on the project and website. This provides a few advantages for us, the most important being content caching to take some of the burden off the server's network connection and instead cache the large client and dataset downloads across the Cloudflare CDN. At least in theory. This also has the benefit of providing traffic monitoring and things like DDoS protection if for some reason such things should happen.

Nothing should change from the user perspective! So if something on this website or the project stops working, please post the issue here.

This step is necessary to help the project handle a larger number of users in the future.
ID: 955 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
pianoman [MLC@Home Admin]
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Jun 20
Posts: 462
Credit: 21,406,548
RAC: 0
Message 956 - Posted: 23 Dec 2020, 22:33:57 UTC - in response to Message 955.  

So far things seem to be going pretty well, we're saving a ton of bandwidth, and we've had reports of client app downloads going orders of magnitude faster.

One thing we noticed, legitimate requests from the user agent "python-urllib' are by default blocked by the CDN. We just rolled out a change to fix this, so hopefully, people writing homemade scripts to query the site will no longer be blocked.

If anyone else notices any similar issues, please post them here.
ID: 956 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
kiska

Send message
Joined: 24 Dec 20
Posts: 1
Credit: 0
RAC: 0
Message 961 - Posted: 24 Dec 2020, 13:56:14 UTC

Hi:

Do you mind letting through curl/7.54.1 as I am graphing the server_status page, and unfortunately cloudflare has blocked the default LWP::UserAgent agent. Or alternatively can you unblock libwww-perl/6.35

These are the statistics I graph:
https://munin.kiska.pw/munin/Munin-Node/Munin-Node/results_mlcathome.html
https://munin.kiska.pw/munin/Munin-Node/Munin-Node/transitioner_mlcathome.html
https://munin.kiska.pw/munin/Munin-Node/Munin-Node/workunits_mlcathome.html
ID: 961 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
pianoman [MLC@Home Admin]
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Jun 20
Posts: 462
Credit: 21,406,548
RAC: 0
Message 963 - Posted: 24 Dec 2020, 21:28:20 UTC - in response to Message 961.  

I'll see what I can do when I get back in front of a computer.
ID: 963 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
pianoman [MLC@Home Admin]
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Jun 20
Posts: 462
Credit: 21,406,548
RAC: 0
Message 976 - Posted: 27 Dec 2020, 17:22:06 UTC - in response to Message 961.  

Sorry it took me a few days (holidays and all) but this should be allowed now too. Thanks for reporting!
ID: 976 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote

Questions and Answers : Issue Discussion : Cloudflare CDN

©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)