MSX.org back from the dead

MSX.org back from the dead

بواسطة snout بتاريخ 31-12-2015, 03:52
المناقشة: MRC
وسوم: downtime, server
اللغات:

After more than 36 hours of downtime, a lot of cursing, configuring and more cursing we're happy to announce that MSX Resource Center is back in action!

So what happened? Well... a month ago we had a brief outage because of a 'regular' RAID-1 failure . It was the second time our server needed a hard disk replacement, and during rebuilding the RAID array some more oddities popped up. The database was promptly moved to a new server, but due to lack of time the further migration was pushed back to the end of December. But our server was less patient than we were and decided it would be a fun idea to let 2 hard disks crash at the same time, leaving one without a partition table and garbled data and the other still accessible but incredibly slow.

It was clear that things were going to take a bit of time, especially because we all had other obligations. So configuration of the server had to be done in between those other activities. We set up an emergency website with a short Q&A and kept a timeline with status updates, as well as some messages to the outside world via our MSX Twitter and the MSX Resource Center Facebook page.

In the days that followed we slowly configured the new server whilst attempting to get the latest possible data from the borked server. With success, as by the end of December 30th we managed to complete a copy of the complete, most recent version of all our precious files - allowing us to replace a slightly less recent backup.

For the nerds among us (how could there possibly be on a site like this?) some info about our new server. We now run a Xeon E3-1245 processor with 16GB RAM and 2 Enterprise SATA harddisks of 3TB on hardware RAID. The pages are now hosted by Nginx and the database had already moved to MariaDB - a drop-in MySQL replacement. Thanks to tools like mozjpeg and PNGOUT we've managed to drastically reduce the size of the images on our server without affecting their visual quality too much. How drastic? Well, it all went from a total size of 6.1GB to 4.3GB -- not that we don't have enough storage space or bandwidth, but surely our mobile visitors will appreciate the lower data consumption. Last but not least, we're finally available via IPv6. In the new year we'll have a look at all things cloud/container, but for now we're happy to have things up and running again.

There might be a thing or two not running as it should, so please let us know if you find something strange and we'll look into it. We'd like to thank everybody for their kind messages, mental support and donations. And above all: your patience!

Now then, let's carry on. As you were!

التعليقات (72)

بواسطة mars2000you

Enlighted (6557)

صورة mars2000you

31-12-2015, 04:43

Welcome back to the best MSX website of the universe Smile

I think that all MRC visitors will appreciate the hard work you've made to save the site from this horrible crash. Not only for that, but also for that, the 'kern' of the MRC crew deserves all our support and applause ! Wink

بواسطة nanochess

Master (222)

صورة nanochess

31-12-2015, 04:44

Glad to see everything back online! Smile Running Naked in a Field of Flowers

بواسطة Bioman

Expert (74)

صورة Bioman

31-12-2015, 06:14

Well done! I constantly followed the progress and happy you made it before the year ended Tongue Joke aside, this has been one most of the important websites for me during recent time and my revival of MSX medium. I want to say big thank for everything from good web-hosting to wonderful forum members and general knowleding of MSX.

Happy new year and welcome back to the world!!! Big smile

بواسطة SuchAGoonie

Expert (108)

صورة SuchAGoonie

31-12-2015, 07:38

Welcome back! Fun fact: I repaired the drive of my A1ST during the downtime. For the nerds among us: I now run an R800 processor with 256KB RAM and 1 diskdrive of 720KB. Tongue

Good to have you back, guys. Smile

بواسطة edoz

Prophet (2501)

صورة edoz

31-12-2015, 08:07

Good that you are back!! Especially that you guys took the time during the holiday season to fix it again!

As there was nothing to do for the last 36 hours on the internet because MSX.org was offline I decided to use my network in a different way! To have some backup, when msx.org gets offline again Wink as good hardware never gets brokenWink

See the results on YouTube

بواسطة JINsMac

Expert (77)

صورة JINsMac

31-12-2015, 08:59

I'm glad to see you again. Smile

بواسطة Bart

Paragon (1422)

صورة Bart

31-12-2015, 09:03

Nice work Snout!

بواسطة Ivan

Ascended (9372)

صورة Ivan

31-12-2015, 09:36

Glad to see you all here again! Big smile

بواسطة turbor

Hero (529)

صورة turbor

31-12-2015, 11:29

Good to see you all back on line!
Nice job, doing this during the holiday season.

بواسطة ray2day

Paladin (752)

صورة ray2day

31-12-2015, 11:30

Jippie! Smile

بواسطة QBee

Rookie (18)

صورة QBee

31-12-2015, 11:36

Well done! The main MSX website on the wave again!!!

بواسطة Daemos

Prophet (2169)

صورة Daemos

31-12-2015, 12:22

now this is a good way to wake up again Smile The sun shining, warm weather and MSX.org back online!! Smile

بواسطة sd_snatcher

Prophet (3675)

صورة sd_snatcher

31-12-2015, 13:21

Welcome back, we missed you!

بواسطة NYYRIKKI

Enlighted (6092)

صورة NYYRIKKI

31-12-2015, 13:27

Thank god... & MRC crew!

بواسطة Louthrax

Prophet (2496)

صورة Louthrax

31-12-2015, 13:37

Rock'n Roll Smile !

بواسطة Bas040

Master (222)

صورة Bas040

31-12-2015, 13:41

Yes!

بواسطة marcos.m.carvajal.1

Expert (85)

صورة marcos.m.carvajal.1

31-12-2015, 13:55

Oh yeses! Thanks for all the hard work! Love to see the page back as normal

بواسطة Konamito

Paragon (1041)

صورة Konamito

31-12-2015, 14:44

Glad to see you back online, guys.

Keep up the good work on MSX world.

بواسطة Jipe

Paragon (1625)

صورة Jipe

31-12-2015, 15:39

a very good new for the end of the year and good luck for the next

بواسطة Grauw

Ascended (10821)

صورة Grauw

31-12-2015, 15:41

Hurray!

Thanks for your efforts in the middle of the holidays guys!

And happy new year Smile.

بواسطة wolf_

Ambassador_ (10135)

صورة wolf_

31-12-2015, 16:52

define irony: the url of this newspost Hannibal

بواسطة Wild_Penguin

Hero (644)

صورة Wild_Penguin

31-12-2015, 17:00

Welcome back into 2016, MRC!

And a happy new year to everyone!

بواسطة Daemos

Prophet (2169)

صورة Daemos

31-12-2015, 17:45

Quote:

define irony: the url of this newspost Hannibal

That is how difficult it is to kill MRC. It dies and returns dead because no one can rise from the dead. A new way of cheating against the forces of nature. Running Naked in a Field of Flowers

بواسطة supmsx

Master (158)

صورة supmsx

31-12-2015, 20:51

Keep going,the MSX force is with you Smile

بواسطة DanySoft

Champion (452)

صورة DanySoft

31-12-2015, 22:36

Fortunately, you're alive again. Smile

Happy New Year 2016.
DanySoft

بواسطة KdL

Paragon (1485)

صورة KdL

01-01-2016, 03:09

Hurray! Clap Clap Clap!!

Happy New Year!!! Big smile

بواسطة libero

Resident (45)

صورة libero

01-01-2016, 11:16

welcome back.
Happy New Year!!!!!!

بواسطة gdx

Enlighted (6436)

صورة gdx

01-01-2016, 11:59

Welcome online again and Happy New Year!

بواسطة karloch

Prophet (2159)

صورة karloch

01-01-2016, 14:29

Glad to have you back! Happy new year!

بواسطة Imanok

Paragon (1200)

صورة Imanok

01-01-2016, 14:33

Great you are back in track! Happy New Year! Big smile

بواسطة raymond

Hero (653)

صورة raymond

01-01-2016, 19:45

Good to see everything is in working order again! Happy new year!

Hannibal

بواسطة ren

Paragon (1947)

صورة ren

02-01-2016, 00:22

(back here as well... ;))
(good job btw ;))
(+ happy new year ;))

بواسطة gdx

Enlighted (6436)

صورة gdx

03-01-2016, 09:45

There is still a problem. The wiki can not be updated.

بواسطة snout

Ascended (15187)

صورة snout

03-01-2016, 10:38

on the fix in a few moments. Hang on!!

بواسطة syn

Prophet (2135)

صورة syn

04-01-2016, 01:07

wb

بواسطة gdx

Enlighted (6436)

صورة gdx

04-01-2016, 01:38

That still does not work for me. I can not update this wiki:

http://www.msx.org/wiki/Victor-HC95

بواسطة gdx

Enlighted (6436)

صورة gdx

04-01-2016, 09:08

I always get "server error 500". After a million clicks, a part the update has been accepted only.

بواسطة mars2000you

Enlighted (6557)

صورة mars2000you

04-01-2016, 10:52

Actually, the changes are accepted, but this error screen lets you think the contrary. If you go back to the page (2 steps behind) and refresh the page, then you see that the changes have been accepted.

So, the problem is: why this error screen is displayed instead of the updated page ?

بواسطة snout

Ascended (15187)

صورة snout

04-01-2016, 11:25

Didn't get around to the actual fix yet - hope to tackle the issue this evening. Will drop a line here when things should be a-ok again.

بواسطة mars2000you

Enlighted (6557)

صورة mars2000you

04-01-2016, 11:46

Another problem with the wiki : uploading pictures does not work. I get this kind of message :

"Could not rename file "/tmp/phpFaTMdA" to "public/e/eb/Yrm506i.png".

بواسطة snout

Ascended (15187)

صورة snout

04-01-2016, 11:55

Thx for the report, I'll took into that one this evening as well!

بواسطة snout

Ascended (15187)

صورة snout

04-01-2016, 12:03

images might have been fixed already, looks like a simple directory permissions thing. No time to test it now, though, gotta run for some appointments...

بواسطة mars2000you

Enlighted (6557)

صورة mars2000you

04-01-2016, 12:11

It still does not work ... Now error 500 and no any file saved.

EDIT : finally the picture has been accepted !

بواسطة mars2000you

Enlighted (6557)

صورة mars2000you

04-01-2016, 17:39

Actually, the problem seems to be the same for uploading a new or updated picture : error 500. I need to go to the page where the picture must be and to refresh the page !

بواسطة snout

Ascended (15187)

صورة snout

04-01-2016, 18:07

So the file permissions issue was solved, the content submission -> 500 error is remaining. I'll get started late in the evening, but this is info I can work with. Thx! Wink

بواسطة Grauw

Ascended (10821)

صورة Grauw

04-01-2016, 19:10

I also noticed that when I first made a (red) link to a new wiki page, and then clicked the link to create the new page, when I went back to the page with the link the link was still red, until I made another modification. Maybe some overzealous caching? Not sure if this is an old or a new issue… not a big deal, but I’m mentioning it anyway in case it may give you a clue about some possible configuration problem.

بواسطة mars2000you

Enlighted (6557)

صورة mars2000you

04-01-2016, 23:44

Another little problem in the Wiki. I've created a new page

http://www.msx.org/wiki/Yamaha_YRM-302

for the Category Yamaha, but it does not appear in the list on the category page

http://www.msx.org/wiki/Category:Yamaha

بواسطة snout

Ascended (15187)

صورة snout

05-01-2016, 02:48

't was a caching issue indeed. Fixing a few images missing in action and then everything should be back to normal. Yay!

بواسطة mars2000you

Enlighted (6557)

صورة mars2000you

05-01-2016, 10:03

Thanks, Snout ! All now seems to be OK ! Smile

بواسطة Samor

Prophet (2220)

صورة Samor

06-01-2016, 11:59

a belated HNY and WB from me Wink

بواسطة RetroTechie

Paragon (1563)

صورة RetroTechie

08-01-2016, 22:51

A very late best wishes for 2016 to you all! Running Naked in a Field of Flowers Spent a full week @ my parents place where little surfing was done... but better late than never.

And kudoz for getting the site up & running on the new server!

بواسطة gdx

Enlighted (6436)

صورة gdx

10-01-2016, 01:31

بواسطة mars2000you

Enlighted (6557)

صورة mars2000you

10-01-2016, 01:38

Refresh the page !!!

بواسطة gdx

Enlighted (6436)

صورة gdx

10-01-2016, 01:58

Thank you, now it appears.

بواسطة gdx

Enlighted (6436)

صورة gdx

22-01-2016, 01:14

The problem continues. I cannot see the newer entries in MSX lists. For exemple, I cannot see the MSX Paxon. I tried using different browsers, the refresh and also cleared buffer.

بواسطة snout

Ascended (15187)

صورة snout

22-01-2016, 10:17

Like Grauw said, overzealous caching indeed. I'll try and fix it soon, but it'll have to wait a bit.

بواسطة snout

Ascended (15187)

صورة snout

22-01-2016, 11:18

Perhaps this is also a good moment to send some big thumbs up to Mars2000you who has been adding an amazing amount of information to the wiki recently. Really valuable stuff & very impressive! Hannibal

بواسطة Grauw

Ascended (10821)

صورة Grauw

22-01-2016, 13:21

Yeah it is! Props!

بواسطة ren

Paragon (1947)

صورة ren

02-02-2016, 18:36

snout wrote:

Perhaps this is also a good moment to send some big thumbs up to Mars2000you who has been adding an amazing amount of information to the wiki recently. Really valuable stuff & very impressive! Hannibal

Still going strong btw.. Wink

بواسطة gdx

Enlighted (6436)

صورة gdx

11-02-2016, 10:07

The problem persists. For exemple, I cannot see the MSX1 HB-75AS in the list. I try on many systems.
I think you have a problem of autorisations. Mars2000 can see it (probably because he has created the wiki itself.)

بواسطة snout

Ascended (15187)

صورة snout

11-02-2016, 10:44

It's a caching issue (there's a per-user cache in place) and I haven't gotten around to working on the code yet. I'll announce it when an update is issued.

بواسطة snout

Ascended (15187)

صورة snout

15-02-2016, 01:04

@gdx - I've disabled a cache setting in the Wiki that I suspect might be the culprit. It makes the wiki a tad slower, but I'm curious if it solves the issue for you. It seems ok for me now.

بواسطة gdx

Enlighted (6436)

صورة gdx

15-02-2016, 01:50

Now the Casio MX-101 is displayed but not the Casio MX-10.

بواسطة gdx

Enlighted (6436)

صورة gdx

12-03-2016, 08:59

Good luck to fix this problem!
The list of MSX1 seems to be remain stuck at 156 pages for several days ago. Many MSX1 are not listed like National CF-1200, CF-2000, FS-1300, FS-4000, etc.

https://www.msx.org/wiki/Category:MSX1

But missing MSX1 are listed on the following list.

https://www.msx.org/wiki/Category:National

The Philips VG-8230 is also missing from the list of MSX2 and perhaps others.

This problem also occurs for updated images.

بواسطة gdx

Enlighted (6436)

صورة gdx

23-04-2016, 07:58

snout wrote:

It's a caching issue (there's a per-user cache in place) and I haven't gotten around to working on the code yet. I'll announce it when an update is issued.

Are you sure? The issue occurs when we are not logged.

When I am logged I can see 78 pages into MSX2 list but when I'm not logged I can see only 59 pages. The MSX1 list is 173 pages when logged, 156 pages only when logged out.

بواسطة Grauw

Ascended (10821)

صورة Grauw

26-04-2016, 20:58

Something’s indeed still off with the caching; I see mars2000you’s 20:55 post here, but on the frontpage I still see my own 20:44 post preceding it.

[Edit: and now it’s showing correctly.]

بواسطة raymond

Hero (653)

صورة raymond

01-06-2016, 20:56

Since approx. 29-5 I do not get mail anymore when somebody posts a reaction on a thread I reacted on earlier. Has this been switched off?

بواسطة mars2000you

Enlighted (6557)

صورة mars2000you

01-06-2016, 20:59

بواسطة raymond

Hero (653)

صورة raymond

04-06-2016, 06:54

Thanks, good to know! Hope it will be back very soon. Smile

بواسطة djh1697

Paragon (1736)

صورة djh1697

31-12-2016, 23:55

Vinyl records are back from the dead here in the UK...!!

بواسطة Protoman

Resident (44)

صورة Protoman

04-01-2017, 12:04

Excellent work!!

بواسطة Manuel

Ascended (19678)

صورة Manuel

31-12-2019, 21:40

Is it still on this dedicated server or now moved into cloud infrastructure?