Oh no! Not now!

Bugs
3

Right in the middle of NaNoWriMo, the server got the hiccups.

First, the blogs stopped responding. Then the main site went down. I did what any stressed dev might do and restarted the server.

Bad mistake!

The MySQL server refused to come back up. Just totally refused.

After some time I found an error log file that had gotten a bit big. I removed it but the server still reported a file space problem.

What?

dev in painOkay, stay calm.

I will not panic, I will not panic…

PANIC!!!!

It turns out that sometimes you also need to restart services that were using the file so they give the space back. I’m sure there is a good reason for that but… Right now I am no fan of that feature. Actually, that’snot true. I know exactly why things work like that and it is a really good design. It comes up so infrequently that I had forgotten about it.

Anyway panic over I restarted the database and everything was fine, right?

No of course not.

One of the blogs – my blog – had a corrupted table and so was still acting like it was down.

I tried not to headbutt my nice new desk and ran the table repair. MySQL has this “magical” ability to fix itself if you “ask really nicely”.

Panic over…

Note to self, get with migrating your older stuff that makes big log files to something a bit less aggressive.

The image used for this post was first used by one of our bloggers. It seemed apt.

Not sure what your hosting platform is, but don’t the log files get recycled? (not sure what the technical term is). Normally log files would be gzipped after a period of time, or when they reach a certain size, only a limited number would be kept.

You are right Danny. Log Rotate would have eventually taken care of the problem. Not logging a lot of nonsense was just more efficient. It was pretty much just an edge case mistake on my part.

3 Comments

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Your post must include a link to this post.

How does this work?
Write a response on your own website and include a link to this post. Then submit your response’s URL here. Your response may appear here after moderation. To update or remove it, edit or delete your original post and submit the same URL again. Learn more about Webmentions.
Bugs
1
I’m checking up on a small bug

There appears to be an issue with ActivityPub on some blogs, including Author Buzz HQ. It should not break the site (as far as I can tell), but it might make following the blog on the fediverse tricky. Whatever the problem is, I’m on it. Update 1: Dev blog itself …

Bugs
You subscriptions page bug fixed

As you might know, you can see all the things you have subscribed to on https://authorbuzz.co.uk/activity/ – I found a “fatal error” bug there today. This type of error just means the code gives up and refuses to show you the page. I fixed it. Let me know if you …

Bugs
PHP updates and fixing BuddyPress Follow

BuddyPress Follow is a plugin we use to enable you to follow rather than “friend” each other. Sadly, it is not PHP 8 ready. This was holding us back both in terms of security and speed. Today, I fixed that. It was a four-line fix, which I shared here. Find …

Skip to toolbar