Linux

Apache to Nginx : conclusion

Well as planned and as discussed in my previous post, last weekend we switched ogre3d.org from a dedicated server running Apache, to a virtual private server running Nginx. How did it go? Well, surprisingly well in fact. I say ‘surprisingly’ not because it was a casual throw-of-the-dice affair - I did a lot of preparation and testing - but because I’m old enough to know that nothing ever goes completely to plan, and we didn’t have any (cost effective) way to test the full server load ahead of turning it on.

Read more →

Dependencies to build Git from source on [K]Ubuntu 9.04

Git is picky when it comes to converting large, moderately complex Subversion repositories and so far the only option I’ve found that works reliably is using the very latest version on Linux. Forget about using 1.6.5 on Windows via msysGit, at least for the git-svn conversion it’s very, very unreliable. Similarly I found Git 1.5 on Linux very flaky for the svn conversion. This doesn’t give me the greatest confidence in Git but in order to properly explore all the angles, I’ve committed to making it work even if it means I have to monkey about a bit.

Read more →

S3 encrypted upload script, v2 (Python)

Ok, so I discovered a number of shortcomings in my recent attempt to sync a folder in one direction to Amazon S3 using encryption, the most important of which was that it wouldn’t resume a failed transfer efficiently, which in the case of large transfers wasn’t at all ideal (as I learned to be own cost - damn my 256k upload speed). So, this is attempt number 2. I decided to completely rewrite the script in Python instead to give me some more flexibility, coupled with the availability of Boto, a nice Python library for accessing all the Amazon Web Services.

Read more →

s3putsecurefolder

amazon backups Linux s3 sysadmin

Edit: this script is deprecated in favour of a rewritten version 2. I use Amazon S3 to host large media files which I want cheap scalable bandwidth on, and for expandable offsite storage of important backups. I used to have some simple incremental tar scripts to do my offsite backups, but since I moved to Bacula, I’ve just established an alternative schedule and file set definition for my offsite backups, the critical subset of data I couldn’t possibly stand to lose (like company documents).

Read more →

MS breaks the sixth seal?

Quick check - ok, the sun is in fact not as black as sackcloth. But today, something earth-shattering happened - Microsoft has contributed code to Linux. I’m sure I’m not alone in thinking that I’d never live to see the day this happened. It’s 20,000 lines of driver code to make Linux run better under Hyper-V, which is of course in their interest (since you have to buy a copy of Windows Server 2008 as the host) , but that’s par for the course for open source contribution (you scratch your own itch!

Read more →

UNetbootin is awesome

boot Linux ubuntu UNetbootin

I just assembled a new server machine, which in the end I chose to house in a shiny aluminium Thermaltake Lanbox, which is relatively compact but still roomy enough for two hard drives, a bog-standard power supply, and plenty of airflow, which is what I wanted. I also knew that the fans on this case were nice and quiet (I have a black steel version as a GPU test box, I wanted a lighter version this time!

Read more →

Moblin looks really interesting

Intel Linux Moblin Novell

Not being the kind of person who would buy a netbook, I hadn’t really paid much attention to Moblin, Intel & Novell’s new netbook-targetted, Linux based operating system. However, Matt Asay posted about it today and that got me looking at it, and I have to say I’m very impressed. I love that they’ve tried to rethink the operating system interface from the ground up rather than just follow in the footsteps of previous efforts.

Read more →

I *heart* plain text configuration files

config Linux Tech Windows

A small bit of musing while I wait for another back-up to run… Reinstalling a server from scratch sucks. Obviously. Not being able to use direct dumps of the old system itself because of concerns of how far a malicious attack got, and how long ago (even though we’re running SELinux) means that everything has to be constructed afresh. How much fun I’m having. But if there’s one silver lining here, it’s that at least Linux stores every shred of its configuration in a simple, plain text format, and in one dedicated subtree of the file-system.

Read more →