Wed 05 March 2014
Hooray! I've finally updated my home file server. This is the first non-drive change made to the system since I built it back in 2010.
The original build allowed up to 20x SATA drives sitting on top of LSI 2068E cards and a motherboard with three 8x PCIe slots on an Intel X58 chipset. This design was to allow for enough bandwidth back to the CPU for full controller-speed (SATA II) for all 20 drives in the chassis.
The system has served me well to date, but as I expand the array I'd like to keep on top of disk density - and if the opportunity arises, I wouldn't mind something a bit quieter.
Also beyond a crazy growth rate of ~300+GiB/mo for the first year or so, my growth rate has calmed massively and I'm only sitting at around 11TiB of data all up spread over 8x 2TB disks. So maybe supporting up to 20 drives isn't necessary after all.
I had a bit long rant preparated about all the goals and issues, but honestly it boils down to:
I ended up settling for a design with a chassis supporting 12x 3.5" + 2x 2.5", with passive backplanes and different card on the LSI SAS2008 chipset. Whilst the dollar-per-bay isn't as great on the new case, it's a much higher build quality and has better airflow/cabling.
And it runs great - I've rebuilt the array onto 6x 4T drives still using linux software RAID but now using btrfs as the filesystem (I'll redo this as raw disk btrfs raid when the code for that is a bit more mature).
Now that the data migration and deduplication run have completed, I can cross this off my TODO list - and decide what to do with the spare gear I have left over, enough to build 2 file servers.
Mon 03 March 2014
I mentioned in a recent post that I've been working with a cool piece of technology called AngularJS recently. It's been a long, long time since I've done any regular web work - but since picking up Angular, I can honestly say that building web applications has never been more enjoyable.
As a developer, I found the documentation reasonably sucky - it has a quick tutorial and jumps straight into API documentation. There's no guide on overall architecture, which makes understanding how you should be building your app a bit difficult.
What follows is my quick and dirty list of notes for developers looking at using Angular in their app:
filtermodule, if you use the string comparison this is actually a substring match (this has caught me out badly before). You probably want to make a global filter using angular.equals in these cases.
angular-route.js- Provides the
ngRoutemodule providing page routing for a single-page application
angular-resource.js- Provides the
ngResourcemodule allowing you to easily create services backing onto REST interfaces
I hope this is useful to other people starting out.
Thu 28 November 2013
I got dragged into another philosophical argument the other day regarding white space in code. It's one of those quintessential tech discussions that does nothing more than rile people up over something that, for the most part, doesn't achieve anything of value.
Generally speaking, I try and stay out of these discussions - however given I was trolling the person in this situation, I feel entitled to claim at least some small victory - someone has to.
That being said, I do have an opinion - and in the interest of adding to the pile of spew on this site that feeds back into the greater slum that is the internet - let me tell you what I think.
Let's start with my personal preference:
Easy! You're well on your way to coding nirvana. I think this scheme works particularly well because:
And to cap it off, here are some common arguments as to why we should avoid TABs, and why I think you're wrong.
Ultimately though, arguments like this are a zero-sum game - nobody is going to be 100% happy, and there's always going to be that guy who has invested their sense of identity in their position on tab-vs-space - but you're wasting your time dealing with them anyway, right?
Pick one that makes the leasy number of people cry, stick to it and move on - we've got interesting problems to solve.
Sun 13 October 2013
I recently stumbled across a post by Timothee Besset about his plan for an experimental framework for low latency, high fps multiplayer games. TTimo is a games programmer who wrote QRadient and has worked at id software, so knows a bit about what he does.
His post outlines the architecture for a modern FPS game engine, which struck a chord with me. Mostly because at a high level, it's similar to an idea I've had before, a message-oriented game engine using ZeroMQ and its zero-copy message model.
It's always nice to see your idea validated, especially by someone who knows what they're talking about. I'm most definitely not a game programmer, despite having tinkered and modded a lot over the years.
I also happened upon a fantastic interview with Edmund McMillen of Team Meat. Whilst being a talk about game development - Edmunds discussion about motivation, career and dealing with people really struck home about a lot of things I have been thinking about recently. Some of those things I'm not ready to talk about, but in terms of game development, the message is clear - keep going at it, the first 30+ things you make are going to be absolute horse shit..
Combined with discussions with one of my coworkers who is writing his own WebGL MMO, Langenium, the interest has definitely been reawakened, for now.
As a result, I've been putting a small amount of time into this project over the last three weeks. One of the biggest problems I've had working on game-related projects (or really, anything at all) is trying to do too much all at once. You get no reward and make all the wrong design decisions at once.
Instead, I've been working at this iteratively - starting with a 2D maze game and upgrading a single thing at a time towards the end goal of a 3D FPS. A high-level of the iterations are as follows:
So currently, I can load and render a Quake 3 map - moving around within the world. I've implemented visibility testing using the BSP tree, however have a bug in either that code or my BSP loader which is preventing it from working correctly.
Before I push on - I need to fix that and implement support for Vertex Buffer Objects, as I am currently making an OpenGL call for each vertex, which is very expensive and thrashes the frame rate way down. I'm currently getting 10-15FPS, which is much better than I was expecting for my simplistic engine so far.
The Quake 3 map format is super-efficient and designed so data can be slurped straight off disk into OpenGL buffers. My BSP loader takes the data and interprets it into an object graph - so currently does not do this. The current plan is to implement my own load handler to re-flatten the data internally.
Whilst this is a bit of a waste for now, I don't have my own BSP tooling and want to keep my engine from being tied to the IBSP format. This is primarily a learning exercise, and I would like to support early versions of the Valve BSP format as well before I'm done.
I'll be happy with my progress when I can come up with a simple death match game with netcode, similar to Quake 3 - complete with bots. Once I'm done with the game side I want to explore the map 'compilation' side of things, BSP partitioning and portal testing.
I've never really understood that side of things before now, and conceptually it's very straightforward - which is a nice refresher. I'm hopeful that as long as I can stay motivated and get past where I'm currently stuck, I can start to play with game ideas on top of my own engine stack.
Sun 13 October 2013
Time for another update I suppose. Last year I noticed that it seems I'm most intellectually active around April and October, which definitely seems to hold true this year.
This year, I've been trying to force myself to spend four hours a week at a coworking space. I'm a member of a local space called Spacecubed, who host the local Startup Weekend events and have become a great hub for local special interest groups.
Using the space is fantastic, mostly because its a comfortable place where I can zone out and set time aside weekly for getting things done.
I've recently started foraying into Java again. Borne mostly out of need at work, where I am writing some software to manage software deployments where reliable Git integration is possible. Plus, y'know... all the cool kids are on JVM these days.
Self-learning EE has been rewarding, and it looks like it has come a long way since I last looked at it. It looks like Java 8 will also bring about a lot of long-needed language improvements as well, including Lambda expressions - something I've found makes writing fluent code really nice in C#.
Together with Java EE and JAX-RS - this has given me a good common patern for developing web apps again, so should cut down on the hemming and hawing when I get motivated about some of my many forever projects.
This has been an interest for a long time, and having recently picked up a dslr that shoots 1080p, has been something I've been toying around with.
Whilst I'm interested in the effects side of things, to keep it interesting - I really need to be able to tell a story effectively. Even a one minute narrative is stretching myself a bit thin, but it's hard to get motivated when you're camera shy.
In the meantime I'm reading some good books on scriptwriting and creative writing and will keep hammering away on this in the background.
This one I'm particularly happy and motivated about. So much so, it's going to get its own post. Bully for me.
Will is a terrible person. He should be shot.Will Dowling
This is the personal website of Will Dowling, a Systems Engineer hailing from Perth, Western Australia.