A view from the rack

A farewell to SWF's and hello to gestures

2011-12-09T21:47:00.006Z

Flex development for iOS is a new adventure for me, it has taken about 3 years to gain a reasonable proficiency with Flex but as with all things, nothing stands still and the pressure to keep moving with the times is ever present. It seems to me that the announcement to halt developing Flash for mobile devices represents a step forward rather than a retreat. The plugin architecture has plainly had its day and device manufacturers are demanding control of the programs which run on their hardware via the App stores which are now ubiquitous.

The problem is that my BI platform is entirely crafted on Flex and therefore relies on the flash plugin for use as I have never felt the urge to move over to AIR before now. That has all changed and it has actually been a very positive prod to investigate the new capabilities of Flash Builder and to begin to think about designing in a new way. Cross platform RIA used to mean Flash and I suppose it still does but as I understand it you are now looking at packaged Flash rather than swf files ready for the plugin and a series of GUI's crafted for each of the expected deployment platforms.

Anyhow enough of my view, its hardly an original train of thought and its well documented, on to the small nugget of code I wish to preserve for my cluttered memory. Along with the new platforms which flex supports there are also some new specific mobile features, in particular the ability to handle gestures or "finger swipes" on mobile touch screens. Its actually beautifully simple and the code follows for an empty view where I wanted to backup the back button in the action bar with a swipe feature for moving back to the previous view.

in the View tag you need the following code

gestureSwipe="handleSwipe(event)"

and then the following in the script.

import spark.transitions.SlideViewTransition;

import spark.transitions.ViewTransitionDirection;

private function handleSwipe(event:TransformGestureEvent):void{

var slideViewTransition:SlideViewTransition = new SlideViewTransition();

if (event.offsetX == 1 ) {

slideViewTransition.direction = ViewTransitionDirection.RIGHT;

navigator.popView(slideViewTransition);

}

Now if you deploy your app to a touch screen device you can move to the previous view simply by swiping your finger, it takes the app into the brave new world!

A breath of fresh AIR

2011-12-09T11:53:00.002Z

After 3 years away I have decided to reopen the blog but with a slightly changed focus. Whereas in the past my blog was a useful journal of the progress of the IT department and concerned infrastructure, programming and Linux. Going forward although there may be the occasional Linux post I will shift focus to Flex, AIR and iOS development using Flash Builder. The IT department still exists, although I am less inclined to share the infrastructure and Linux progress, but there are so many new and interesting features coming forward with Flex development I need a journal just to keep track and so I might as well share it!

Enslaving a bind DNS server on CentOS

2007-09-13T16:11:00.000Z

One thing I have been trying to accomplish ever since I commissioned our server in Manchester almost 9 months ago now is getting it set up as a secondary DNS server, this I have finally accomplished and it is an experience worth sharing. There are many howto's on the Internet which tell you how to set up a DNS server on windows or Linux but what I was after was to setup BIND on Linux as a fail over system for our main Microsoft DNS server and this is a far less well documented scenario. Also contrary to what you might read its actually really easy just don't step off the path!

For those of you who don't know, DNS is the system which marshals the traffic around the Internet, for example in the absence of DNS you would have to type in 72.21.206.5 instead of amazon.com to get to your favourite e commerce merchant :o). So DNS is important for the Internet but also as local networks are now very much modeled upon the Internet scheme, without DNS it becomes very difficult to manage your network in a user friendly manner. Which as usual is great until it breaks!

So very quickly as your office network becomes more central to the workings of your business it is natural to want a secondary system in case the first one breaks, especially when you are using a VPN as we are as the loss of our central DNS server would render our remote systems unusable as well. So that's the background, here is the solution to setting up a secondary DNS server using BIND on Linux as a slave to an Active Directory DNS server. Bear in mind this is for CentOS 4.5 (RHEL 4 equivalent) using the command line, if you are using a GUI just use the GUI tool!

1. On the Microsoft box open DNS and right click on the forward lookup zone you wish to replicate, eg, somebiz.local. Under 'Name Servers' add the IP address of your Linux box.
2. If you have already been playing, completely remove your existing BIND installation (yum remove bind), and trash any files in /var/named/chroot/var/named.
3. Run yum install bind to install a fresh one.
4. Paste the following into /var/named/chroot/var/etc/named.conf

// Red Hat BIND Configuration Tool
// Default initial "Caching Only" name server configuration

options { directory "/var/named"; };

zone "mydomain.local" IN {
type slave;
file "slaves/mydomain.local";
masters { xxx.xxx.xxx.xxx port 53;};
};

include "/etc/rndc.key";

5. substitute your domain for mydomain.local and your active directory server's IP address in the xxx.xxx.xxx.xxx space.

6. Run service named start and make a cuppa cos your done!

Obviously this is not a comprehensive look at this subject, there is an awful lot more to play with in bind but that really is all you need to do to get going. Hope it helps..

New lines vs Carriage returns

2007-08-02T15:02:00.000Z

There really is not much in this post for the layman so if you are not a dyed in the wool techie your going to find this dull so I apologise to you.

I came across an interesting problem this afternoon when quietly building some PDF files using PHP (as is my want) which I would like to share. It concerns the carriage return which is an invisible character usually used to move the currently printing text onto the next line. It turns out FPDF, the PHP module I have been using to generate PDF files just doesn't like them. Instead it uses the alternative invisible character 'new line' which is great :o) hooray!

The really ticklish bit of all this is of course that these characters are both invisible so when one is having a struggle with them its really bit like wandering around in the dark. The first step when trying to sort a problem of this nature is to turn these characters into their representative codes, for this one requires the ord() function. One then needs to isolate these pesky invisible characters and decide what to turn them into.

So to cut a long story short if you are trying to print a block of text using FPDF and your line breaks are not appearing use the following little function on your text:

$text_var=str_replace(chr(13),chr(10),$text_var);

where $text_var is the variable containing your text. The function will magically strip out the ASCII character 13's (carriage return) and replace them with shiny new ASCII character 10's (new line).

Pdf Trials

2007-07-12T20:11:00.000Z

As soon as a programmer creates a program which stores information, at some point someone is going to want get at it (the information that it), print it, send it to someone else or just take a copy. In other words one requires a portable document.

In our little in-house programs we have been using Excel a lot, it is ideal for presenting raw data to IT savvy managers as quite often the first thing they want to do is chop the data around, turn it upside down, rattle it and maybe analyse it against another spreadsheet. Excel begins to struggle when it comes to printing and presenting a better looking sort of document so we have begun to look at creating PDF documents for some of our reporting and printing requirements.

The first thing you find when you are looking for a program to create PDF files is a library called PDFLIB made by a company called ... PDFLIB. They have products for programmers who use C, Java, Delphi and our own favourite PHP. The upside is that it is quite comprehensive offering the vast majority of the elements defined in the PDF format, the downside is that it costs about £1000. Given the price tag I decided to dig a little deeper and turned up a product called FPDF where the F stands for Free, a much more palatable entry in the IT budget.

So Having installed the library effortlessly and tried a few of the examples I was impressed, the functions are limited but actually it seemed to cover everything I needed. The next step was to dive into probably the most complicated PDF file we have and up until the very last element it was all going so well, attempting to write vertical text knocked the wheels off the wagon however. Was vertical text going to cost a grand!?
Back to Google with a fresh cuppa and given that the PDF Format is freely published I thought maybe I should try my hand at extending the FPDF lib and adding the function for rotated text myself. The problem is it has been 15 years since my A level maths teacher force fed me matrix transformations and Adobe might have published the format and described the matrix transformations but they don't really 'throw you a bone' when it comes to programming them.

More tea and some inspiration from a tunnocks tea cake turned up a pear module which is in a slightly fragile beta 0.2 state but essentially builds on FPDF and includes a rotate_text function - File_PDF. Being a pear module, installation was easy but could I get it to work! Alas no. However could I lift the bonnet on both these php projects and force them into an unholy union, why yes sir! So this is my contribution to the open source community, if you are using FPDF and need the ability to rotate some text paste the following code into the fpdf.php file and call it using the last line of code.

function writeRotie($x,$y,$txt,$text_angle,$font_angle = 0)
{
if ($x < 0) {
$x += $this->w;
}
if ($y < 0) {
$y += $this->h;
}

/* Escape text. */
$text = $this->_escape($txt);

$font_angle += 90 + $text_angle;
$text_angle *= M_PI / 180;
$font_angle *= M_PI / 180;

$text_dx = cos($text_angle);
$text_dy = sin($text_angle);
$font_dx = cos($font_angle);
$font_dy = sin($font_angle);

$s= sprintf('BT %.2f %.2f %.2f %.2f %.2f %.2f Tm (%s) Tj ET', $text_dx, $text_dy, $font_dx, $font_dy,$x * $this->k, ($this->h-$y) * $this->k, $text);
if($this->underline && $txt!='')
$s.=' '.$this->_dounderline($x,$y,$txt);
if($this->ColorFlag)
$s='q '.$this->TextColor.' '.$s.' Q';
$this->_out($s);
}

// Write 'Soup' at grid ref 50x50 at a 90 degrees rotation
$pdf->writeRotie(50,50,"Soup",90,0);

As ever one hour of the day accomplished 95% of the job, the rest of the day was spent chasing around after a seemingly straight forward willow the wisp of a function.

Fiddling around and the simple storage solution

2007-06-22T12:44:00.000Z

I was invited on to the Amazon Computing Cloud yesterday - a seminal moment as I have been desperate to have a go on it for weeks now, but disaster! I was passed over because I had foolishly forgotten to open an S3 (simple storage service) account which is a prerequisite, despite my grovelling and the immediate opening of an S3 account I appear to have missed my window of opportunity.

That said it has given me a little time to investigate the simple storage service and in itself this has opened a few doors in my mind. Storage in the S3 bucket is very cheap indeed at 15 cents per Gig per month, this means for example that I could store my largest SQL database, at 2Gig and rising, on the ultimate storage system for 14p per copy per month with transfer costs of 10p. Doing a little simple maths therefore means that backup scenarios would cost:

24p per month per copy

£1.78 per copy per month

£50 per month for a rolling 30 day backup

£650 pa. for a daily backup rolling on for 12 months (almost 800Gb of data)

The real magic here is not that I can get someone to host almost a terabyte of data for £650 pa but the infrastructure behind it, storage spanning multiple data centres in multiple countries, is fantastic. There are only 2 slight problems, there is a file size limit of 5Gb at present which hopefully will have increased by the time my bloaty database has got anywhere near that, also my backup software Red Gate does not at present support S3.

So I'll have to write a little program one of these days to bounce my off site backup from our Manchester server over to the S3 cloud on a nightly basis then I really, really will have an offsite backup I can be satisfied with. Alternatively our friendly Red Gate developers might like to take the hint, get an S3 account and crack their programming type knuckles. Utility computing has to be the future of off site backup so get in there, I wont charge for this revolutionary piece of advice but I have broken my promotional Red Gate pen so if someone wants to send me another one we'll call it quits :o)

Whilst I am on the subject of S3 there is a fantastic little add on for FireFox which I found very useful for getting things moving, the S3 organizer, its a good job the programming is better than the spelling of organiser :o)

And speaking of really useful little pieces of software anyone who does any programming of web apps should get themselves a copy of fiddler. Its a really rather sweet little program written by Microsoft (tun tun tun!) and distributed free! Maybe Bill finally has enough.

Anyhow before I get on my soap box, fiddler is a very simply http proxy server which gives you a real time readout of what traffic is moving through your Internet connection. As we are using Flash couple with AmfPHP we constantly struggle to debug in an efficient way but not anymore! I wont spoil compadre Robs review right now but just get it and watch out for the bug eyed review.

In the queue for the ECC

2007-06-06T08:28:00.000Z

There have been lots of things going on over here for the past month but nothing really blog worthy, aside from this, having a baby has somewhat curtailed my late night blogging sessions, so this is the first post since May 10th!

We have signed up for the ECC, this is not another odd-ball European thingy but in fact Amazon's new web service christened the Elastic Computing Cloud. The concept is what is known as utility computing in that you create a new Virtual Machine and only pay for the storage and processor time you use. This means that within reason your online application can scale wonderfully from being a dusty corner of the web which no-one ever uses to the latest craze with millions of users in minutes and your server wouldn't crash (as long as your code is well written of course).

We have a little online application which we will very shortly be polishing for general release and this seems like a great opportunity to keep our initial installation costs very low but have the ability to scale quickly to meet the needs of our new users :o) Then of course, when things have settled down, and we know what sort of power we are going to require long term we can make a more informed decision about buying our own hosting kit without having to wade through goat intestines with the help of a good soothsayer.

The spanner in the works of course is that everyone else want to make use of this wonderful new service as well and I have found myself in the queue. This seems to be a rather annoying trend in fact, I queued for Joost, I queued for Google applications for Domains and now I am in another queue. I suppose it allows companies to test their systems without having a big embarrassing launch followed by teething trouble but I want it now :o(

I have looked for alternatives but it seems no one else is offering such a simple, well supported and dare I say cheap service within the means of the average web applications developer. Until now utility computing was in fact the preserve of the scientist wanting to test his quantum theories or analyse what happens in the middle of a cosmic jam doughnut (think SETI) so it seems Amazon are possibly on the cusp of having a runaway success. Every applications developer who doesn't want to ask his boss for a new server and equally doesn't want potentially unstable code on one of his precious live servers will want an account for testing stuff.

I am only surprised that Amazon beat Google to it as its just their sort of thing, I look forward to using the gutility computing cloud in about 2 months (probably for free) and inevitably the Microsoft computing cloud in about 2 years which will be compliant with the utility computing standards which the IEEE will have created and ratified by then but with of course.... Microsoft extensions.

Finding extra space on a VMWare Virtual Machine

2007-05-10T16:27:00.000Z

Now our Redgate SQL Server backup system is running nicely it has exposed a slight deficiency in my server setup over in Manchester, the problem now is that when I created virtual machines for all our little applications running on the VMware system I only gave then 4GB disks :o)

For the Nagios system, the Intranet applications, the source code repository and the knowledgebase these disks are perfectly adequate but for database backup obviously a bit more space is required. Having utilised a spare folder on the knowledgebase virtual server for the SQL Backup it would have been very inconvenient to erase the machine and create a new one and also given the fact that the host server is not overburdened with RAM I didn't feel it would be wise to put more than 4 machines on the system.

So we come to a less well documented feature of a VMWare virtual machine, when you set the hard disk size on creating the machine you cannot increase it in the future. So you have 2 choices, the Lego approach - smash it up and start again, or the clever approach, add on a new virtual disk. I chose to be clever and in a nice twist of fate got away with it :o)

So I think a little how-to is in order.

Begin by adding a new disk in VMWare, it was recommended that I choose a SCSI disk so I complied, bear in mind this has to be done with the virtual machine powered down. When you have added the disk just power up again and you are there, all you have to do now is to get your Linux install to make use of it.

As I have blogged before our flavour of choice when it comes to Linux is CentOS but RHEL4 or Fedora would probably work in exactly the same way because its pretty basic stuff really.

First use Fdisk to create a new partition, as this is our second disk its SDB (SCSI Disk B)
so:
fdisk sbd
and then just follow the instructions to create a new partition.

Next you need to format the new disk so:
mkfs.ext2 /dev/sdb

At this point you need to check the space on the disk so:
df
and you should see your new disk listed

Finally you need to mount the disk so:
mount -t ext2 /dev/sdb /home/samba/sql

As I was using samba to share the /home/samba folder all I needed to do was update the permissions on the folder and restart the service - job done.

Now I have a bit more space on the share the backup has worked a treat, it is one of the real strengths of the Red Gate system that you can see immediately how your backup routine is performing using the timeline GUI. As you can see from the picture here the first couple of databases backed up nicely but given that they are larger databases they are a bit snug so I might just ease them apart a little so we don't get a clash as they grow.

SQL bakcup - a can of worms!

2007-05-01T16:18:00.000Z

It seems that the SQL Backup market place is far busier and competitive than I had imagined, no sooner had I arrived in the office this morning than a nice person from Quest Software, makers of Lite Speed, finally caught up with me and set me right on the technology and the price. It seems they have a very interesting suite of SQL server products all of which make the standard Microsoft tools easier to use and in some cases adding functionality, the version I had seen yesterday happened to be the developer version at $45, a full version for our setup being £700 - a bit of a jump. In the end I spoke to 3 people there and came away with a whole heap of good advice and technical background to the product.

No sooner had I finished on the phone than I had a very pleasant representative from Red-Gate, makers of SQL Backup, on the phone wanting to discuss my recent blog post (Gulp!). Actually it turns out that instead of wanting to sue me for mentioning their software on my rather random blog he wanted to give me a full pitch for the product and was very happy to offer a cheeky discount, a good deal on support and some very good advice about which product was right for us. It also turns out that I was already out of date as version 5 had come out over night and I am just in the process of kicking that around. The benchmark looks about the same, maybe a slight improvement in performance, but it has a rather nifty new GUI which plots your backup activity on a time line graphic so you can visually see whether your backup schedules are in danger of overlapping and going into a shame spiral. (Cue - dip into Google images for shame spiral and discovering a picture which is also fitting for the genius which is the time line GUI).

My next step was to download a trial of HyperBac to evaluate their approach which shuns the extended stored procedures of the other products in favour of a totally stand alone setup for SQL backup. This in turn invited another phone conversation as I actually gave my real phone number when downloading :o) It seems the nice people who created HyperBac where originally involved with creating Lite Speed and they decided to create a new company with a new approach a while ago. Again their sales dude was a wealth of information about the strengths and weaknesses of the various approaches taken and was very helpful indeed. The cost for our setup was $499 irrespective of the number of processors we wanted to throw at it and as such it sits directly between the other 2 products. Having played with the system it performs well but I would say that both Xceleon and Quest will be interested to have a good squint at SQL Backup version 5 as they are both slightly quicker but overall I think Red-Gate have it.

I have set our demo rig up for hourly backups overnight so I will be interested to see what is waiting for me by the time I get in tomorrow morning! Hopefully a useful archive of backups which all restore perfectly.... we'll see :o)

Remote SQL backup onto SAMBA Shares

2007-04-30T15:51:00.000Z

Backup is a subject which comes up a lot on the rack as regular readers will already have noticed and I have already detailed several of the strategies we employ to make sure we have a myriad of copies of our essential data spread across the network, preferably as far apart as possible! Our latest investigation concerned how to get a usable copy of our most precious and bloatie database from our SQL Server 2000 installation across the VPN (and therefore Cheshire) on a regular basis.

Time for a topical and amusing dip into Google images for the word of the day - bloated, as in a very large database. This little marmot, who obviously has a small pie problem represents our database for this afternoon.

The data to be moved is 1.3 GB over a 2MB line from a Windows 2003 Server to a Linux partition on our CentOS virtual machine. Given all the other scheduled adminnie jobs we have going on overnight I cannot afford for the whole process to take more than about 30 minutes, I sometimes think the network is busier out of office hours!

The solution is of course to compress the backup before sending it and it turns out that after a little investigation there are a couple of products on the market which do this for you. After only a brief search I found SQL Backup by Red-Gate Software and Lite Speed for SQL Server by Quest which both offer on the fly compression and encryption to boot. One might have expected Microsoft to include a compression option in their rather expensive server system but one would be wrong as usual (thanks Bill). Bit less time writing the EULA and more on the software next time eh?

Moving swiftly on, the products mentioned above are relatively simple in their approach in that they add some system stored procedures to your SQL Server install which can be scheduled to run, adding compression and or encryption to a standard full or differential backup. The cost is quite manageable as well at $45 to $399, which is a lot less than the time would cost to build our own script! But incidentally if anyone is interested here is a start. Installing the programs on our test bench was easy and initially everything was very straight forward until we tried to send it to our Linux machine....

In order to share a folder on Linux one requires the cooperation of a service called SAMBA which is really quite powerful and therefore complicated, sharing a folder to any Tom Dick or Harry is very well documented and quite easy. Authenticating against our active directory and sharing with our windows machine requires the services of a good soothsayer however and is somewhat sparsely documented!

Having finally got a shared folder onto the windows network I thought the job was done but unfortunately I hadn't counted on a couple of less well documented features of SQL server.

1. SQL Server does not like backing up to network shares that are not in the same work group
2. SQL Server will not offer to re authenticate, the user account SQL Server logs in on must have explicit and full access to the network share.

I would love to give a blow by blow account of how I got the network share going but I have been chipping away at this problem sporadically and unfortunately I have sort of lost track of how I got where we are.

Having taken a while to sort this I have finally got some comparative data and I am very impressed indeed! Given that a 2MB line is really quite modest, SQL Backup managed to compress, encrypt and squeeze a 1.4 GB database down to 250 MB and ferry it across Cheshire in 20 minutes and 10 seconds! It took me a while longer to get Lite Speed up and running but at only $45 it ripped through the compression and transfer in a mere 10 minutes and shaved 30 MB of the storage requirements at 220 MB! Its my new best friend and I would recommend it to anyone looking to get their database backups as far away from them as possible. The only thing left to sort out is that I cannot afford to change the logon account for the main server as I did on the test machine so hopefully I can get SAMBA to cooperate with the existing setup this time :o)

Nagios - The Final Word

2007-04-18T15:51:00.000Z

Having posted about installing Nagios on CentOS I have finally had a few comments on BeerBytes (Hooray). I have also featured on 2 little news posts on other Linux sites as well click here for the latest and check out the blogroll right for a proper link. Given the obvious appetite for this subject (no not me - network monitoring) I suppose its only fair that I should continue dispensing nuggets of information given that its the only subject which has raised a flicker of interest.

Having got the basics set up I spent some time last week getting the network diagram straight, as we have quite a busy network with 60 nodes I wanted to monitor, the automatic function did not do it justice. Moving on from this I fell foul of having installed the incorrect plugin archive, for some reason check_ping worked fine but I wanted to start monitoring DNS, MySQL and HTTP on a couple of servers and these plugins would not run. In order to test your plugins you can simply move to the plugins directory and type ./pluginname, for example ./check_ping --help will tell you what command line parameters the ping plugin requires then try it again with these supplied. To continue the example ./check_ping -H www.yahoo.com -w 1000,10% -c 1000,10%
returns PING OK - Packet loss = 0%, RTA = 84.63 ms. The commands are already set up for the standard plugins in commands.cfg if your install was ok.

So to sort this problem out I ran off to try my old mate DAG's archive :o) I found the appropriate rpm and bingo, everything works well. If your are relativly new to Linux as I am and you are struggling to connect to the repository on yum or using rpm there is a quick and dirty work around. Simply find the link to the rpm in your web browser, copy the link, get back to your shell and type wget and paste the link, this will download it to your machine. Next type rpm -i and the name of the downloaded file and this will install everything, apologies if that was embarrisingly basic but yum can be a bit hit and miss for me.

The documentation for installing Nagios is quite good but the documentation for actually using some of the many and various standard plugins is really quite sketchy so look outside the Nagios.org site for this information. The Nagios plugins page on sourceforge is your starting point for this but its not obvious.

In order to start monitoring services a little editing of the services.cfg is required followed by creating a couple of new hostgroups for similar machines. For example I wanted to monitor Mysql on 2 machines so I declared the service in services.cfg as follows

define service{
use generic-service
name mysql-service
is_volatile 0
check_period 24x7
max_check_attempts 5
normal_check_interval 1
retry_check_interval 1
notification_interval 20
notification_period 24x7
notification_options n
check_command check-mysql-alive
service_description MYSQL
contact_groups nerds
hostgroup_name mysql_servers
}

This will check the hostgroup mysql_servers every minute, 24 hours a day and email the nerd group if there is a problem for 5 successive queries. It presumes a standard install which predefines the 24x7 time period and the check-mysql-alive command in the realvent files.

Now that I have these extra services being monitored there is some really quite useful informtion being generated, for example the number of connections connected to the MySQL servers and the response times for the HTTP servers. Another area which is being fine tuned via the timegroups.cfg file is when I want to be alerted about certain things, for example I quite like getting an email if a router goes down overnight but as some equipment is turned off overnight I dont particularly need to know. So in short just getting Nagios installed is the tip of the iceberg, the more you think about things the more instances where good network monitoring is useful become apparent. The good news is that this fine tuning is very quick and easy once you have the thing up and running.

One final point on Nagios before everyone gets bored is that on windows you can actually use active desktop to embed your live network map into your desktop making sure you never miss a trick :o) Simply go to desktop properties->customise and paste your Nagios address followed by /cgi-bin/statusmap.cgi?host=all into a new web address to embed into the desktop.

Some other things happening in our little team include a spontaneous upgrade to Adobe CS3, I haven't even got it installed yet so you will all have to wait for some views and opinion but one thing to remember is that you need bags of hard disk space, the download is about 1.5 GB and then it unpacks to nearer 2 GB then needs 5.6GB for the programs, so unless you want to be cleaning up after every stage you need about 10GB! Also the knowledge base is filling nicely and the more I use the product the more I like it, just one little point is that you have to keep going to different URL's to do different things, it does not check your security and give you all the options you are entitled to.

A two pronged approach to vesion control

2007-04-13T11:06:00.000Z

We had a little IT retreat earlier this week to discuss how we can more effectively work as a team, already this has spawned the knowledge base which we are diligently filling with guff, but another thing which became apparent is that we need tighter version control on the source code for the applications we are developing. The aim being to make it easier for several people to work on the applications together without constantly tripping over each other trying to edit the same files.

In a previous project myself and compadre Rob created a sports club management tool as a team and it very noticeably benefited from the contrasting styles and knowledge which was brought to bear on the task. We used subversion for source control on this project running on windows and although it was very useful it never quite delivered on all sides.

The reasons for this were mainly due to the focus of SVN being for text based source code and the merge principle of team work. For example, if two people work on the same text file simultaneously svn can very cleverly merge together the separate changes and 9 times out of 10 they will not conflict. Where the SVN system begins to come unstuck is when using non text based source files like Flash FLA files, as these use a proprietary format you cannot merge files if 2 people have simultaneously changed them, you immediately end up in conflict. So in this scenario you need to lock a file on the server when you are editing so that no one else can open it, the problem is that SVN is not very good at this, unless as can happen, I have missed something.

Given that our new systems are being developed in Flash with support from PHP files and a little MySQL thrown in I decided to look more closely at the version control on offer in Flash and Dreamweaver. It turns out that although the current system is very good at locking files using their 'Check In' 'Check Out' philosophy it is not quite so good at keeping an entire repository synchronised unless Dreamweaver is your weapon of choice. As each of us in the team prefer different HTML editors this will work very well for the Flash files but not for the project as a whole. According to the Adobe site the new version of CS3 has been greatly improved in this respect.

So the solution which seems to present itself here is in fact to use both systems in tandem with Flash taking care of its proprietary source files and subversion via tortoise in my case taking care of the text based files and having overall responsibility for the repository. Touch wood this seems to be working nicely but we have yet to get the whole team working on the project simultaneously.

If anyone else fancies having a go at this, installing subversion on a new virtual server is very straight forward and there are lots of good tutorials on the subject click here for the definitive guide for CentOS.

The Adobe site or the online help for Dreamweaver or Flash is the best place for information on how to use the current simple Macromedia version control.

And finally there is a short article here about fine tuning the setup when using both of these systems concurrently.

The IT Brain Dump

2007-04-11T11:24:00.000Z

One thing we have always struggled with in our little IT department is the sharing of important information. If I set up a new system I might note the details in a book or even on a shared document but we have never quite found a system which works for us all and as a result we cannot always put our hands on other peoples knowledge quickly and easily. Last week we decided to have another go at organising our information again and whilst wading through the available knowledge management tools came across a couple of gems.

One system which came top of the list on Google was an open source system called Twiki which I must say was my first choice for a while. They have some very big companies using the software and it looks like a very simple system, which in the tradition of wiki allows all users to contribute towards a knowledge base. I think my main gripe was that I wanted something which looked a bit more easily organised and more like an application than a simple website, although in Twiki's defence I did only look through the demo for a few minutes.

The product I found in the end was a very nice PHP application called PHPKB as in PHP Knowledge base. Although this would not be to every ones taste the fact that the application is available as a simple and very reasonable series of PHP pages suits our setup here perfectly. You have to have access to, or know how to setup, a web server and a MySQL database to serve this application but I did note that the company offer a free setup service and they do have a hosted option. We simply added a new virtual server to our main Virtual Host and had the system running in about an hour. The installation is quite simple and managing the system once its running is very straight forward, I have already started posting bits of information about systems and its surprising once you get started how many very important nuggets are stashed on emails and even in your head.

One of the other nice things about this particular system is that some categories of information can be public and some can be protected, so that in depth technical information can be cordoned off but some of the less technical information and tips can be made available to everyone in the organisation. As with all systems the usefulness is only going to become apparent when we have been using it for some time but I would say that with a little perseverance it has the potential to save an awful lot of time and stress.

On another point regular readers of 'AVFTR' will have noticed that someone actually commented on a post yesterday :o) In fact the nice gentleman concerned even Blogged about the Blog! I must add it to the Blogroll. I am now braced for a massive increase in traffic, I might call Blogspot to make sure they have capacity because in the last 4 hours of yesterday I had 30 visitors.

Nagios on Centos - a grudging union

2007-04-05T10:52:00.000Z

Centos is one of the great network operating systems, it was developed by a group of people who saw Red Hat Enterprise version 4 had become super reliable but slightly bloaty, they exercised their rights under the GNU public license got the source of RHEL4, put it on a stairmaster and gave it to the people.

Likewise Nagios is a great open source network monitoring system, if you are a Linux user and run a network chances are you will have come across Nagios, short of forking out about £1000 it is in fact pretty much your only option. About 12 months ago I installed Nagios on Fedora and it was a breeze, even though Nagios is a very comprehensive system requiring lots of fiddly configuration, on Fedora if you follow the instructions you will succeed in getting going in about an hour.

Unfortunately given that Centos and Fedora have a common ancestry and are very similar, trying to install Nagios on Centos will drive you up the wall. Unless I have done something stupid without realising it, installing the system from RHEL4 RPM's seems to scatter the files from one end of the disk to the other and it takes lots of patience to track them all down and link everything up. My advice would be follow the instructions to the letter but if you don't find the files you are looking for don't be surprised. Click here for the main Nagios site, this post is not a guide to installing Nagios on Centos just an amendment to the install guide based upon my rather frustrating experience.

Just in case I forget or anyone else trips over this, the locations are as follows:

Config CFG files - /etc/nagios
Web interface files - /usr/share/nagios
Log files - /var/log/
CGI files - /usr/lib/nagios/cgi

A guy called Dag (??) has done some Centos RPM's but I couldn't subscribe to his repository, if you can it is quite possible that he has reworked the install to follow the instructions. Couldn't resist doing my 'Google Images' thing for Dag, turns out this Swedish guy is also comfortable going my the name Dag. There are some great translations for Dag on wikipedia, in Swedish it means 'Day' and in Turkish it refers to a 'Mountain'.

So now the dust has settled after our mammoth network rewire last week and Nagios is running sweetly I feel quite satisfied with everything. As expected we have had a few static routes crawl out of the woodwork and we have renewed our efforts to use DNS rather that IP addresses for routing around the network. It turns out reversing the VPN connections was not all that it promised and we have moved them all back again, it also seems that having Nagios running is actually very good for the stability of the VPN as the frequent pinging seems to keep the routers awake and the tunnels in good repair.

One job left to complete is to define a custom status map for Nagios, as we have over a hundred nodes on the network being monitored the auto generated map is a bit of a mess so I have to define the map by hand which is a bit of a pain. That said it will look very nice as we have purchased an icon library for our software development and their networking set is very sweet. See left for a sneak peek, note however that our main managed switches are not down it is just that Netgear have issued a firmware upgrade they are short of. One day I would love to do a more comprehensive Flash front-end to Nagios but frankly right now I have better things to do.

Another job I think would pay dividends would be to set up a secondary DNS server at Manchester, it is probably quite straight forward but I think I will let the dust settle before attempting this one.

Some Excellent Manipulation

2007-04-04T12:11:00.000Z

An interesting little job came up yesterday which involved formatting data on an excel spreadsheet, we have some lists which have to look pretty but are edited frequently and we were having to spend a lot of time ensuring that these lists had a reliable and consistent format. Lots of ideas spring to mind for a job like this and the temptation is to go for yet another little database application but in this case it really felt like it would be overkill.

The solution which appears to have legs is to create a rather niffty excel parser using a couple of useful PHP add ons. For those of you who don't know what a parser is the definition on wikipedia is "the process of analyzing a sequence of tokens to determine its grammatical structure", in lay mans terms think of it a s a digester of documents. You push one in one end and it reads it, digests it and magically supplies a result, or in this case a completely reformatted spreadsheet. This will allow us to keep our data in a very simple unformatted spreadsheet, but by running them through our new system, we can have a nicely formatted consistent look ready to print in a click. Its all summed up nicely by another of my random dips into Google images, this time for the word "parse" see image right.

So if anyone ever has a need of such a beast or, more likely, if in 6 months time I have forgotten what I did and need a reference, the 2 places to go are PEAR for the excel spreadsheet writer add on and Source forge for the Excel Reader add on. When these are installed and working individually there is no reason why they cannot be used in the same PHP script in a push-me pull-you sort of fashion. It only took a couple of hours to get a basic system running and you can even allow the user to specify some parameters with their spreadsheet. So for example you pass a raw sheet of data, a title, a font and a relative font size and the parser running through the writer will apply sizing's and fonts in defined ways to different columns of data, it will even specify margins and printing areas so the document is completely ready to roll.

Keep tuning in for the definitive guide to installing Nagios on Centos without 'going postal' later this week.

Completing the VPN

2007-03-27T19:11:00.000Z

For the past couple of years our VPN has been somewhat of a work in progress, although it has been providing a useful service it has never been quite finished, one of those 95% projects. Well I am sure you will all be excited to learn that tomorrow it looks like we will finally be able to stand back and say that the network is one project that is 100% complete in every way (for now).

All sites and key personnel are connected, our co location facility is connected, we have finally finished putting all the head office connections onto the Draytek 3300V and we have the RADIUS server running for mobile workers. Added to this we have upgraded the head office switches to managed Gigabit switches and tomorrow we should be activating the load balancing system so that if our leased line goes off the ADSL line will try to pick up the pieces and vice versa.

One of the major improvements has been the recently discovered need to reverse all the connections so that now both the co location router and the head office router are in charge of the connections to the remote locations. Quite why this never occured to anyone before will remain a mystery but hey ho :o) Of course the big question was which way should the connection be configured to connect between Manchester and Head office now we have 2 very clever VPN brains at each end, well the odd coincidence is that you can set then up to dial each other! It is not immediately obvious whether this will cause them to get in a knot at some point but we can always toss a coin and switch off one link if it does.

The main visible improvement has been the state of our comms cabinet or spaghetti junction as it was known, when we have disposed of our old ADSL router and installed the super VPN pass through modem we should finally have a perfectly organised rack of kit with no dangly encoutrements for once. I will take a piccie tomorrow to illustrate but unfortunately I don't have a before picture to give the true contrast.

I watched an interesting webinar last week about steelhead WAN link optimisers from riverbed which can allow network applications to be run from the datacentre so maybe this could be the way forward for the network, phase 2 if you will. Just need to find a couple on ebay running at a bit of a discount as they are a bit expensive. Maybe terminal services will be a better bet but if anyone wants to bin a couple of steelheads do call :o)

Extracting the 2950 from the dog house

2007-03-20T17:22:00.000Z

Our upgrade to the Manchester server looked like being a bit of a damp squib this morning, after a good start with our new 2950 Draytek firewall router dropping straight in as a replacement for the 2900 things were not turning out to be as reliable as I had hoped. Twice the previous day the link from my house to Manchester had locked up and then Nigel had a similar problem when his tunnel locked up, the outlook did not look good.

However after having a pootle around on the Draytek forums and not really coming up with a lot I had a moment of inspiration, the problem is that if one of the pub routers drops its connection its too stupid to realise and doesn't try to dial back into the main host every time. So the solution is surely to remove the responsibility for dialling from the slightly less clever routers and put the main super efficient router in control. In a nutshell get Manchester to dial the pubs instead of the other way round, this way Manchester should know that a connection is dropped (using the power of its dedicated VPN processor) and simply dial it up again. One other thing to be aware of if anyone is trying this is that the default timeout on Draytek 2600's is a lowly 300 seconds and should be reduced to zero :o(

So after reprogramming all of our routers and having a major rejig of the Manchester end of things it all looks a lot happier, of course its not as simple as checking they are all connected and I won't really know until a few days have passed. Tomorrow I will rejig our Nagios server to test these connections and I should start getting an idea of how good this configuration is going to be quite soon. As an aside when searching for 'Damp Squib' on Google images this is what comes up, call me a fool but that dead cow don't look too damp to me :o)

Instant gratification

2007-03-15T16:41:00.000Z

No sooner had I posted about my declining traffic due to lack of blog fodder than I get 30 visitors in the same day, I am wondering whether this means that people have subscribed using RSS readers and therefore I can generate as much traffic as I want simply by bombarding you all with posts!

Our 2950 arrived last week and was immediately dispatched to Manchester where it has now been installed, its early days yet to get an idea of whether it is going to provider a better and more reliable service but so far so good. Although the 2950 is quite different to the 2900 it is replacing, and as such you cannot simply export the configuration and move it across, the setup screens are pretty similar so it was easy to copy the configuration page by page. We have about 20 VPN tunnels hard coded into the config and one thing which would be great in a further revision of Drayteks new operating system would be to duplicate an entry in the profiles page because it can be a bit of a drag, just in case anyone from Draytek ever trip over this.

One other little happening which I found very interesting is that Google have created a little program for Pocket PC's which runs Google maps. I must say that my HTC PDA is becoming more and more useful now that I can get my email, it is a phone, it syncs with my Gcal over the air thanks to goosync and now Google maps as well! I feel quite spoilt.

With all this in mind I found it very interesting to note that HTC have got a new version of my favourite toy coming out. I would guess that they are watching the IPhone with some trepidation because although apple will have a lot of work to do to create something as functional as the STC S710 I think we can all be confident that OSX on the IPhone will be slicker than Windows Mobile 6. So like the technology lemming that I am when the contracts on the phones are up for renewal I shall be torn between these two new and probably slightly flaky but 'oh so cool' toys and once again spend the duration of the contract getting it just right in time for the next one.

Google Apps cntd.

2007-03-13T16:38:00.000Z

I have been progressing with lots of odds and ends this week and last which has meant no blogging, you can't force it after all. Unfortunately this means my traffic has nosedived so its a good job I am not dependant upon the income from my blog like Rob is ;o) (see previous post)

Which illustrates a point I wanted to make - should anyone read this and think 'Hey that looks like a cool thing to do that blogging lark' the only advice I would give is to get a Google analytics account because otherwise is pretty dull. As you can see I have visitors from all over the world when I can actually work up a little blog fodder but otherwise I have had no feedback at all, so praise Google for keeping beerbytes online!

So I am sure you have all been waiting with baited breath for an update on the Google calendar situation, well we have had some movement - spanning sync is out of beta and ready for deployment. Hooray! I really must congratulate spanning sync for producing just about the only calendar syncing software which works, I have been running it now for about 4 weeks and whilst syncmycal was merrily trashingmycal, spanningsync has just worked which is all we ask.

Another piece of software which also seems to be working is a little system called goosync which is syncing my Google calendar over-the-air with my HTC Pocket PC. This means now that the Mac side of things is perfect, Ical Syncs my calendar both ways with Google, my PDA does likewise and Ical also displays the rest of the offices calendars via .ics addresses.

This last point brings me onto a bit of a gripe with Google Apps. On paper Google apps is great but I have steadily been whittling away at the features which are actually useful to an organisation like ours. 2 weeks ago I closed the premier account because it was not bringing anything to the table over and above a standard Google apps for domains account and this afternoon I have had to walk away from even this because the calendaring system on these accounts does not allow private Ical feeds! Big mistake - I have had to spend some time this afternoon manually setting up standard Google accounts because syncmycal on the PC is not very happy with the Google apps calendaring feeds which seem to be slightly different from standard Google feeds and Outlook 2007 cannot plug into the Ical feeds on Google Apps.

So I am short of only 2 things now, Goosync is struggling to work on our Nokia 6233's but I am sure we can sort this and I need to get Outlook publishing to Google which syncmycal can allegedly do as long as your not on Apps.

Other news, Joost is still very cool but the content has been suspiciously stagnant since I first went on possibly indicating an Achilles heel, is it difficult to get the established networks to part with their premium content? And/or is it difficult to circulate new content around the Joost network? Maybe they need to take at look at the youtube way of doing things and get the public to contribute, I am not talking about the 240x180 endless rips of Simpson's funnies but seriously good quality video from Jo public. something along the line of a bit torrent network where people can submit content recorded on proper video cameras to make good quality but amateur videos which will play full screen. These could be vetted and categorised by Joost thereby avoiding the lawyers making a fat buck or two and allowing a huge variety of content to be available.

I've seen the future - and it's Joost

2007-03-02T20:45:00.000Z

I am going off topic, as in this has nothing to do with IT and business, but for anyone else who thinks that TV in the UK is a bit poor at present I have just seen the future and its truly exciting and scary in equal measure......

A perfect Friday night, I got a pass from the missus for an hour at the local, they were in the middle of a barrel of Jennings Mountain Man which is nectar, and I get home to find out that I have been admitted to a rather exclusive club. I am a Joost beta tester!

Now for those of you who don't know (I can hardly remember quite how I ended up signing up for Joost myself) but Joost is a new online TV station. Online TV is one of those technologies which has promised so much in the past but never lived up to the hype, I am sure we have all tried some of those poor real player feeds in the past and frankly if you have real network shares take my advice and sell sell sell! Joost is a quick download, I was genuinely very pleased to find a Mac version for a change, so I installed it on the ol' mac book, logged in and just watched half an episode of fifth gear full screen with no buffering. Seriously.

Vicky Butler-Henderson never looked so good, although I suppose she never sat on my knee whilst presenting fifth gear before :o) I am such a nerd sometimes...

The choice of programming even in beta is far superior to HDTV even f the quality isn't, its full screen though, its on demand, they have programmes from national geographic, channel 5, MTV, I even heard tell of a Viacom deal yesterday and you can tell that the choice is going to be truly staggering on an international scale. I cannot emphasise this enough, sign up now because in 6 months time your digi box is going to look pretty dull, and that is the scary part. I dislike TV, I like gardening, I am a frustrated smallholder (in that I haven't got one) and I think people should be tilling the soil rather than vegging on the sofa and I quite like having an excuse to turn off the TV when nothing is on. In a Joost world there is always going to be something on you would like to watch, maybe land will become cheaper because all the smallholders will be watching Joost and then I can make my move.... sweet.

Delving further into Google Apps

2007-03-01T19:53:00.000Z

Last week I set up a Google apps account to investigate the potential for using it as a replacement for Microsoft Exchange, given that we only really rely on Exchange to share calendars. Today I finally got chance to properly look into the fixtures and fittings of Google apps and I must say that my initial impression is very positive.

Although I had used Google Calendars before, and found the user experience to be a very positive one, especially for a browser based application, I had not really investigated the other aspects of the apps suite and that was the aim of this afternoon. Google apps is actually a very simple system and that is one of the things that appeals to me about it, the manual for exchange is about a foot thick and I would say that its a typical case of Microsoft over engineering. It is quite unfair in some ways to compare these 2 products because Exchange does lots of things that apps does not, however as a small office I would say Google is closer to fulfilling our requirement for information sharing.

So to the details, there are only 3 elements of apps which really interest me at present and these are in order of importance, calendars, email and finally the personalised start page. Of course each of these elements have been available on an individual basis for sometime but the new apps for domains approach allows one person to administer these systems for an entire office. The first thing you have to do is provide the domain, it would have been possible to sign over our existing brunningandprice domain and then link back to the website and use Gmail as our primary email system but I am not quite ready to take a jump like that so I got a new one for a mighty £2 pa :o)

One of the really nice features becomes apparent at this point, if you want to create user accounts for 20 odd people you can simply fill in an excel spreadsheet and Google will quite happily auto generate your user accounts. Easy. You can even set a global setting to ask all your new users to change their password when they first log on and preset their sharing options to allow everyone access to each other calendars. At this point if we were happy to use online systems the job is done, everyone has an account, email, calendar and even instant messaging.

The next thing I wanted to look at was the personalised start page, everyone in our office almost without exception uses Google as their start page anyway so to have the opportunity to add their calendar and email to this was quite appealing. It turns out that this system is again very simple to use and I simply popped our logo on the top of the page and dropped in each users calendar, email preview, to-do list and even a link our internal applications. I think we will get compadre Rob to use a bit of his design magic on this page if the idea takes off.

So far so good, the task for tomorrow is to make a decision about how best to approach using the email, should we simply have one pop3 account or route the existing mail via Gmail, my initial reaction is no however Gmail is a rather nifty web mail system compared to our existing service... tempting. Also its time to start throwing some larger calendars up and seeing what happens to performance, I'll keep you posted.

A really slick backup idea!

2007-02-28T17:02:00.000Z

And it wasn't even mine.....

Its another not very exciting post about backup, I know its not the most fun subject even for fellow nerds but its a fact that backup is very important (see the last but 1 post). One issue we have as a company with distributed sites and therefore computers is trying to make sure we get copies of the data from harassed managers. Its no use giving them a cake of Cd's and a printout which requires them to do complicated computing tasks, it simply doesn't work, so you have to think of something really slick and this is what our main mac man Nigel has done.

At the same time that I was playing with rsync to backup my Manchester installation over the VPN Nigel was using the same program, which comes as standard on the Mac, to do some simple backup tasks on his computer. Having both recently installed a nice RSS reader called Vienna we have access to a useful little blog called Mac OSX Hints which pretty much does what it says on the tin. One hint which Nigel picked up on was a rather nifty little application called "Do Something When" which very simply runs a script when a USB Flash drive is plugged into a Mac. Using the power of his brain Nigel that put these 2 ideas together resulting in "A really slick backup idea", luckily Nigel doesn't blog so I get to write all about it and reflect in the glory of the idea without doing a thing - sweet :o)

So after a small amount of programming, setting up you Flash drive and rsync script, every time you plug the Flash drive into the Mac it automatically does an incremental backup of your predefined files! This will allow us to present our managers with a backup solution which is so slick they can't fail to use it.....

The rest of this week has been programming for me, a mix of finishing our new job applicant database and moving our exisitng data into the new database, from Microsoft SQL server to MySQL which has been a bit painful. A thing to watch out for if you are trying to use DTS to move data between these databases is that text data will not copy across using an ODBC connection and I couldn't tell you why. Varchar data will move and I have checked its not a collation issue, it just won't go, answers on a postcard please. The solution I used in the end was moving data to excel spreadsheets and then pushing the data into MySQL from there, not very elegant really.

Improving the 'Manchester connection'

2007-02-26T21:36:00.000Z

Sounds a bit like a Tom Clancy novel doesn't it - "The Manchester Connection" - in reality of course it's nothing very classy (if Tom Clancy novels can be described as classy) it is a slot in a rack in Manchester which is currently occupied by one of our little VPN firewalls.

When we first embarked upon extending the VPN to Manchester it was a bit of an experiment and as such we didn't necessarily want to go mad buying expensive hardware for the first phase. However now that we have approaching 20 connections to this part of the network and are beginning to use the applications and data store there more and more, we are in need of a bit more horse power.

One thing we have noticed is that when the total number of connections on our current Draytek 2900 exceeds the recommended 16, although it will quite happily chug along for days without a problem every now and again if a connection is dropped it can fail to automatically pick up again. The only solution is to manually drop the connection and then everyone is happy again. Of course when you are relying on this connection to serve up applications it is not acceptable to have this occasional glitch and the resulting lockout so its time for an upgrade. What we were intending to use was a Draytek 330V as these units have capacity for 200 simultaneous connections and a dedicated VPN processor and was the choice for our main VPN hub, however it turns out that Draytek have a new toy out - the 2950 Note especially the cutting edge case design which is such a hall mark of any Drayteck product, the designers obviously frightened themselves with the racy blue case of the 330V and retreated to their comfort zones with the latest offering! Its a good job they work so well.

Click here for a full spec and here for a link to their control panel demonstration. We have been given a delivery date for Friday so if its on time I should be able to relate the tale of the setup on the Friday afternoon post :o)

Other news is that on the Google calendaring and sync front so far the Mac system - spanning sync - seems to be fine. However the PC solution syncmycal is having some minor emotional problems, so far the most impressive thing is the prompt service from their technical support department. Nuff said.

Mounting a network drive and dabbling in cron jobs

2007-02-23T22:56:00.000Z

Now before you all think I have gone crazy and started a sideline in email scams I must explain some background before things will become clear.

Our new all singing and dancing application we are building in Manchester is starting to become useful and inevitably when something becomes useful people start actually using it to do important work. Also when people start using software they trust their friendly IT manager to look after all their useful information in a responsible manner so that if anything bad happened their precious information will be preserved. Imagine if you will a collection of harvest mice with a big stash of blackberries, if the stash of berries is squished the IT manager has an opportunity to become a hero by unsquishing them or alternatively slightly fired :o)

(The operations Director was very angry when she found out all the data was lost)

So the solution for guarding our 'blackberries' is to duplicate them and put them in several places at the same time, we have a clever piece of software in head office which does this - when it can be bothered (thank you to the creators of retrospect). However our new system is being created on a Linux server and as such has no access to our main backup software so we have had to create our own. Its pretty simple really, every night copy our 'pile of blackberries' from this place to this other place, as I have bored you already with the story of replicating our database we are simply concerned here with files. The thing is that there would be no point in copying our files from one part of the Linux server to another so it needs to be sent to head office, this means going from Linux to windows and this is where the fun is.

And so to a brief instruction on mounting a windows network share:
1. Stretch - its important.
2. Create a new windows account on your domain.
3. Create a folder on your windows server and allow access to it for your new user
4. Try connecting to it using the following command:

mount.cifs //servername.domain/share /mnt/ -o user=user,password=password,domain=domain

Don't try smb, mount, mount.smb or any of that because it doesn't work, I have no idea why - its probably very simple but 2 hours of banging my head against it could not get it going!

If the preceding command works edit your /etc/fstab file and simply copy and paste the command into it. That way every time you restart your Linux machine it will automatically make your windows share available to you in /mnt/ magic!

So next to the cron job:
For those of you who do not know, cron is a simple program which runs another program at a certain time on a certain day so you don't have to remember to. A cron job is a preconfigured task which cron will perform at a specified time and date, told you I could explain.

In our scenario we have a very simple command to be run cp -r "/home/store" "/mnt/" so the first step is to simply run it at the command line and see if it works. If it does you copy and paste the line into the /etc/crontab file with a preceding '0 1 * * *' which it turns out translates 'to please run this every night at 1am' simple really.

I hope you find this ramble as useful as I would have done if I had found it 2 hours ago :o)

The Ultimate Calendaring System?

2007-02-23T12:19:00.000Z

First job this morning was to spec out and test the idea outlined yesterday and I have even made a pretty picture, I might print it out and put it on the fridge at home :o)

I have had Spanning Sync on the Mac for a couple of weeks now and it seems fine, ditto for sync mycal on the PC and at £12 per license its very reasonable but they have been linked into separate calendars. This morning I have linked up all of these systems via my Google calendar and so far they have not started fighting. I think the key must be to accept that the Google calendar has to wear the trousers and although its 2 way sync set both of the client tools to defer to Google if there is a dispute. The next step in testing this system will be to actually set up one of the new Google domain accounts, I will keep you in the loop :o)

BTW in writing this blog I thought I might put in a little picture to illustrate the fact that this Calendaring strategy might be 'all things to all men', when I searched for this phrase another quirky burp of Google images threw up a picture of a squaddie with an enormous gun(see right). Not quite what I had in mind but he definitely does seem to have the equivalent of my Calendaring strategy tucked in his sweaty pit doesn't he :o)

Groupware Eaton Mess?

2007-02-22T20:11:00.000Z

For those of you who don't know it Eaton mess is a kind of pudding, I know this because even though I am a techie I work for a pub company and you pick up nuggets like that. Eaton mess is not just any kind of pudding though, its the Rio carnival of puddings, the fact is it shouldn't really work, its just a pile of stuff that just happens to be delicious.

I was reading the write ups this morning about Google's paid for 'sort of office' suite and was quite impressed but it has taken me all day to actually digest the possible opportunity which this service might be offering. I had been looking before at using just the calendar aspect but the App suite brings a few more things to the table for a quite reasonable £25 per year. As a suite of tools the offering is quite basic but there is nothing wrong with that, and the simple fact that you have to be online to do anything is quite limiting. For 360 days of the year it would not be a problem but I can just imaging the other 5 could be very frustrating indeed. That said there are 3 aspects of the suite I really like, namely the Calendars, Gmail and the Personalised Home Page the question is how to make best use of them and this is where it turns suddenly into Eaton Mess. So could a useful Groupware system be shackled together using Google Apps and some supporting software to create a masterpiece or just a big pile of stuff that doesn't quite gel.

Our problem as described before is the requirement to support Mac's and PCs and a variety of software applications with 2 way synchronisation for all applications. Or to put it another way is it feasible to replace Exchange with Google?

The requirement:
Shared Calendars, Personal Contacts, Web Mail, POP Mail and Mobile Access

Platforms:
Outlook 2007, Entourage, Ical, Apple Mail, Pocket Windows 5, Apple Address Book

I have alluded before to a couple of pieces of sync software that look promising, syncmycal and spanningsync, these are both coming along and although I am nervous about 3rd party plugins getting in the mix if, just if, they did get finished and worked well they could make all the difference. I will put together a diagram to illustrate but I would say that off the top of my head all that is missing is a way of syncing contacts with Gmail.

One thing which would be great about this whole house of cards would be that looking forward we could actually think about binning outlook and any other email/calendar clients thereby making life very simple. I love the idea of opening a web browser and having my mail and calendar immediately available to me, it was in fact a part of the initial idea for our central management system but it didn't seem worth while reinventing the wheel so to speak.

Why I like SQL and a matter of AS Dysfunction

2007-02-19T22:24:00.000Z

One of the little projects I an engaged in at the moment is quite a nice little program to store facts, its the latest chapter in the drive to put information traditionally stored in a managers spreadsheet horde onto a central system which anybody can access.

The program is very simple, a set of pubs and a set of facts but one aspect which was quite intriguing was how to efficiently add an address for an entry without ending up with a huge database of contact details which would require constant maintenance, we have enough of those already! In due course a solution presented itself, why not simply use one of those other databases and what better than the accounts system because frankly businesses like to get paid and if there is one set of contact details which they make sure to get updated if anything changes its accounts. And this is why I like SQL, the new 'fact' system is in MySQL the accounts system in Microsoft SQL but thanks to the gift of SQL and PHP all of this information can be glued together in a really elegant little system.

The next step with this program is to then load this contact information into a VCard, we may be writing lots of our own software but you have to have an eye on standards and for contact information the VCard is it. Thankfully a nice group of people have written a PHP addon for creating VCards via the PEAR system and if you know what I am talking about and fancy a laugh pop into the documentation section for the VCard PEAR module :o) I'll tell you how I get on with this part tomorrow.

One other little note for today was a confusing feature of the asfunction in Flash, if you are ever programming in Flash and cannot get a function to work using asfunction check the target level, it does not reference the root level but whichever level the text area is in which is calling it. Bet you'll all sleep better now :o)

The rack is open and Rob earns 2 cents

2007-02-16T21:28:00.000Z

When I first started musing upon life and aspects of IT on my little blog it was really a test, sorry to break the news but there you are. The theory was that the blog would be a valuable way of getting interesting and topical content onto our company website, explaining to anyone who cared what we do in the IT department and dispensing some useful nuggets of information to anyone having trouble with things we find solutions to. Its what makes the web so interesting, whatever mess you have got into you can almost guarantee someone has been there before and was good enough to write about it so other people could dig themselves out of the mire slightly quicker.

The question we had to answer was, is it possible to blog on a regular basis, say something interesting and informative and would it be worth linking into the site. So here we are 2 months later, still posting, still enjoying it and very pleased with the amount of traffic on my blog, at present only about 20 a day but its encouraging to know people are finding it and we have decided to link it onto my profile on the company website :o)

Having extolled the virtues of regular blogging as a tonic for the soul our revered communications director has decided to join in and I would like to link you at this point to his blog - a view from the bin. As our wine aficionado this of course relates to his tales from the wine bin in the same way that mine relates to the server rack, as opposed to the instrument of medieval torture... although...

And moving onto our other company blog the big news from compadre Rob is that he has sold out and plugged Google AdSense into his site, obviously a worth exercise as in the first week it has earned him a truly mighty 2 cents, or 1p after tax.

This of course now leaves Rob in a terrible quandary as he will
have to choose between a black jack or a fruit salad.

Shared calendars - how hard can it be?

2007-02-15T20:20:00.000Z

Not been very much of note going on this week, mostly moving some of my little applications over to our Mancunian installation. I have now moved over our R&R invoicing system, the SMS system and our Pub facts, these are all little Flash applications now running on AMF and served up over the VPN.

One big movement this afternoon has been with our company calendars, for the last few days we have been evaluating Outlook 2007 to see where its new Ical support is worth us spending the money for an upgrade on our Head Office PC's. Compadre Rob has been less than impressed - click here for his frank evaluation. Officially we have a support contract but according to Microsoft our Small Business Server license does not entitle us to an outlook upgrade until exchange 2007 is out which conveniently might be after the contract runs out. If anyone ever offers you a Microsoft support contract tell them to pound it, if they brought the software out on time it would be fine but they don't and its more trouble than its worth.

Enough of that or I'll get all angry.

So we have been using exchange for about 18 months now and it is less than impressive when you have a mixed network as support on the Mac's is poor so we are desperately trying to extract ourselves. Moving the email back to POP3 is easy but we still need to be able to share calendars. One thing we have been looking at quite seriously is using Google calendars but in order to have your calendar offline you need 3rd party software in the shape of Spanning Sync on the Mac or Syncmycal on the PC, both of which seem to work but we have tried so many other pieces of calendar syncing software in the past that I would be very nervous of recommending it.

So given the new Ical support in Outlook we are looking at the simple option of Webdav and Ical/Outlook. I have dusted off my old Pentium 3 based server called Chubba and given it an install of fedora core 5, setting up webdav on Apache is easy thanks to this rather niffty tutorial. The only thing we need to sort out now is whether Ical can cope with 12 calendars, it used to cope with about 10 but ironically it was an upgrade to Tiger which caused major problems. Seeing as all our Mac's are now core 2 I have high hopes that they will have sufficient cojones to keep everything synced up. If they struggle it will have to be Google calendars and plug in hell! No offence Bill but exchange is going and that's that.

Still loving the Mac by the way, must have quicksilver, Neo office and synegy if you have another machine though - again I will point you to the bug for a good post on stuff you need on your Mac.

Return of the MAC

2007-02-12T20:29:00.000Z

Just so that my newly expanded international audience doesn't get too worried that I might inflict some off key UK R&B schmoltz on them the MAC I am referring to is not Mark Morrison but in fact a shiny new MAC Book. Although in fact its not shiny because its a rather nifty Matt black, it's just new.

Gotta love Google Images - turns out this guy is called Mark Morrison too :o)

(Can I just reiterate this is not a picture of me - he's called Mark Morrison and I don't know him, its funny and if you don't know why Google Mark Morrison the singer)

Firstly I must say hello to the international audience I have alluded to, thanks to links from my com padre Rob at bugeyedchron, and his rather popular brother Thom, this humble little blog has now been visited by people in all kinds of places including Australia, Singapore, Mexico, Norway and China. I hope you have been informed/entertained and please be assured each new blob on my Google analytics Geo Map makes me very happy :o)

So to the Mac...
Normally I am a Windows person it must be said, I don't like Microsoft particularly but I am a developer, I write programs and web apps, mostly cross platform actually, but I like an easy life, I like a choice of development tools and I like things I can tinker with. I suppose you could say I like PC's but that does not mean Windows. In fact I would love to use Linux more often but it just not quite there yet on the desktop.

I have had a hankering for a Core 2 Duo machine for some time as my Dell laptop is getting a bit long in the tooth but I have a feeling that a Vista based laptop could be a bit lacking in the trouser department as XP does not run that quickly and newer laptops do not have that much more horse power. I almost went for a desktop but the opportunity to swap out my Ibook presented itself and I have been really very impressed by the new Mac books so I thought - "twist my arm I'll have one". I have only had it a day but it has definitely impressed far more than the original Ibook did, here are a few Plus points:

Seems nice and quick, a good step up from what was already a quick machine
Much better value for money, Ibook was expensive compared to the PC competition, this seems good value
love the inbuilt Isight, great quality, very convenient for Skype
Screen is the best I have seen on a laptop
Still like the CD drive, its a great piece of design
The new magnetic power connector is brilliant, probably the most vulnerable part of a laptop is instantly rendered much more robust,
Lovely tactile keyboard.

What more could you ask for in a laptop? Frankly not much, I suppose you would think me ungrateful if I said outlook and a maximise button :o) , throw in Half life and I would never go back!

Seriously though, within 2 hours I had FireFox, Thunder bird, Open Office and Skype on it and I began to feel quite at home, its almost unfortunate that my Flash Pro license is PC only because I would move my license if I had the option.

The only dark cloud in my otherwise seamless experience was that MySQL Maestro does not have a Mac version so I am having to use Cocoa, its OK but just the sort of compromise which gets on my nerves. I am keeping an eye on Parallels and crossover just in case they solve this annoying aspect of running a mac.

Will keep you posted.

Hunting and killing orphaned processes

2007-02-08T12:32:00.000Z

I shall await the comments from emotional teenagers with interest, I have just spent the last 30 minutes wondering why I could not restore a SQL server database which had had some problems. It turned out the culprit was pesky orphaned processes, so in true Elma Fudd style I went hunting them and brutally slaughtered any I found. (If it wasn't for the fact that Warner Bros would probably sue my arse off I would have put a jaunty picture of Elma in at this point but you will just have to imagine over to the right there is Elma complete with deer stalker and double barrelled shotgun)

So you want to do something on SQL and its telling you you cannot because the database is in use, first ring round the office and make doubly sure no-one is on it. Next use query profiler to examine current connections but don't expect to see every process in the list, it will allow you to see active connections though and you might find someone on there who didn't realise it :o)

Take a deep breath and open query analyser, the command to see a complete list of processes is sp_who so type

exec sp_who

Then if you can see your pesky orphaned connection you use its spid to kill it, so type:

kill spid
exec sp_who

and they will magically dissappear from the list :o)

Everyone is happy and you can get on with the day, maybe after a congratulatory cuppa and biscuit.

MySQL Stored Proceedures - You just need a maestro

2007-02-04T22:31:00.000Z

And I am not talking about an 80's talking car, seriously Austin (went bust surprise surprise), night riders car might have talked to him but that didn't make it right.

No the Maestro I am talking about is the rather nifty new MySQL administration tool which makes creating stored procedures so much easier. There has been a lot of discussion on the web about whether MySQL has what it takes to run enterprise level databases for real world companies and despite the fact that there are lots of examples of huge companies using it I feel that the feeling of nervousness stems from the fact that although the database is rock solid the management apps are definitely not. Lots of good progress has been made of late particularly by the people at MySQL but most of their GUI apps are recently out of alpha and I do not like the fragmented approach they have adopted, ie. mange your permissions and backup with this app, analyse your queries with this one and extract data with this one. I end up having 4 applications open to do a days work. Well not any more, sqlmaestro.com is the place to get the only MySQL management tool you will ever need, and all for only $149!

Cheesy plug over - the reason I came across this software was because I wanted to use the new MySQL stored procedures and to see how they compare to Microsoft's offering, which I have been recently introduced to as you know (because you read this every day don't you). I turns out that Stored procedures have only recently been introduced into MySQL in version 5.1 and documentation and examples of their use are a little sparse at present. This particular piece of software however has its own really good stored procedure manager which is why i downloaded it and found the rest of the tools it offers as a very nice surprise.

I will go into how to actually write a stored procedure tomorrow, when I actually write a useful one, but to anyone who is just looking around to see how they can get into this there are a couple of things you have to do first it turns out. Unless you have just installed the latest build of Fedora or some other main stream Linux build you will have to upgrade both PHP and MySQL (assuming you want to use PHP of course). Stored procedures are supported in MySQL 5.1 but you cannot actually get at your stored procedures from PHP without the mysqli addon. As we use Centos as our weapon of choice on the Linux servers this means having a whole scale muck out. It turns out the safest way to upgrade either of these programs is to backup - remove - and reinstall which frankly appeals not at all (he he). I have tried it locally here but tomorrow I will be reorganising these programs, when its all over I will write some proper stored procedures and tell you all about it :o)

l8r
k

Freeing the beast - foreign keys and other nerdy guff

2007-02-02T20:42:00.000Z

Been on a course - brushing up on my SQL with the rest of the department and finding out some very interesting little tit bits which will speed things up at head office no end. I had always considered for example that stored procedures were really an organisational tool designed to reduce duplication of queries on the client side. Interestingly it turns out that they carry a good improvement in performance because the query is essentially precompiled and all the execution planning and checking is already done. Could make for a busy Monday :o)

Having got home I decided to look at some of the details of the MySQL databases which are less well used than the Microsoft SQL databases, and definitely less critical, but still in need of efficient design. While reorganising things a little I found out a couple of slightly less well documented issues with creating foreign keys on a MySQL database which is already in use and therefore carrying a little baggage shall we say.

A couple of things seem to cause problems and errors 105 and 121 seem to crop up a lot
1. ensure that columns to be associated are of exactly the same type, for example a column of type INT will not be forced into a liaison with a column of type INT(10) unsigned.
2. Ensure that all columns will match exactly, for example if one column has a NULL entry it is not going to conform to the relationship and it will ruin your evening.

That's just a couple of things, I'll keep jotting about whatever else drops out of the woodwork. Next week I will post the first installment of the main event - taking our main MS SQL databases to demon tweaks - exciting stuff :o)

So you edited the slave.......

2007-01-31T20:12:00.000Z

When syncronising 2 databases via replication one thing you do not want to do is touch the slave in any way. The system is clever you see, it knows where its up to and really doesn't expect a helping hand. Unfortunatly this afternoon I went to edit my little utility meter reading database, a very simple and efficient little system, I just needed to add a column but I chose the slave by mistake. In the immortal words of homer simpson - Doh.

At this point everything falls apart, the slave process has a fit because it is trying to add a column which is already there and stops taking orders from the master. So at this point if you are also a bit of a dunce with 2 similarly named databases you need to follow these instructions to get your little donkeys back on the straight and narrow.

1. Stop your slave with 'slave stop'
2. Back up your master
3. Restore it onto your slave
4. On the master run the 'show master staus command' to get your log file and position
5. On the slave run the following rather longer command.

mysql> CHANGE MASTER TO
   ->     MASTER_HOST='master_host_name',
   ->     MASTER_USER='replication_user_name',
   ->     MASTER_PASSWORD='replication_password',
   ->     MASTER_LOG_FILE='recorded_log_file_name',
   ->     MASTER_LOG_POS=recorded_log_position;

6. On the slave restart the slave process with 'slave start';
7. Check its all OK again with 'show slave status\G'
8. Make a nice cup of tea and congratulate yourself on getting your codling's out of the fire :o)

More from the rack next week as I am getting educated tomorrow and Friday, brushing up on my SQL skills and seeing if Microsofts SQL server 2005 has anything to offer. Without being cynical however given the fact that Microsoft's licensing model is getting more and more complicated and expensive they better have something really good up their sleeves to regain my attention given how positive my recent MYSQL experiences have been.

Using AMF in Anger

2007-01-26T22:25:00.000Z

So no sooner had I found a slinky new piece of software to try than an ideal opportunity to test it out comes along! How lucky am I :o)

A request for a quick application to share a list of tasks landed in my in ear this morning, something simple to basically mimic an excel spreadsheet which needed to be shared between several people. Bear in mind we are cross platform so stop shouting "use a shared task list in exchange" because Entourage on the mac is pants, also this might eventually be shared all over the company and we don't let just anyone onto exchange (not because we don't love everyone it just to blinkin slow). So I added a new module to our internal application suite (codenamed Fattie) and set to work creating a new service in AMFPHP.

Now it has to be said that of the 2 main benefits to this new approach the speed of development over XML is huge, I literally needed to declare the table of methods of which there are only 4 and write a very short function for each. So the application broke down to -
1. Fetch a list of all records
2. Fetch a full Entry
3. Fetch a blank entry
4. Save Entry

in all 80 commented lines which I am sure with a bit of inspiration could be halved which would have taken about an hour of unbroken typing if I were ever to get one :o) Add to this 2 tables in the database for the tasks and contractors and the server side is done.

One thing I am still getting used to in Flash is the recordset c lass, if you are using AMF you really have to use the recordset and this has required a change in my approach to interfaces.

Up to now I have been a big fan of Flashloaded's BIT co mponents for Flash but unfortunately they do not support the recordset as a dataprovider so I have had to dust off the standard Flash version 2 components and bone up on the recordset. That said throwing a quick interface together took about 20 minutes:

Add to this another 20 minutes to create the only dialog box required in the application, that is used to add or edit an entry.

And all that left is a bit of programming to string it all together. As I mentioned before the main difference between how I used to use the BIT Components and the Flash Components is how the data provider is organised. When using a standard array based data provider you can access data using something like component.dataProvider[0].data whereas when dealing with recordsets you have to use component.dataProvider.getItemAt(0).columnName. Seems simple but it probably wasted an hour today in one way or another. Of course now I have dutifully blogged it I shan't forget.

The only thing left to finish off this little app was to take the existing excel worksheet and use the previously blogged technique to force the data into the new MySQL table - sweet :o)

Once finished the other main benefit of AMF kicks in and I can just tell its faster than an XML based equivalent would have been, can't tell you how but I just know.

One improvement which I would have loved to try but I will save for another day is to try and finally get my head around the data binding functions within Flash and using Delta packets to remove the requirement for the dialog box. It would have required some groovy cell renderer's to add the combo boxes to an editable cell but I am sure it could be done.

Revisiting AMFPHP

2007-01-24T17:15:00.000Z

I had a pleasant surprise this morning after I decided to pop in and see how the AMFPHP was getting on, it turns out very nicely thank you and I wish I had popped in 8 months ago when it came out of beta!

For those of you that don't know AMFPHP is an open source project which is very like Flash Remoting Server in that it allows you to more tightly bind a flash application to an application server. There are several reasons why this is a good thing but there are also several reasons why we have never used it in the past even though, as Flash users, it is a powerful tool to have around.

In the beginning there was Flash Remoting Server, it cost a lot of money (-1), it tied you to Cold Fusion as your application server (-2) and it tied you to Flash as a front end(-3). Now I like Flash as a web app programming tool for several reasons, its cross platform, its very readily available, its quite quick and the run time is free, so as a means for creating small web based or intranet based apps its very nice. The problem I have always had with Flash is that it may not be around for ever and I don't want to get tied to it just in case it is superseded also the server side kit from Macromedia as was very expensive. So when we started developing these applications we used Flash for the front end but PHP on the server and always used XML to communicate data backwards and forwards leaving the door open to AJAX, JAVA or anything else we might want to use as a front end.

The only downside to using XML is speed, one very nice thing which I have been using more recently is the XML formatting functions on Microsoft SQL server which meant that there was no need to assemble an XML document from the query data using PHP, simply run the query and send it off to the client. However once this arrived often there are quite complicated functions used to extract the data from XML and display it which Flash was not so hot at sometimes.

So long story short I found that AMFPHP is on release 1.2 with a 1.9 in Beta, installed it in about 5 minutes and had a basic application running in 10. The real change from my point of view is that it is now compatible to a greater or lesser extent with AJAX and Javascript which is great news. So I have spent the rest of the day looking at how much more efficiently this approach can be used to send data backwards and forward between client applications and the server than XML.

The answer is much quicker in 2 respects, firstly the data is serialised at both ends and transmitted as binary data so the latency is much reduced, also as the data arrives at the client side as native data types processing is quicker and much more straight forward. Suddenly the data binding in Flash standard components makes sense! Writing the code is much more straight forward when you get your head around the way that server side classes are constructed and how the information arrives, so much so that a page of programming 250 lines long becomes a far nicer 40 lines long with another 30 odd on the server side. If you program in Flash you need this! I have taken the liberty of linking to the showcase page which lists some great sites apparently using AMFPHP in the wild :o)

Bulk Import to MySQL

2007-01-23T12:39:00.000Z

2 posts in a day! Ring the bells.

Just a quick post because I have found a nice solution to a problem I have encountered a lot and that is that when you move from MS SQL server to MySQL you tend to miss some of the nice quick data import systems in DTS. A typical scenario is how do I bulk import into MySQL from an excel spreadsheet which someone has given me?

The solution is scary but quick and described nicely here. Essentially save your spreadsheet as a csv file, FTP it up to your MySQL server and start an SSL session. Log into MySQL on the command line and switch to your intended target database with "USE database name" then use the command "load data local infile 'Path to csv' into table table name fields terminated by ',' lines terminated by '\n' (field name,field name...........);". Hey Presto its in as long as your fields are in the correct order, one nice aspect is it even allows you to import into auto increment fields.

Sweet.

Rip Poblems and the Legendry Second Tunnel

2007-01-23T10:56:00.000Z

No posts for a few days but that's just because there has not been anything to say, not because I have gone off blogging :o)

Its taken a few days to move one of our applications to Manchester and it has taken a while to get over a sticky routing problem, in that my router at home which is IPSEC tunnelled to the office would not allow me to access the server at Manchester even though RIP was enabled. So in a nutshell from home I could get onto anything on the head office sub net but not access any further sub nets of which we have one each for the pubs and one for Manchester. After looking into static routes which didn't help and trying to investigate RIP I realised that this was a waste of time because of course the grand plan is to have Manchester as a self reliant application server in its own right and by routing through the head office I was therefore reliant upon head office to get to Manchester.

So the quest now became setting up a second IPSEC tunnel to Manchester alongside the existing tunnel to Head Office, a model which would eventually be rolled out to all the remote locations. Now on paper setting up a second tunnel should be really straight forward but if anyone else has tried it you will know that sometimes they work and sometimes they don't, the most frustrating part being that unless you go the whole hog and set up an event log server you get no feedback so when it doesn't connect you just have to keep trying. 10pm last night I was beginning to loose my rag, deleted the tunnel profile from my router, set up another identical profile and bingo - worked first time.

So now the model is as illustrated below which means that when the applications are mirrored properly and all the data is replicating we will have a nice fail over system without breaking the bank. The only trade off being that if Manchester went offline moving users to head office is simple but going back means a backup/restore of the data and a bit of a faff due to the choice of replicating data rather than clustering.

More MySQL replication and dare I mention the I-Phone

2007-01-15T10:56:00.001Z

I was not surprised to log into the MySQL slave this morning and find out that it had completely failed to replicate over the weekend but what was disappointing was how easy it was to fix! I just found another how-to ran through the same information in a slightly different order and hey presto! So if anyone is unfortunate enough to have ended up on this blog looking for MySQL replication info click here because the last link I posted didn't work.

Surfing around over the weekend and I must confess I am getting a bit bored of the I-Phone hype. Obviously I would be foolish to comment too negatively lest I be abused by the faithful as has happened after a rather frank article on the register which gave a few things you could do with a dead I-Phone. I also won't mention the fact that I am on my second HTC smart phone both of which have had touch screens and although I am sure the I-Phones is better the general concept is hardly revolutionary.

No the thing I would like to mention is the rather cool Linux based smart phone from FIC obviously it being Linux based and open source it will not be quite as polished as the I-Phone but I think when we are talking in terms of a revolutionary product having a phone which is so flexible and 'open' this seems to be a truly new approach. It may only be a toy for techies at the moment but I will certainly be getting one when they are available :o)

Muses on Replication

2007-01-12T16:52:00.000Z

So the Manchester server is working nicely 2 weeks on, the reporting system is beginning to be useful and its time to develop the infrastructure a little more. The ideal scenario with this new off site system would be that if it were to fail for whatever reason we could bring on another to replace it very quickly. In this way if we begin to move the pubs everyday applications over we know that we could always turn on an up-to-date backup within a few minutes thereby increasing the peace as Chuck D might say.

The best approach for this in my opinion is not to go all out and create an automatic fail over system with database clustering etc etc as its just not that much of a nightmare if the systems are unavailable for 5 minutes. Instead I am going to use replication which creates a live backup of the data but sends changes over periodically rather than trying to keep total synchronisation. MySQL has a very nice replication system which operates in a master slave relationship - Manchester being the Master and head office being the slave.

There are lots of benefits to this approach but ironically backup is not one of them. Having a database to backup from on the local network is obviously a benefit but one of the things with replication is that if you dismember your master it will automatically dismember your slave right on time :o)

So you still have to backup in the traditional sense but we can do it here instead of in Manchester and if we need to take one of the databases down for maintenance we have a way we can do this in a controlled manner rather than getting up at 2AM and hoping no one wants to use the systems!

I will not go into a 'How To' about replication on MySQL because I just used someone else's blog to accomplish it so here is the link. Also having set it up I now have to go home and see if my changes filter through by Monday morning, speaking of which did anyone else see the BBC thing with the tiny camera last night? Eugh!

Scheduled for next week - I really must get round to playing with Net Beans, found it last week and it really looks like somebody finally made a nice use able web app development tool for Java which must be worth a couple of hours.

Virtual Jiggery Pokery

2007-01-08T17:22:00.000Z

Now that our Manchester server is up and running the main thrust of the work this week has been on moving our company wide reporting system over to this new facility. After tests last week the performance of the system running over the VPN has been very pleasing and even large queries over the accounts database for invoice reports is perfectly acceptable.

A little background on the reporting system would be useful at this point I suppose or this won't mean a whole lot!

Basically the system is a PHP web application with a Flash front end, the key aspect of this system is the excel spreadsheet writer pear module for PHP. The reason for this approach is that most reporting systems, crystal, jasper etc etc can create very nice reports but the emphasis is on each report being a presentable document. Although you can export or generate reports in excel the approach we have taken is to allow a shopping basket of reports to generate a whole workbook full of sub reports which can then be analysed in a much more convenient manner without having to amalgamate reports or remove excess formatting.

One problem we have found today was an odd quirk with our virtual servers. We currently have 4 virtual CentOS machines running on a VMware server installation and the original intention was to have a separate machine for each function ie. one for MySQL, one for the web application, one for NAGIOS (after the problems with our thin client) and one for stuff :o)

The problem we found, which is quite probably my fault, is that accessing the MySQL database on the virtual host from the web application server on another virtual host was sooooo slow it was useless. Therefore we have now had to install MySQL on the same host and all is well but I am not sure that this is how we will want our system long term.

Note to self - stop forgetting things!

2007-01-04T15:11:00.000Z

One problem I find with skipping around from one system to another is that one forgets things, I have just been setting up our new virtual server to house our cross company reporting system and half way through wading around in RPM packages I got a real sense of deja vu. When you install linux it sets itself up very nicely to have a web server and a scripting language (PHP) and even its own database server, however one thing that Linux does not like is Microsoft SQL server so the idea of adding an extension to query this sort of database would seem simple.

How wrong can you be!

So just in case anyone else comes across this problem follow these steps.

1: Install the FreeTDS support library
rpm -i ftp://fr2.rpmfind.net/linux/conectiva/snapshot/i386/RPMS.database/libsybdb4-0.62.4-65381cl.i386.rpm

2: Install FreeTDS
rpm -i http://belnet.dl.sourceforge.net/sourceforge/phprpms/freetds-0.63-2.i386.rpm

3: Install the PHP MSSQL extension
rpm -i http://mesh.dl.sourceforge.net/sourceforge/phprpms/php-mssql-4.3.9-3.2.1.i386.rpm

Seems simple but it just took an hour to find all those bits and pieces - enjoy.

As an aside the virtual servers are performing well, ping times are obviously higher than querying the servers on the local network but 20ms for the round trip should mean that the reporting system still works relatively quickly. The server is now querying one of our MYSQL servers and the master MSSQL server which is nice however for some reason the Auth package in PHP has decided to play hardball - 2 more hours left in the day so here we go.....

A mancky extension to the VPN

2007-01-03T16:27:00.000Z

Our VPN now extends all the way from Tunbridge Wells to Manchester thanks to our new node which appeared on the network this afternoon!

Sounds easier than it was mainly because in setting up the hardware to go to manchester, I was so focused on making sure all the little numbers were correctly set to allow it to take the place of the server, I missed the little button which allows me to actually talk to it once it is in place. Not to worry, the nice technical people sorted it out and it is now ready to form the basis of our company reporting system. One other interesting thing which we have done with this new setup is to put a toe in the virtualisation pool. We have one physical server in the rack but our man Rob has managed to convince it that in fact it is 2 separate servers and in fact we may make a 3rd if we decide we need another separate system. The bonus of this approach for those of you who don't know is that if one 'virtual machine' has a fit and falls over the others continue on as if nothing happened. That is of course as long as the hardware doesn't fail in which case you loose the lot :o)

It will be fine I am sure.

So the next job is to begin to move our base reporting system over from our test server to Manchester.

Detox

2007-01-02T14:10:00.000Z

We're back! After having failed miserably to get the thin client running before the holidays it was relieving that we had a rather uneventful holiday in terms of IT failure. I have moved on to trying a micro drive instead of the flash card as the main disc but I don't really want to spend much more time on it as we can use it for something else and maybe a mini itx based PC would be a better option :o)

We recently commissioned a server in a data centre in Manchester and that should be plugged into our VPN this week so I am looking forward to finally getting some time to investigate the possibilities that will bring. Eventually the plan is to completely split the computing tasks between head office and a rack in Manchester so that where ever possible the hardware can be taken off site, there are lots of obvious benefits to this but the big question is speed.

If the setup proves to be quick enough we may be able to host all of our databases in Manchester but I have a feeling that a more likely scenario would be that all of the pub applications and data will be held in Manchester and all of the head office applications will stay here. The big question is reporting as we are building a system at present which is capable of generating reports on the fly from any of the databases we have be it accounts, HR or pub stock etc etc. The burning question is if we have to split the data between sites can we still report seamlessly across them?

Watch this space.

The curse of the micro client

2006-12-22T09:47:00.000Z

Well I haven't posted for 2 days mainly because I haven't made any concrete progress in the last 2 days. The limitations of the device in question are beginning to be annoying - if only the guys had pushed the boat out and installed 256 MB of RAM it would be a completely different story.

The current thrust of the work in trying to get a useful setup on our micro client has been using VMWare to get a minimal installation of the Slackware Linux distribution which can then be imaged and put onto our compact flash card. The trouble is that even with the cut down kernel and using the excellent package management tool which come in the Slackware setup, as soon as a few packages are selected it bloats very quickly to our 128MB limit.

Another problem seems to be that Slackware has a slightly different folder configuration to the fedora/red hat/centos distros and as a result nagios struggles to configure itself. All a bit painful really and it might be easier to look at another network monitoring tool which is a little more basic.

Training the puppy.

2006-12-19T09:48:00.000Z

Having spent a few days using the new 'device' now it is becoming clearer that my initial plan might not be practical. No great surprise there as I am sure anybody who has ever had a plan will agree but thankfully all is not lost.

The root of the problem is the lack of RAM on the computer, as puppy Linux requires 50-60Mb of RAM to sit in and the device only has 128 available which is very constricting. The only applications I wanted to install were Nagios and Apache but in order to compile these programs I would also need devx which filled up the available resources even before it could fully install never mind the other apps. This required a rethink and at Robs suggestion we tried compiling these programs on a virtual machine, the idea being to copy the finished items back afterwards. On digging a little deeper it seems that this approach may also be flawed because when looking into the rather nifty Nagios live CD which is a precompiled fully operational ISO of Apache and Nagios with no other rubbish thrown in it seems that the minimum required RAM is 256 MB.

Doh!

Enter Cheops to save the day!

On browsing the available dotpups, which are prepackaged installs for puppy much like RPM's for red hat, I found a program called Cheops which appears to be an anorexic version of Nagios. It may not be quite as polished but essentially looks as though it will do what I need which is tell me or the other IT guys if a server or one of the more essential switches falls over during the festive season. Installation is a breeze and so far it is quite happily mapping the network without me having to even tell it where to look which is nice :o)

Watch this space.

Its Arrived!

2006-12-18T11:05:00.000Z

Exciting news - Christmas has come early for the IT department (or at least for me because no body else can get near it!) as our shiny new toy has arrived. About four weeks ago now I read an article on the register about thin clients and more specifically a company called Norhtec and their new micro client Jr. This is a very simple embedded computer based on a lowly 200 MHz processor which is designed to run a cut down version of Linux for simple tasks, but it turns out to be surprisingly capable.

The application I have in mind for it is as a platform for our Nagios network monitoring system which is currently running on a cheap desktop machine loaded with Fedora. Given that desktop machines can use anything up to 200 Watts even when free wheeling and of course even running Linux they occasionally have glitches and crash, the idea of having a tiny computer with no moving parts and which only requires 15 Watts is very appealing both from an environmental and a reliability standpoint.

When the machine arrived first impressions were very good, its tiny - about the same size as a 3.5" hard disk, and boots up with the (optional) compact flash based puppy Linux installation in about 2 minutes. The only thing we had to do was quickly pop to Maplins for an adapter to change the rather exotic Thai power pins to something more mainstream :o)

As the operating system runs entirely in RAM it takes a while to get into the mindset of installing applications to the master rather than installing into RAM and the application disappearing next time you boot up.

So far I have installed FireFox 2 which runs nicely even with the new Flash 9 Beta plug in, and this afternoon I will attempt to squeeze Apache and Nagios onto it if they will fit. Might need to have a muck out first though ;o)

IT begins

2006-12-15T12:23:00.000Z

We have been having discussions about bringing some new elements to the company website, this blog is what you might call a toe in the water, if we find that we can keep up the postings and write something which is actually interesting we may have to create a blog on our main site. Over the next couple of weeks I will try to put up some background posts as well as some progress posts to fill in the details about the nature of IT at BandP.