Back in April (April 22nd to be precise) I handed in two copies of my 72 page document which outlines everything about my project.  I wanted to blog about my dissertation while I was doing it, but the thought was always pushed back by other thoughts of actually doing the project.

The project investigated how one could use virtualisation techniques of today and use them to virtualise every application on a machine.  Here’s a copy of my abstract:

In computing, occasionally an application can cause a whole system to be brought down. This wastes valuable time for users and has the potential to lose unsaved data. This project sets out to create a concept whereby applications are virtualised for overall system stability and which appears completely transparent to the
end user. The project attempts to create a system based on this concept using OpenSolaris 2009.06 and a number of its technologies, most notably: Zones.

The project discovers that the choice of technologies used are not yet mature enough to implement the concept, though they are very close to maturing.

As the abstract says, I used OpenSolaris Zones to implement the concept.  I created a script which wraps around the OpenSolaris `pkg` command which is used to install applications.  My script creates a new Zone and installs the new application into that Zone.  The application is now basically in it’s own operating system, to better describe it, it’s as if the application has been installed onto a whole new machine.  The application is accessed using SSH and tunneling X11 over it, this worked quite well after I had set up the infrastructure, but the user had to input their password when they wanted to launch an application.

The project was really fun, I really enjoyed it and learnt so much.  Now it’s finished I’m rather lost as to what to do with myself…

If anyone would like to read my Dissertation or try implementing my project (with is licensed under the BSD licence), please don’t hesitate to contact me.  At the end of it all, the documentation consisted of 72 pages in PDF form (that was 1086 lines of LaTeX, excluding comments and blank lines), and the project consisted of 1494 lines of Bash script and 1393 comments!

# search for all instances of an executable in $PATH
function whence {
for i in `echo $PATH | sed "s/:/ /g"`
do
/usr/bin/ls $i/$@ 2>/dev/null
done
}

It’s nice and straighforward, nothing complicated about it at all.  In fact, to let everyone on your system use it, you could just stick “#!/bin/sh” at the top and stick in a file in /usr/bin !

Today, I wanted to find a man page, the sysidcfg man page to be precise.  Instead of doing the usual trick (`find / | grep sysidcfg”), I thought I’d modify `whence` to look for it for me, and seeing as it’s no longer `whence`, I called it `whenceman`:

# search for all instances of a man page in $MANPATH
function whenceman {
for i in `echo $MANPATH | sed "s/:/ /g"`
do
/usr/bin/find $i/ 2>/dev/null | grep -i $@
done
}

As you can see, it’s very similar, and you could do the same thing by putting it in /usr/bin so everyone could use it.

Though if you don’t have access to a Windows box, but do already have access (or know someone with access) to an OpenSolaris box, then this method works too.

I started the copy from my Mac, however halfway through my Mac crashed   After a restart I decided to start the copy again.  So, my plan was to cd to POCKET and `rm -rf` everything…However, by some horrible fate, I typed the path to my media folder by default and went ahead with `rm -rf *`.

I only noticed about 30 seconds later what was happening…Bit by bit, my data was being de-referenced, left for ZFS to write over it with something else…My first thought was “It’s OK, I’ve got a mirror!”, however, the mirror is, of course, in real time…My second thought was “ZFS snapshots!”, however, they are not enabled by default

I have spent the last few weeks slowly re-ripping my collection (though thanks to James as he had copies of a lot of content), I’ve still got a few to do, but I’m mostly there.  I turned on ZFS snapshots too.  I access my server though SSH from my Mac, so here’s what I did:

ben@faegilath>$ ssh -X beleg-ia -l admin
Password:
admin@beleg-ia:~$ time-slider-setup

I was then presented with the screen on the left

As you can see, you can just tick the box saying “enable time slider” and the choose to snapshot all filesystems or select what filesystems you do want to snapshot.

root@beleg-ia:/share/media# zpool status
pool: rpool
state: ONLINE
scrub: none requested
config:

NAME        STATE     READ WRITE CKSUM
rpool       ONLINE       0     0     0
mirror    ONLINE       0     0     0
c4d0s0  ONLINE       0     0     0
c4d1s0  ONLINE       0     0     0

errors: No known data errors

pool: share
state: ONLINE
scrub: none requested
config:

NAME        STATE     READ WRITE CKSUM
share       ONLINE       0     0     0
mirror    ONLINE       0     0     0
c5d0s0  ONLINE       0     0     0
c5d1s0  ONLINE       0     0     0

errors: No known data errors

The above was achieved by doing something similar to this:
# prtvtoc /dev/rdsk/c4d0s0 | fmthard -s – /dev/rdsk/c4d1s0
# prtvtoc /dev/rdsk/c4d0s0 | fmthard -s – /dev/rdsk/c5d0s0
# prtvtoc /dev/rdsk/c4d0s0 | fmthard -s – /dev/rdsk/c5d1s0
# zpool attach -f rpool c4d0s0 c4d1s0
# zpool attach -f share c5d0s0 c5d1s0

First we print the vtoc (volume table of contents) and pipe that to a format command.
The -f was used to force the attachment, I followed instructions from several other sources and all has worked for me.

The ‘share’ pool is auto-mounted to /share which is cool.  Now with file systems galore using ZFS, `zfs list` give me the following output:

root@beleg-ia:/share/media# zfs list
NAME                            USED  AVAIL  REFER  MOUNTPOINT
rpool                          33.1G   424G    75K  /rpool
rpool/ROOT                     4.79G   424G    18K  legacy
rpool/ROOT/opensolaris         5.42M   424G  2.27G  /
rpool/ROOT/opensolaris-1       4.79G   424G  4.55G  /
rpool/dump                     1018M   424G  1018M  -
rpool/export                   26.3G   424G    19K  /export
rpool/export/home              26.3G   424G    21K  /export/home
rpool/export/home/admin        28.8M   424G  28.8M  /export/home/admin
rpool/export/home/ben          26.3G   424G  26.3G  /export/home/ben
rpool/export/home/ben/backups  20.4M   424G  20.4M  /export/home/ben/backups
rpool/swap                     1018M   425G  31.9M  -
share                           126G   331G    19K  /share
share/media                     126G   331G    27K  /share/media
share/media/iTunes             5.66G   331G  5.66G  /share/media/iTunes
share/media/misc                911M   331G   911M  /share/media/misc
share/media/movies             61.8G   331G  61.8G  /share/media/movies
share/media/pictures            425M   331G   425M  /share/media/pictures
share/media/standup            5.32G   331G  5.32G  /share/media/standup
share/media/torip              4.50G   331G  4.50G  /share/media/torip
share/media/tv                 47.7G   331G  47.7G  /share/media/tv

So I’m pretty happy with it at the moment.  I’ll be looking at upgrading the motherboard next.  Something with 8 SATA channels so I can increase my hdd’s and potentially create a RAIDz for 4x 1TB drives…But we’ll have to see how funds go…

I wanted a way for me to access my server when I wasn’t on the local network.  A friend pointed me to DynDNS, this will give you a domain name (e.g. myname.something.com) which you can update to point to your IP.  However, you need a method for updating the DNS entry, this is needed because everytime I switch off my modem and turn it back on, Tiscali give me a new IP.

So, my OpenSolaris box will need to update DynDNS.
DynDNS have a couple of scripts for doing this, and how to install/run them.  Clicky.  I chose to use inadyn (here).
Only problem now is, I’ve got to make it run!  And I really didn’t want to run it at boot every time…So it was an excellent excuse to play with SMF!

I moved the script to /lib/svc/method/inadyn-exe and created a config file in /etc/inadyn.conf
Here is my config file with some of the more important data spoofed:

admin@beleg-ia:~$ cat /etc/inadyn.conf
--username user1
--password password
--update_period 6000
--background
--alias myserver.example.com

I then created a new manifest for SMF.  The manifest file is written in XML and tells SMF what the service is, what services it depends on, what services depend on it, what to do when enabling it, what to do when disabling it and much more.
My manifest looks like this:

<?xml version=”1.0″?>
<!DOCTYPE service_bundle SYSTEM “/usr/share/lib/xml/dtd/service_bundle.dtd.1″>
<!–
This service will kick off inadyn-exe which will update my IP
Address should it change.
Ben Lavery has an account with dyndns.com
Hostname is:
myserver.example.com
–>

<service_bundle type=’manifest’ name=’SUNWcsr:ip-update’>

<service
name=’site/ip-update’
type=’service’
version=’1′>

<create_default_instance enabled=’false’ />

<–! Only create 1 instance –>
<single_instance/>

<!– Depend on the network being up –>
<dependency
name=’milestone’
grouping=’require_all’
restart_on=’error’
type=’service’>
<service_fmri value=’svc:/milestone/network’ />
</dependency>

<!– Depend on the config file existing –>
<dependency
name=’config_data’
grouping=’require_all’
restart_on=’restart’
type=’path’>
<service_fmri value=’file://localhost/etc/inadyn.conf’ />
</dependency>

<!– execute /lib/svc/method/inadyn-exe when svcadm enable is issued –>
<exec_method
type=’method’
name=’start’
exec=’/lib/svc/method/inadyn-exe’
timeout_seconds=’60′ />

<!– Kill the process when svcadm disable is issued –>
<exec_method
type=’method’
name=’stop’
exec=’:kill’
timeout_seconds=’60′ />

<template>
<common_name>
<loctext xml:lang=’C'>
IP updator
</loctext>
</common_name>
<documentation>
<manpage title=” section=”
manpath=” />
</documentation>
</template>
</service>

</service_bundle>

So, after placing this in /var/svc/manifest/site/ and calling it ip-update.xml I ran it through an XML checker:
# xmllint ip-update.xml
<output ommited>

Then I imported it into the SMF repository:
# svccfg
svc:>  validate ip-update.xml
svc:>  import ip-update.xml

After this I was able to use `svcadm enable ip-update` to start the service, though it will start up after the network service has started.  If the service goes down SMF will try to restart it for me!  Even after two months it keeps DynDNS updated and I can happily SSH in from outside my home network!

NB: You may need to set up SSH forwarding from your home router.

At home everything was still running smoothly, the battery had lasted the travel from work (it doesn’t suspend yet…) .  My only problem was that it didn’t like the WPA2-psk wireless in the house.  I had two choices:
1) Screw every computer in the house ovre and change to WEP.
2) Look for a work around.

I opted for 2.  My work around was very simple actually.  Build 105 fixes the compatibility with WPA2, so I added the developers repository to my authority list and live upgraded the machine to build 105.

Now I can happily lye in bed, with my X32, and write this blog entry!

Build 105 seems fairly stable so far…Not that I’ve tried doing much yet.  Will report findings as I go along

I set about looking for a solution.  Unfortunatly, Googling around didn’t throw up anything to begin with   So I thought I’d record my steps as a walkthru.

First of all, I installed the distributon constructor:

# pkg install SUNWdistro-const

Next I cd’d to the directory they had been installed to:

# cd /usr/bin

And ran the following command:

./usbgen /var/tmp/osol-0811.iso /var/tmp/os0811.usb /var/tmp
/dev/rlofi/3:   1689000 sectors in 2815 cylinders of 1 tracks, 600 sectors
824.7MB in 176 cyl groups (16 c/g, 4.69MB/g, 2240 i/g)
super-block backups (for fsck -F ufs -o b=#) at:
32, 9632, 19232, 28832, 38432, 48032, 57632, 67232, 76832, 86432,
1593632, 1603232, 1612832, 1622432, 1632032, 1641632, 1651232, 1660832,
1670432, 1680032
Copying ISO contents to USB image...
..................................................
..................................................
..................................................
.............................
1407024 blocks
=== ./usbgen completed at Mon Jan 19 00:25:49 GMT 2009

Lastly:

# ./usbcopy /var/tmp/os0811.usb
Found the following USB devices:
0:      /dev/rdsk/c9t0d0p0      15.5 GB USB DISK 2.0     PMAP
Enter the number of your choice: <enter your choice>
WARNING: All data on your USB storage will be lost.
Are you sure you want to install to
USB DISK 2.0 PMAP, 15500 MB at /dev/rdsk/c9t0d0p0 [ w  (y/n) y
Copying and verifying image to USB device
Finished 824 MB in 316 seconds (2.6MB/s)
0 block(s) re-written due to verification failure
Installing grub to USB device /dev/rdsk/c9t0d0s0
Completed copy to USB

And that’s it!  Should be done.  Will report back tomorrow with how the install went.

Make sure you have various DNS domains in /etc/resolv.conf, then:
cp /etc/nsswitch.conf /etc/nsswitch.conf.BAK
cp /etc/nsswitch.dns /etc/nsswitch.conf
svcadm restart dns/client

After this, edit the file: /etc/nwam/llp

It will look something like this:
rge0    dhcp

Change it to this:
rge0    static    192.168.1.18/24

I have rge0, you may have something else, don’t change that bit!  The IP address it your choice too, the /24 gives you the netmask 255.255.255.0

Restart nwam:
svcadm restart network/physical:nwam

Add your new IP and hostname into /etc/hosts following the same format as already exists

svcadm enable network/physical:default

The add just the ip address of your default router to /etc/defaultrouter

svcadm restart network/routing-setup

Hope that help some people

I have so far set it all up as such:

ben@BELEG-IA:/share/media$ zfs list
NAME                                   USED    AVAIL  REFER  MOUNTPOINT
rpool                                       26.1G     431G    72K  /rpool
rpool/ROOT                         3.10G    431G    18K  legacy
rpool/ROOT/opensolaris   3.10G   431G  2.96G  /
rpool/dump                        1018M   431G  1018M  -
rpool/export                        640K   431G    19K  /export
rpool/export/home               622K   431G    19K  /export/home
rpool/export/home/ben      602K   431G   602K  /export/home/ben
rpool/share 21.1G   431G    19K  /share
rpool/share/media                      21.1G   431G    33K  /share/media
rpool/share/media/movies 21.1G   431G  21.1G  /share/media/movies
rpool/share/media/music        18K   431G    18K  /share/media/music
rpool/share/media/pictures   18K   431G    18K  /share/media/pictures
rpool/share/media/tv                18K   431G    18K  /share/media/tv
rpool/swap                                           1018M   432G    16K  -

The bold entries are separate file systems I have created using:
zfs create rpool/<file system path>

For ezample:
zfs create rpool/share

I then did the following to allow the file system and all sub systems to be shared over NFS:
zfs set sharenfs=on rpool/share

So far I’ve not set up any sort of snapshotting…