LCA2012 – Tuesday after Lunch

Mistakes were made by Selena Deckelmann

  • Misc management
  • Prepare for failure, Failure is an option (it will happen)
  • Book: “Everything is Obvious”
  • 2 examples (NZ and Scotland) of rats gnawing through cables and taking out country
  • Document -> Test -> Verify
  • Failure to Document
  • Write Docs, Update Documentation, Make documentation a step with your written processes, assign some time to that step.
  • Doc Tools: Graphic Designers, wikis, sphinx, diagrams  – timelines – bug tracking – ordered todo lists
  • Failure to test
  • Verify success criteria – Write tests – test with buddy – have a plan
  • testing frameworks, staging environment, repeatable shell scripts
  • Failure to verify
  • Have a plan for things going wrong – have staging environment – test rollback plan, not just implementation plan
  • Tools – People, staging environment
  • Failure to imagine
  • share stories of failure – talk to people are different from yourself – act out implementation scenario
  • Failure to Implement
  • reflection ( post-mortem )
  • Plan to do  post-mortem, document the plan with numbered steps and a timeline – test plan & rollback plan – Identify point of no return
  • During – screen sharing – chatroom – Voice – Headsets – Designated time-keeper

Scaling Openstack by  James Blair and Monty Taylor

  • 6 projects in openstack.
  • collection of related repositories
  • Most contributors paid to work on it by their companies
  • number , quality and area or contributors varies
  • 6 monthly releases – design summits – continuously open truck – dev on master – Monthly milestones – stable branches post release
  • Vision – consistent tooling and process on all projects -> Consistent Product -> Multiplier effect.
  • Minimize meta-development, Standard tools
  • Gerrit – code review
  • Jenkins – Testing (pre and post merge)
  • Orchestra (bare metal deployment)
  • Lanchpad, documentation servers, planet, repos
  • Environment: Ubuntu, Everything in Python (pep8 standard, openstack.common ). virtualenv/pip
  • Gated truck – ensure quality – auto tests – means devs always start from working code – keeps bad code out of tree – process same for everybody, transparent, automated.
  • Gerrit – stand-alone patch review system – lots of integration hooks – lots of review categories
  • SSI using openid for all of project sites
  • Git review is implemented as git sub-command to submit things to gerrit. zero-config <- looks cute
  • Vendors can have labs and tests and code can be automatically submitted and tested on it

 

Share

LCA2012 Tuesday – Before Lunch

I’ll be posting some updates from Linux.conf.au in Ballarat in the next few days. I arrived on Sunday but this is my first post. I’ll see if I do an out-of-order blog post on that later.

The keynote from Bruce Perens was really good. He talked a lot about the failure of open source to engage the public and policy makers. He also covered a bunch of cool hardware projects and cheap (and often open) small boards and other electronic products.

Smashing a square peg into a round hole – David Basden and Chris Collins

  • Automation your automation.
  • Anchor – Hosting provider, doing built solutions, non-standard requirements
  • Puppet is one step, PXE & dbootstrap just another, hundreds of others
  • A “simple” build used to take a day, down to 10 minutes
  • instead of defining all steps define dependencies to get a “partial ordering”
  • figure out what has to be done, in what steps, keep track of what has been done
  • Lack of security in many queuing systems, bad agents can grab tasks they aren’t supposed to etc
  • Outline of “Audience” job control system. Design goals and decisions
  • Code on github.net/anchor

 Extracting metrics from logs for realtime trending and alerting by Jamie Wilkinson

  • passive system, query application about it’s metrics. However sometimes hard to parse
  • However most apps log to system or other logs
  • emtail – exporting modular tail
  • plugins – on event X do Y – usually regex
  • Metrics are values, times ( name, value, when, type (counter, gauge) , string, tag
  • metrics are exported over a common protocol ( google protocol in G version, json in open source version )
  • exported over http using json or CSV,  sent to something slse to save and do something with
  • Written in Go. Old version in python but too google specific
  • 20 minutes talking about the source code (I browsed the web during this bit)
  • I and a few others in the audience seemed to think this duplicated a lot of other tools with no obvious huge advantage over them. Bit of google NIH.

 

 

Share

2012 New Year’s resolutions

I don’t usually make New Year’s resolutions let alone publish them but I thought I’d go for it this year. If nothing else it’ll make me feel a bit guilty not keeping to them.

1. Get weight down to 80kg – Over the last couple of years my weight has drifted up from around 85kg to 95kg. My goal for this year is to get it down to 80kg.

2. Get my learners driver license – I don’t have a drivers license at all right now. Goal for this year is to at least pass the written test and get the first stage of a full license. Hopefully I’ll actual do a bit more than this but I think the learners is a good minimum.

3. Get chess rating to 2000 (either NZCF or FIDE) – My rating is currently hovering around the 1800 level for both my New Zealand (NZCF) and International (FIDE) rating. My goal is to get this 200 points higher which will put me into New Zealand “A” grade.

4. Complete  “Learning Python the Hard way” – My programming skills are a bit weaker than I would like. The is a fairly well known book/course Learn Python the Hard way by Zed Shaw that I’d like to complete to get my skills up a bit.

I’ve tried to make the goals realistic and list things I can actually finish. The weight goal and the chess goal are probably the hardest. The weight one will require me to stick to a diet pretty much all year while the chess one will require at least a couple of hours a day of study and practise.

I’m not sure how long the programming course will take, I’m guessing 20-50 hours if I do most of the extra-credit exercises. The drivers license things should be less perhaps 20 hours of road-code study plus the test itself.

Some of the things above cost money but I feel that they are all worthwhile enough to spend a bit on. This is especially the case where I’m spending a lot of hours on something. For example there is a video version of the python course available for $US 29. It would be silly of me to invest 20-50 hours in the course but “save” $29 by not paying for the full version.

The license and programming goals are a little unambitious but with them I’m hoping to (a) have something I will actually complete and (b) be things that have obviously follow-ups.

Share

July Update

I just updated this blog to wordpress 3.2 which came out this week. Only a small glitch caused by me running an old theme which wasn’t 100% compatible. WordPress itself seems to be better. I had a quick look at the Twenty Eleven theme which comes packaged with wordpress and it looks nice even via my mobile browser. I’m tempted to update from the Simplicity theme which I currently use.

I updated my hosted Linux VPS to Ubuntu 10.04 last week and took the opportunity to change the web software around when I did it. I’ve now replaced lighttpd+fastcgi with a standard apache2+mod_php setup but I’ve put Varnish 3.0 web accelerator in from of everything. Complete overkill for a bunch of small sites that I host but it gives me peace-of-mind for slashdotting type situations. Main reason for the move is that lighttpd is a little obscure these days while I use apache and varnish at work.

Last week I attended the 3 day NetHui conference in Auckland. The conference was aimed around Internet Policy for New Zealand. An interesting 3 days during which I attended (and missed) plenty of great discussion, talking to interesting people and saw a few great talks. The event was cheap to allow more people to attend and features a wide range of people including Lawyers, educationalists, techies, businessmen, civil servants and a few “interested in a private capacity” people. Great event. Here is a link to the media/blog coverage.

Later this month I’ll be in Christchurch for the South Island Chess Champs ( link to site not page since sites uses frames!!). Christchurch has been hit by 3 big earthquakes in the last year (and hundreds of small ones) and thousands of buildings have been damaged (Many have or will be demolished) so it will be interesting seeing some of this for myself (although I’ll be playing chess during most of the day). The tournament is one the other side of down from the most damaged areas however.

Also coming up this month I’ll be at Barcamp Auckland 5 , probably not speaking though.

The Call of Papers and Call for Miniconfs have also just come out for Linux.conf.au 2012 in Ballarat. Once again we’ll hopefully be able to run a Sysadmin Miniconf and I’m also thinking of putting in a talk proposal.

Share

Work shuffle

Work recently had a bit of a reorg and my “infrastructure” team (me and two other guys who look after the hardware, network, database,  OS and everything apart from the the actual website code) were moved from the “online” division to “Central IT” . Next week we physically move down to the basement (yes, really) to be with the rest of IT.

Note: One of my rules of seating is “always be as close to marketing as possible” . This is because marketing (usually) have a bit of clout in any organisation and will always get at least semi-decent offices with things like windows, pool tables, working lifts etc. Departments like IT, Helpdesk, accounting and security on the other hand have no pull and will get pushed into windowless dungeons whenever the reorganisations happen.

The main thing I’m worried about with my new job is that I’m not cut of from my “platform users” , we are about 2 minutes walk away (for now, potentially more later) so it’s not too far for meetings but certainly too far for unsceduled chats. So I won’t know if a major stoary is breaking (with the potential load on the system) just by watching frantic acticity any more, nor will I be able to walk a few metres to check a bug, ask somebody a questions etc.

Just last week we had a bug on the site for a few minutes that caused one article to 302 (temp redirect) to itself for about 10 minutes. I noticed the big jump in hits and was able to talk to the 2 editors in charged or the article and the head programmer right away. As of next week something similar will take much longer as I would either have to run upstairs (and be offline) or phone/skype people until I got hold of the right ones.

It’s a common situation with disjointed teams but it means that things have to get a lot more formal in order to keep the site reliable. So I’ll probably be spending the next few weeks going over rollout, escalation, ticketing and similar procedures because I’ll no longer be able to just turn around and yell to find out if somebody is running something causing a problem.

At least one good thing that’ll come out of this is that we won’t be doing the “level 1” helpdesk stuff for the dept any more, so we’ll be able to concentrate on our actual job.

Share

lca2011 – Fri Close

Apology re keynote material

Lightning talks

  • New policy on open source software in Govt, stronger, participate in community
  • Linux.conf.au in antartica. Cooler than brisbane, drier than wellington
  • other conferences by lca drupal down under, wordcampe, pycon. You run your own conf, LA may even support. Join planet LA, Join a LUG
  • Next 12 months in IP law: ACTA will happen in next 12 months. TPP might be stopped by NZers. Iinet decission very soon. DRM [cutoff]..
  • usbdoodad.info . Surface mount soldiering help, kits available
  • macbook people. not too hard these day. Get hold of reefer bookloaded. partition under OSX. Leave a gap between linux and OSX partition. testing many common distributions
  • LDAP. ldapauthmanager software
  • OSIA Open source industry australia. Join for advocacy & networking
  • Debian 6.0 released next week!
  • Donna promoting “Digitise the Dawn”
  • secan does ipv6 now says Rusty
  • Women in Open source, under-represented still. No funding. Suggested ideas if they had money. training courses. adainitiative.org – looking for funding for 2 years of full time work on women in open source.
  • SUDE studio – create virtual appliances
  • new conference in australia – oct 2011 – Sydney – php conf australia – twitter.com/phpconfau

Closeup

  • lca2012 in Ballarat
  • http://lcaunderthestars.org.au
  • 2013 bid process in next few weeks
Share

lca2011 – Fri session 5 – Open source in education

Open Source in Education – ASHS One Year On by Patrick Brennan

  • Followup to last year
  • greenfield school – flagship school – no classrooms, learning commons, 2 floors of open plan
  • 2011 enrolments 740 – 16-18 year olds
  • open for teaching 4 days per work, 5th day do “impact projects” eg work to raise money for charity, local video storage system
  • Ubuntu Desktops, teacher laptops
  • Xero for account
  • Mandriva Servers
  • Terminal servers for edge cases
  • Cloud Apps
  • Single sign on
  • Windows remains for building management
  • Education space Microsoft ffocussed
  • Heavily subsidised by the MoE and Microsoft
  • Established Norms / established design refs
  • Perception that students should train with “real world” tools
  • Free as in beer vs free as in freedom
  • Licensing costs – NZ Govt / MS Subsidised – My Opinion underhanded monopoly
  • Learning tax – expensive for software at home – leads to piracy
  • Web filtering
  • MOE funds watchdog to 10Mb/s
  • $5000 to install Cisco device supporting 100Mb/s
  • Coast to support watchdog to 1Gb/swith existing FW $0
  • “Dill” provide no installed OS on desktops
  • Teachers working out how to do with tools, sharing techniques on eduwiki with other schools
  • No learning tax yields freedom
Share

lca2011 – Fri Session 3 – Lightweight messaging

Lightweight messaging for a connected planet – Andy Piper

  • The internet of things, smart devices in our hands
  • Instrumented, interconnect, intelligent
  • MQTT = MQ telemetry transport
  • publish/subscribe paradigm.
  • Optimized for Low bandwidth, high latency, unreliable, high cost networks
  • Expect client apps to have limited processing resources
  • provide QOS where possible
  • simple semantics, minimized format ( 2 bytes minimum packet )
  • “last will and testament” to publish if client goes offline
  • what about HTTP – MQTT much simplier, message not document centric, less verbose, lightweight
  • variable QOS
  • Free Client API / libraries for most languages, various propriety products as well
  • various examples
  • IBM rsmp official client – free for personal use, various binaries for many platforms
  • http://mosquitto.org – packages for various dists, windows, Mac. Open source , python and C++ examples
  • Random stuff – file syncs, desktop notifications, digital to analogue readouts, LEGO microscope control
  • Smart meters, heathcare patient monitoring
Share

lca2011 – Friday Session 2 – & habits of PMs

The 7 Habits of Highly Ineffective Project Managers – Carol Smith

  • Works in summer of code office, previous network operations, enterprise software
  • 11 interviews at google to get her position
  • Habit 1 – spend more than 2 weeks in meetings with engineers, “makers schedule vs managers schedule” by Paul Graham
  • Habit 2 – Assuming all the engineers you work with are purposefully tryin g to do a bad job and sabotage the project
  • Assume competence – People want to take pride in their work and do a good job
  • Habit 3 – Keep a checklist – creates a big gant chart, bugs engineers constantly about status
  • Needs to be familiar with technology and project to understand what engineering is talking about when there are problems
  • Habit 4 – Let middle and senior level managers meddle with timeline
  • maintain credibility and managers will feel less inclined to meddle
  • Habit 5- make everything an emergency
  • Don’t cry wolf – get people to understand if you do say something has to be done today it really does
  • Habit 6 – Break down rapport with engineers whenever possible
  • cookies
  • don’t use small cookies to reward directly, use to build rapport not reward directly
  • Habit 7 – Assume that the dates engineers give you are spot on
  • engineers will try and tell you something will please you, under promise and overdeliver, take past estimates from that person into account
Share

lca2011 – Fri Session 1 – LinuxCNC

All Chips , No Salsa – Bdale Garbee

  • Got tabletop 3-axis mill 2nd hand, sloppy but got useful work
  • Bought new mill in 2006 305x765x560mm working volume + CNC conversion kit
  • EMC2 – open source machine control system
  • EMC2 – HAL between layers – very modular – real time – Linux user interface – “axis” user interface – “trivkins” control module
  • Open vs  closed loop. Closed loop tools feedback to controller to tell it result of commands issued
  • stepping vs servo motors
  • Pluto-P board – parallel port connected – source and open drivers – not open hardware but “obvious” FPGA so transparent
  • Amps boast 3.3 volt to 60-80 volts at several amps
  • Use windshield wiper motors to test before rigging up to big stuff
  • wires enclosed in clear vinyl tubing
  • http://gag.com/homeshop
  • HeeksCAD / HeeksCNC
Share