Hung around a bunch of top guys in Linux talked about added SMP to Linux
Talk on porting Linux to Sparc by David Miller & Miguel de Icaza. Going into improvements and showing how Linux port to sparc bet Solaris in the Lmbench benchmarks on same hardware.
Relaized lived in a world where students could create and port OS that bet the original OS from the vendor
1997 – 1998
Wrote (with another guy) and got ipchains added to Linux
“I woke up one morning and I was kernel firewall maintainer”
Got job people paid to work on Linux firewall code
1998
Decided needed an Australian Linux conference
Oct-Nov visited a bunch of LUGS to invite people and find person to collect money.
People not sure what they wanted to go to a Linux conference ( $380 bucks)
Invited John Maddog Hall
Created and ran a slashdot ad
Created card got into $14k negative
Last session of the 3rd day, reran the 3 best talks
Three stories from 1998
Tutorial Books for each of the tutorials- Couldn’t get photocopies from commercial facility, so had to make 400 copies of books via 4 coin operated photocopiers
Tridge bought up a triple-CD burner. People ran it in relays
Somebody said. “I can’t believe you don’t have conference tshirts”. He bought white tshirts, got them screen printed and sold them.
End of conference Tridge organised a gift from the Speakers to Rusty. Pewter Beer mug
Linux.conf.au after 1999
2001 scheduled 3 talks from Rusty. At the same time
Met Tridge at LCA – Moved to Canberra they did AusLabs
How Great Projects
Smart and Capable enough to complete them
They are Dumb enough to try
When somebody tells you about a project?
That sounds Great, Tell me more
What can I do to help
Enable people’s enthusiasms
Collaboration is a super Power
Get along with people is a skill
“Constructive absenteeism”
Headwinds to collaboration
Signs are welcoming to some people
Other people get signs that they are not so welcoming
Good are seeing them when they are aimed at them, not so good are even seeing they exist when they are not aimed at them.
Open Source Tools for Publishing and Processing Earth Observation Imagery – Paul Haesler
Paul Haesler
Golden age of satelite imagery
Geostationary – One area – Good for weather
Circum-polar orbits – all over earth every 10-16 days
Data processing Chain
Level 0 – Raw
Level 1 – Geo rectify – Measure surface radience
Level 2 – Curroect for sun, sat angle, atmostphere – ARD – Records surface reflectance
Landsat-8 (25-30m , 8-16 day cycle, data since 1982 ) Sentinel-2 ( better, 5 day cycle, 10m resolution)
Digital Earth Australia
The Problem
Open Data Cube
Python, based on xarry
Postgres for metadata
Actual satellite sata from local or network repo (transparently)
GUI maintained by CEOS
Nationalmap.govt.au
Aims to publish all Aus OpenData that can be mapped
Based on TerriaJS
Some DEA data was already being publish but need for additional stuff
COGs – Cloud Optimised GeoTIFFs
DataCube_ows
Lightweight web application server
Developed by Datda61 for GA
WMS
OGC Web Map service
Good for general-usage web apps
Returns standard images (eg png)
Support 1.3 well, works with most clients
Styles for band-mapping
on-the-fly solar angle correction
WCS
Version 1 supported
Works well with TerriaJS , works okay with QGIS or ArcGIS
Next Steps
WPS for on-the-fly processing is regularly discussed
Better ingegration with datacube-core
More recent WCS versions inc WCS-2EO
Sparse Data problems
The Tragedy of systemd – Benno Rice
References to Contempt Culture
Ancestry of Systemd
Unix: Happy accident, place, time, reaction to the previous thing
housekeeping functions – “mounting filesystems and starting daemons”
inetd – Super Daemon for all sockets – “worked well until The Internet Happened”
Then the Internet happened
forking a process per connection doesn’t scale
Lots of persistent state for things like databases
Service
Might be a bunch of processors
Init starts but doesn’t manage
initab can restart things in SystemV
System Config vs Service bootstrap
Mixed in togeather
Service management needs more
Windows NT
Service model there from beginning
MacOs
Application Model means lot richer interaction with the host
Application delegate
launchd
The Idea of Systemd
launchd
Service handling in MacOS
Took over init, inetd, cron
Can listen on ports. Start stuff. doesn’t need to start on boot, boot gets faster, power reduced, security improved
Move system services to daemons, then start daemons as needed
From Launchd to systemd
upstart
event driven
shell based
Rethinking PID 1 – Lennart
“Start less” , “Start more in parallel” , “listen to hardware and software changes”
cites launchd
System management
Everything is a lot more dynamic
Hotplug , DHCP , etc
Don’t install 15 different packages that all behave differently
But systemd will have to do things in a different way to those 15 other things
The reality of systemd
Widely adopted ( 2011 – 2015 )
Arguments
Violates the unix philosphy – actually systemd actually is many binaries
It is bloated and monolithic – Well it does do a lot of thing
It is buggy – So is all software, actually a good failure mode
I can’t stand Lennart Poettering – He’s delivered. “I won’t defend his community interaction”
It is not portable – UNIX is dead – Posix isn’t really a thing anymore, there are not a bunch of crazy Linux variations. “These days you have Linux and some rounding errors”
cgroups
User-Level units
Change – System is a lot of disruptive change
The Tragedy of Change
Nerds love change as long as we are the ones doing it
System boot ups using shell script interaction is like the old blanky we should of got rid of 20 years ago
The Knee-jerk – Abuse is not Cool
The Next Generation
They See a lot more APIs
Thinking in Containers is different from thinking in not-containers
What does Systemd have that FreeBSD (or even future Linux) could use, or could do better
Message Transport
RPC Framework
Kernel and Use-space services should look similarly to the services above them
Service Lifescycle
Automation via API – Easier for vendors to write appliances
Containers
The System Layer
Doesn’t have to be the only implementation of theis
Consistent Device Naming
Better Log/Event/Audit Handling
A new model of an application ( a bunch of things managed as a Unit, See the MacOS model)
Questions
Launchd option – Too MacOS specific
Dynamic Libraries = DLL Hell – Containers avoid, different problems
Is reaction to systemd scaring other big changes off – Possible, hard to write, very hard to handle the social issues to push though
Where is FreeBSD at? – A long way away, no consensus this sort of change needed
Should everything have been swallowed up – Thought experiment, If systemd had instead defined an API for separate projects instead of writing them itself, would that have worked? And now we do know what is needed could we switch to a separate model with APIs?
Enbeded Devices need systemd – Anything Dynamic needs it
What Push back from FreeBSD – Something like that but not systemd. Some like launchd
What needs to change in community and systemd team to make things better – See Adam Harvey’s talk on language changes. Hard since everythign is asking for different stuff, systemd people.
What should systemd go further into – Messageing and RPC stuff more pervasive and more thought about. Something into the kernel.
First contribution of source code was almost 40 years ago
Used Vax BSD at CMU – HAd the deal with an obscure priesthood
KA9Q TCP/IP stack for amateur radio in the 80s
Appearance of RMS in my world
GNU Manifesto
4 Freedoms
GPL
Debian
Worked as LInux CTO from one of the largest IT companies in the world
Collaborative Development Model
Spread out besides just making FOSS
No one company in charge
Diverse range of contributors, massively different motivations
We get a software commons we all get to benifit from
Free Software means Freedom of Choice
Reduced barriers between users and producers of software
Any user can be a dev, or pay someone to dev
If upsteams goes bad, things can be forked
What it means to be successful when you are operating in an open and collaborative model?
The goal of a trad company is for investment to yeld technological control points
First mover advantage
Differentiated features, preferably patentable
Collaborative dev model allows us to recognise the benifit of collaroation on all the non-differentialting elements. Leavign more value to the users / customers
Thinks less about control points, more about points of affinity. What is it that would make a customer want to user you products or services?
Innovation these days largely takes place in the open space
Wrights/Goddard – They didn’t get told to to the next new thing, they just started it as a hobby
Free Software enables people who we don’t know exist to create innovation and invent things we can’t imagine
Long Tail of Contribution
Example: People who did one Linux Kernel contribution, often to fix on specific thing that was causing them problems.
No company on earth that can hire that resource
Needs to be easy for people to access the code and make contributions
Attributed of Successful Communities
Active contribution and collaboration
Diverse participation
Solid core of code
Recognizable mainline trunk
Unified, cohesive structure
Low barriers to entry
Choosing the right license
Businesses can only be successful with permissive licenses
The most successful projects seems to be communities built around open contribution
Share-alike licenses stop possible problem of Closed Corporate fork while the original project withers
Beach Wreck Ignition: Challenges in open source voice – Kathy Reid
Kathy Reid
MycroftAI – One of the few open source voice stacks
Introduction to a Voice Stack
Wake Word – eg “Hey Alexie”
Utterance – Phrase of command
Speech2text processor
Looks for keywords etc
Runs a command
Dialog – acknowledger + response
Wake Word
PocketPhinx, Snowbox, Mycroft Ai Precise
Some use Phonemes (smallest units of sounce in a language)
Hard to tell differences between all words
Always listening, connected to internet
Some use Use Neural networks
Low accuracy can cause frustration
Bias towards male speaker (10:1 male:female in dataset). Also more with American than other accents
To unbias the sample had to tag the samples with ethnicity, gender etc. Which was a problem with ethics of taggign samples/speakers
Speech to Test
Kaldi – no network needed, compute heavy
Deep Speech – From mozilla
Challenges
Lots of accents out there. Hard
Only trained for most common accents
Also problem with regional slang
Need to train on individual speaker
But need lots of data to understand a speaker
Endangered Languages
No commercial imperative to cover them
Mycroft Translate using Pootle to translate command words to 40 languages
Issues for gendered languages, formality
Intent Parsers
Rasa, Mycroft Adapt, Mycroft Padatious
Intent Collisions – Use confidence scoring depending on how explicit the request is.
Text to Speech
Mary TTS, Espeak, Mycroft Mimic, Mycroft Mimic 2
Mimic recording studio, Need 40-60 hours audio
Challenges
Natural sounding voice – making the voice sounds not robotics
