Fenxi - Performance analysis made easy
Changing libgnomecups For Multiple Evolution Users
Happy National Sys Admin Appreciation Day!
ESX iSCSI Basic Configuration from the CLI
Tape Rants and Raves: LTO4 Rules
apparently you aren't dead until you start to stink
Charlie Goes to Candy Mountain
Seattle Scalability Conference, Pt II
Overclocking tool for the Mac Pro
ADO.NET Entity Framework (Microsoft's new ORM) given a non-confidence vote by beta testers
Ruby interpreter flaws make the case for JRuby
AdvFS - Tru64 filesystem ported to Linux
OpenSolaris 2005.05 repository update to b91 - follow these instructions carefully
SXCE can ZFS install as of b90
Vertebra: EngineYard's Next Generation Cloud Computing Platform
Skype 4.0 beta overhauls video chat
Mozilla org receives traditional IE cake
Toyota Prius to go entirely Electric
Bill Gates steps down permanently for philanthropic activities
Men write code from Mars, Women write more helpful code from Venus
DRBD LVM Xen = Bug. A rather nasty one at that.
Intel unveils Ct as an extension for C/C to encourage threaded programming for multiple cores
VMWare ThinApp - Run any Windows app on any version of Windows
JRuby-Rack <-- a JRuby port of Rack
Rack <-- a lighter cousin to Merb, fully threaded and no Mutex.
Solaris Cluster Express (SCX) 6/08 released.
Changing solaris' default password hashing
Texas based service provider explosion affects 9,000 servers and 7,500 customers.
Jruby on Rails on Tomcat deployed as as WAR file
42 more of the best Linux games
Use Google's cached ajax libraries
Arduino microcontroller with OS/X
The metasploit page describing the full impact of the poor RNG.
Holger Bert's blog post on the openssl RNG fiasco
Cayac - Cherokee MySQL PHP5 phpMyAdmin
ZFS very slow under an xVM kernel
Dynamically editing libvirt xml configs while a VM is running to redefine reboot flags.
Chronoton - the time travelling robot who's best friend is a talking pie game
Rietveld - Google's code review tool
Opensource multitouch displays
Ono - an efficient way to locate nearby peers
Solaris CIFS integrated AD with ZFS acls
Samba Winbind and ZFS acl working together
Why's unholy Ruby to Python .pyc compiler
OpenSolaris 2008.05 final ISO image
Twitter abandoning Ruby on Rails
HP makes memory from a once-theoretical circuit
Setting Up an OpenSolaris NAS Box: Father-Son Bonding - The Video
Linux kernel Xen self-ballooning patch
Coolstack - Yet another group of solaris packages
SFE - Spec Files Extra - or, solaris's ports system
ksplice - live linux kernel patching
ZFS-102-A.pkg - binary package build of newer ZFS for Mac
Changing boot flags for a solaris domU guest
callflow - SIP callflow diagram generator
sdedit - quick sequence diagram editor
Milax - The OpenSolaris Small Live CD
Big Nerd Ranch on Windows/Linux/Leopard single signon
Sun touts big plans for OpenSolars as first release nears
Heroku - EC2 based Rails hosting.
Meadowcourt's compiled WindowsXenPV driver, v0.8.8, as built from win-pvdrivers.hg repo
Network Solutions hijacks all customer's unused subdomains
ZFS speed bump: set zfs_nocacheflush = 1
We Don't Use Software That Costs Money Here
Hubble - a PlanetLab realtime Internet "blackhole" monitor
Citrix price jumps on rumors of potential IBM/Cisco bidding ware
TechCrunch labs on their AppEngine deployment
pash - because powershell was too cool to let microsoft keep to itself
Brazil migrates 430 thousand boting machines to Linux
The Machine Emulator - TME can emulate a sparc4 with OBP
Google releases new GCC linker
Automatic generation of peephole superoptimizers
Xen.org Trademark Policy for Review
SXCE b85 has problems booting under Xen 3.2
VNRP == opensolaris quagga rbridges crossbow xVM
problems reprobing iscsi devices with solaris 10
LSI MegaRAID SAS/Dell PERC5 driver for Solaris
dm-band block IO bandwidth controller
Dojo.storage - Google Gears workalike?
ooma.com - free phone service after you buy their device
Hacking defibrilators shockingly easy
Microsoft working with Eclipse.
Pentagon attack last June stole an "amazing amount" of data
Solaris and Solaris Cluster on HP ProLiant Servers
Apple Introduces new MacBook and MacBook Pro models
Sun leaks 6-core Xeon, Nehalem details
Xen and Solaris - a journal of sorts
How to save the world with ZFS and 12 USB sticks
Xvm: a summary of creation of various Xen domU
OpenSolaris b82 comes with CoolStack
Dilber PHB on Virtualization Consultants
Sun xVM Ops Center GA v1.0 tomorrow
KernelTrap on the 2.6.23 Xen merge
IETF XMPP/SIMPLE Interworking Draft
PSYCed - IRC/XMPP server that gateways transparently between both
OTR - Off The Record, Homepage. IM Encryption.
SIPE - Pidgin plugin for SIP/SIMPLE with Microsoft LCS compatibility hacks
Price Waterhouse Cooper's Global Cable Map
Solaris Windows iSCSI speedup disabling NAGLE
OpenSolaris Storage Developer Wish List
Nexenta Builder - build your own Nexenta based distribution
Microsoft to acquire SideKick maker Danger
Linux Kernel 2.6.23-2.6.24 vmsplice local root exploit
The evolution of Tech Company logos
Mindstorms NXT Rubiks Cube Solver
Cut four undersea cables, shame on you, cut a fifth, also shame on you
Koha - OpenSource Integrated Library System
SIPE - SIP Exchange protocol - or, how to get Pidgin to talk to Microsoft Live Communication Server
Amazon SimpleDB written in Erlang
Xen DR7 and CR4 Registers Multiple Local DoS vulnerabilities
XMLPulse - parse xen dom0/domu stats
The rist of the FOSS spinmeister
Smartphones patented - lawsuits immediately filed
H-Sphere cross-platform hosting control-panel
Mystery infestation strikes Linux/Apache web sites
GNU/Solaris - When the fun begins
KDE goes cross platform with Windows and Mac/OSX support.
Microsoft prints get-out-of-jail card for Vista Home
Tsung - an erlang based multi-protocol distributed load testing tool
Microsoft relents, ban on vista virtualization is lifted
Hyperic podcast talking smack with Luke KAnies of Puppet
The Mysql storage engines, and when they are appropriate.
MADOCA - Message And Database Oriented Control Architecture
SMP Xen HVM Windows guests need timer_mode=1
James Randi is coming to Tampa
Information Of Those Who Appealed Watch List Compromised
Tata Nano - $2500 world's cheapest car
Air Travel with Spare Batteries? Check the changes to what is permitted starting tomorrow.
Open Configuration and Management Layer
FiveRuns RM-Manage - rails project monitoring
VLDB - Very Large Data Base Endowment Inc - nonprofit
Elastix - a more friendly Trixbox fork
A Glimpse and a Hook - a take on resumes
Xirrus - LISA used 7 arrays to provide WiFi
dopd - an easier way to keep drbd primary/secondaries in sync
OpenSIM - run your own SecondLife grid.
$4million in hardware lost in London data center heist
iscsi block device script for /etc/xen/scripts
Quaqua - Aqua look and feel widgets for jvm
Chimps beat humans in memory tests.
Level 3 needs technicians with FIREBALLS
10 steps to close down an open society
Longer flights to avoid air traffic control charges
News release from Six Apart about LJ sale to SUP
Optimus keyboard is finally available
pkgGen and logGen and Packagemaker - repackage os/x packages to deploy
Jumpbox.com - virtual appliances
TelegraphCQ - barkeley database research - adaptive dataflow capture, combine, analyze
UK loses CD of private info on 25million citizens
Solaris Automatic Migration opensourced
AVS ZFS Demo <-- replicated ZFS pool
Xen Virtualization book not yet published for sell on Amazon
Phoenix BIOS releasing its own hypervisor
Andrew Warfield's other publications
Parallax - managing storage for a million virtual machines, from the Xen guys at Cambridge
Kepler project - GRID scientific workflow engine
Google Code Map/Reduce mini lectures
What 24 would have been like in 1994.
WaterRoof - Mac OS/X Firewall Manager
10 reasons why Oracle databases run best on VMWare
Google Caja - allow scripts in a 3rd party context
Xen Windows PV drivers - opensource mercurial repository
QuickSilver - opensourced 11/06/07
vmcasting.org - someone else "gets it"
ASUS EEEPC701 starts to appear
Perian - Opensource quicktime codecs
RSnapshot - an rsync based dirvish like tool
Flyback - a google code project equivalent to Apple's Time Machine, for Linux
Apple tablet PC is real, says Asus.
producten.hema.nl - wait for this one to load
Google rolls out the Open Handset Alliance
Cost analysis of Windows Vista Content Protection
Git - a Google Talk by Randal Schwartz
indeed.com - MIT search engine for jobs crawled from monster, dice, etc.
Tomshardware's RAID Migration Adventure
Theo de Raadt on Virtualization, and the sate of OpenBSD Xen
Bitlbee - IRC gateway all of your other IM traffic
Off The Record - encrypted IM overlay
SATA drive -> NES cartridge style
Amazon's one-click patents struck down
Morgan Stanley sells entire New York Times stake
Massive installation management tools
GULP: a unified logging architecture for authentication data
EC2 outage loses customer data
FutureOfWebApps conference underway
Microsoft releasing the Source Code for the .NET libraries
Windows 2003 Server Emergency Management Services (EMS) - Special Administration Console (SAC)
Catalyst - the Perl web framework analog to Rails
Fusion io - the power of 1000 harddrives in the palm of your hand
Proggyfonts.com - fixed width font downloads
BarCamp Orlando is this weekend
How to us CHDK to give your Canon digial camera RAW support
Cygnal - When Red5 just won't cut it for an RTMP server
IBM's CoScripter - automating web-based processes
AjaxWindows.com - Another Michael Robertson company
p0f passive fingerprinting IDS
Talking storage systems with Sun's ZFS team
SproutCore - a MVC scaffolding for actual Application development
Skype protocol obfuscation layer
Microsoft Silverlight and the Mono team at Novell join up to create the Moonlight project
Bitlbee - bridge IM client networks to an IRC channel.
EJBCA - The J2EE Certificate Authority
Mcell 3.5" drive has 1GB of DDR RAM 2.5" drive == 110MB/s transfer rates
OpenSolaris Xen domU with a linux dom0
Tentakel: distributd command execution
Ganeti: Opensource virtual server management software for Xen
Seemless dynamic image resizing
Mono and XPCOM scripting VirtualBox
podbrix young woz and jobs playset
Woz gets a speeding ticket for 104mph in a Prius
Google Starts Shared Storage Service
Storm Worm DDoSes scanning machines
Defendant wins access to the Intoxilyzer 5000EN Breathalyzer source code
How to replace graffiti 2 with the original graffiti on a Palm
customizegoogle.com - a firefox plugin for customizing google
I wrote this little whitepaper a while back for Amy Zunk to document the function of the VideoKeg/VideoJukebox boxes. Documented here for posterity.
The primary goal of the video keg was to build a reliable video box that was easy to transport with enough space to store 3 days worth of Anime fan-subs.
The secondary goal of the video keg was to make a home PVR system for video playback and time-shifting, along with a video arcade and perhaps a web browser.
The tertiary goal of the video keg was to find an affordable hardware platform so that we could buy 4 of them immmediately to service the primary goal's need for 4 separate video rooms.
For a PVR, the machine neeed to be small, quiet, low-heat, and still fast enough to run the software video player and arcade games.
For portability, we decided to go with a smaller mini-ITX style cube box.
The primary goal suggests redundant drives, but due to the smaller form factor chassis and heat requirements, it was decided that recreating a harddrive should one encounter problems would be a minor task.
Looking at the primary goal, mplayer seemed to suit the need of playing media with a variety of codecs with a minimum of fuss. Easy to script, easy to extend, low overhead, with the ability to normalize audio and clean up dirty videos - mplayer was simply ideal. This lead to the requirement of a ~1Ghz or greater box. The secondary goals would be served as well, though MAME would like a bit more horsepower for some of the more complex emulators.
In the end, we settled on a Chyang Fun Cellbox CF-7989EPIA (1Ghz EPIA-MII 10000) turnkey system with 128M of RAM, a Samsung 160G harddrive, and a DVD-ROM drive.
Once the boxes arrived, the decision at the time was which distribution to pick. If I'm managing more than one server for a given purpose, I like to use debian for package management. If this were a lone PVR box, I would have probably used Gentoo simply for the EPIA community support toward that end.
Starting off with Debian 3.1 Sarge, it was apparent a number of things needed fixing to get it to work with the embedded hardware.
Step 1, find patches and build a kernel.
Kernel patches
After roaming the net for hours, there really seems to be one good source for the latest in EPIA patches: the EPIA wiki:
The site has more of a Gentoo bent, but the patches work on a vanilla kernel just the same under debian.
CPU Optimizations
While building all packages, it seemed important to pay attention to optimizations to squeeze every last cycle out the 1Ghz processor. To that end, the generally recommended C3 Nehemiah CFLAGS are:
CFLAGS="-march=i686 -msse -mmmx -mfpmath=sse -Os -pipe -fomit-frame-pointer"
If you use gcc 3.3, there is a new arch designation for C3 Nehemiah CPUs:
-march=c3-2
Some in the commmunity think that the small 64k L1 cache on the C3 processors is causing starvation, and using -Os and not -funroll-loops actually helps performance:
CFLAGS="-march=i686 -msse -mmmx -mfpmath=sse -Os -pipe -fomit-frame-pointer"
Many others claim the following works best for them:
CFLAGS="-march=686 -O2 -pipe -fomit-frame-pointer -ffast-math -finline-functions -msse -mfpmath=sse,387"
As I was using gcc 3.3 at the time, and the middle ground seems less extreme, I went with -funroll-loops being bad, and back off to -O2:
CFLAGS="-march=c3-2 -msse -mmmx -mfpmath=sse,387 -O2 -pipe -ffast-math -finline-functions -fomit-frame-pointer"
MPlayer
Step one, after building an optimized kernel and loading the appropriate drivers, was to look at MPlayer and decide how to use it. There are video output drivers within MPlayer for the native Linux Framebuffer device, DirectFB, and X11 (XFree86/Xorg), among others.
Getting TVout to work with the viafb driver was tricky to say the least (more on that later).
Playing with mplayer for a while, it became apparent that the optimal playback CPU wise was using X11 with the Xv extension for video output.
XFree86 4.x/Xorg 6.8
Wether XFree86 or Xorg? This is really up to you. The Xorg project has some neat new things (like DRI enabled DDX) and a more "friendly" license that makes everyone happier. Newer distributions seem to be coming out with Xorg builds now, which is a problem for people who are forced to use older XFree86 binary drivers for their hardware (like ATI users).
For our purposes, the differences are moot. To that end, I decided to stick with the "debian way", and patch up the XFree86 4.3.0-dfsg package.
Video Driver
VIA uses their newer Unichrome chipset on newer motherboards, including the EPIA-M. Unforunately, VIA is horrible when it comes to OpenSourcing their efforts. You may download various binary drivers for specific versions and revisions of various distributions off of their VIA support site. There are also old video driver source snapshot releases floating about on there that simply won't work. Some have hacked at it and managed to get those old drivers working on newer handbuilt kernels, but it really isn't necessary anymore.
There is a sourceforge project now where development seems to be focused:
Occasionally, the unichrome project submits a release to Xorg for incorporation into their CVS repository.
There are a number of older drivers out there, along with HOWTOs on patching debian kernels with them.
The unichrome download page has a patch against the Debian XFree86 4.3.0-dfsg package.
DRI/DRM
The newer video driver also requires a newer DRM kernel module. The DRI project has split CVS off of SourceForge to freedesktop.org. You can visit the DRI wiki or the freedesktop.org site directly:
http://dri.sf.net
http://dri.freedesktop.org
Unfortunately, you can't use Debian's default xlibmesa-drm-src package.
To build the latest DRM drivers, I built a CVS snapshot.
Audio
Either OSS or ALSA would do. I'm a fan of ALSA however (newer code), and the debian alsa-driver package was a simple module addition to the kernel build.
$ module-assist auto-install alsa
The VIA EPIA-M motherboard uses the "vt8233" driver.
Writing the Video Keg
The video keg was based on a simple premise: always play video.
The first generation of the video keg was simple. Using a text file listing the filenames of video to play, loop through the list and run mplayer for each filename.
This had the unfortunate site effect of requireing a precalculated spreadsheet of the start time and length of every file in the list. As such, the posted times on the door to the video room would show a complex schedule that was suprisingly accurate.. until a video doesn't play correctly.
Watching 3 days worth of linear video watching for video that doesn't play correctly isn't for the feint of heart. This is the problem with Anime fan subs.
The second generation added scheduling element. If the filename starts with an equal sign ("="), there will be a command after it. Initially there will be one command, "waituntil". This command takes one argument, a time/date string to wait until.
When the video keg script is started up, it reads each line, waiting when appropriate. While waiting, it randomly plays commercials from a directory (sorted on number of times already played and length of playtime) and plays videos with play times shorter than the time available until the wait finishes.
As the keg knows the length of every video, it can calculate when it should be in middle of playback of something. If this is the case, the "-s" argument to mplayer is used to skip a calculated number of seconds into a video. This way, should a video keg lock up, crash, loose power, or otherwise stop, powering it back up will resume the video right where it left off.
If a video cannot play correctly, it dies or otherwise stops playing, and the next waituntil will wait with filler commercials. Brilliant.
Writing the Touch Screen
The "touch screen" box proved a new challenge.
Step 1: Find a touchscreen on EBay that will work with Linux. Step 2: ? Step 3: Profit.
The screen that arrived was an Elo Graphics touch screen with a serial interface. XFree86 already had a driver for it, so the no-brainer was to add a section for it in /etc/XF86Config-4:
Section "Inputdevice"
Identifier "touchscreen1"
Driver "elographics"
Option "Device" "/dev/ttyS0"
Option "AlwaysCore"
Option "screenno" "0"
Option "MinX" "0"
Option "MaxX" "4000"
Option "MinY" "0"
Option "MaxY" "4000"
Option "UntouchDelay" "3"
Option "ReportDelay" "1"
Option "SendCoreEvents" "true"
EndSection
Then include that as an inputdevice to the ServerLayout section (after your existing mouse):
Section "ServerLayout"
...
InputDevice "touchscreen1"
...
EndSection
Viola. We have a touch screen. The input is as if it were a mouse. This makes development easy.
Deciding on what to develop in was simply enough: Perl. Just as the video keg was hacked together as an overnight perl script frontending a set of bourne scripts for playback, the touch screen would be developed overnight using the same rapid development mindset... only...
I want themes. Users want eye-candy. The default Perl::TK widgets don't take to easy theming. What I really want is a way to theme widgets like GTK...
Enter Perl::GTK2. That was easy.
Time to write the script:
Put a banner of text at the top: "Metrocon Video Touch Screen Jukebox".
Put a play button and a progress bar.
Put a tabbed listbox of all available video (each tab as a letter of the alphabet, and 0-9, for quick searching).
Spawn mplayer to play back video. Watch the output of mplayer to update the progress bar while the video is playing.
Allow the user to select other video while the video is playing, but don't let them click "Play" until the previous video is complete (grey out the button).
Ah, but there is dead air between viewings, what can we do with that dead time?
Simple enough: add commercials.
Create a commercials directory full of video to play, and another directory to record how many times each commercial has been played. Between user selections, start playing from the sorted list of commercials that have been played the least. If the user clicks play, schedule their video to play after the current commercial finishes playing.
QED.
Add standard GTK2 themes. Enjoy.
Polish & Branding
To "brand" this as a drop-dead simple device, I spent a bit of effort making the boot sequence pretty.
Finding the award bios flash tool for the motherboard and the bios modification tool for changing the graphics, I built a DOS Boot Floppy (Bart's modular boot floppy) and burned it as an el-torito bootable CD. Making space for the new graphic ("Linux evil inside") required removing the rhine PXE boot ROM from the flash image (no real loss).
Patching the kernel with bootsplash shows another graphic up until XFree86 starts up.