ulmer.org

Empty Mail.app Outbox

Fri, 05 Sep 2014 20:30:00 GMT

Background

Users can extend the functionality of Mail.app for OS X by installing software packages called "Mail Bundles". I use three such bundes of joy on a daily basis:

Each of these is essential to my workflow, and not having one of them severely imapcts my productivity.

The Problem

One of them is broken, and none of them will admit it. The problem began after applying the OS X 10.9.3 update.

At irregular intervals, Mail.app will stop servicing the Outbox. That is, messages to be sent will be placed into the Outbox folder, and then remain there. I have my suspicions, but I'm not able to trace Mail.app's execution deeply enough to figure out who is repsonsible. The problem is not related to the system's network location, or the actual mail payload itself (that I can tell). Restarting Mail (usually) doesn't help.

Apple Support is essentially useless if there is a problem that's not a short between the keyboard and chair. Despite the fact that the problem had never once occurred previously and started literally minutes after updating to OS X 10.9.3, they washed their hands of it after determining that I could sometimes access my iCloud account. This is completly reasonable since no Apple programmer has ever made a coding error in recorded history.

While annoying, this did provide a clue: If the Mail Bundles are uninstalled the outbox immediately empties when Mail is restarted.

Okay, so the update broke something on which one of the bundles depends! I'll just contact the authors and submit a bug report!

Yeah... Not to easy.

I know it's not GPG Tools, because when that is the only bundle the problem never happens -- it has to be the Clip-O-Tron or Mail Act-On. Both of these are made by great companies, so I submit problems to both of them... and they both essentially say, "We're happy to help once you prove it's our Bundle."

Thanks, guys. If I had the tools to do that (like your source code), I would have just sent you a patch. How about you at least tell me how to run your junk in debug mode?

Solution

So failing any meaningful help or direction, what's left to do? Script it! Below is an AppleScript that:

Stops Mail.app
Moves the Bundles out of the way so Mail.app doesn't load them
Empties the Outbox folder
- Starts Mail.app
- Waits until the Outbox has no messages
- Stops Mail.app
Moves the Bundles back into place
Starts Mail.app

Restart Mail.app AppleScript

set mailDir to "Macintosh HD:Users:ulmer:Library:Mail" as alias

tell application "Mail"
    quit
end tell

waitForExit("Mail")

tell application "Finder"
    set the name of folder "Bundles" of mailDir to "Bundles.not"
end tell

tell application "Mail"
    activate
    repeat until not (exists messages in mailbox "Outbox")
        delay 1
    end repeat
    quit
end tell

waitForExit("Mail")

tell application "Finder"
    set the name of folder "Bundles.not" of mailDir to "Bundles"
end tell

tell application "Mail"
    activate
end tell


-- Wait until the process named as parameter is not running
on waitForExit(appName)
    tell application "System Events"
        repeat
            if not (exists application process appName) then exit repeat
            delay 1
        end repeat
    end tell
end waitForExit

Hazel Rule for Hurley Travel Receipts

Thu, 14 Aug 2014 05:38:00 GMT

This article is a specific implementation of the concepts discussed in Hazel for Expense Receipts.

This rule is specifically so I can report the cost of an airline ticket. My employer pays for the tickets directly, but we're still required to add them as a non-reimbursable item on the appropriate report. All other items in the itinerary get their own receipt from the vendor (hotel or car rental company, et cetera).

My employer has had more than one travel agent, but all of their documents have a very similar format. I suspect that all agents booking for American Express Travel (Concur) will have formats that are similar enough to adapt this rule.

I like to use the last leg of a flight as the date for reporting, in case the trip goes over the end of a month.

The document contains a table that has a row for each "travel event". So for each fight, hotel stay, or car rental there is a row. I've never had an itinerary where the last row wasn't the final flight, so I use that date -- your mileage may vary.

These are the details:

Notice that this rule matches two separate strings within the document. When we book with this travel agent, we get a confirmation of the request first, and once everythign is ticketed we get a second message with a real itinerary attached.

We have to look for a date (in the pattern below) that follows a word, comma, and space. The last occurrance in the file is picked because the search is configured to start at the end.

The for this match, I named the pattern to reflect what it matches. So two-digit month (zero padded), one digit day (no padding), four digit year -- all separated by slashes.

This just shows that you can reference the matched text from the "match" area in the "action" area.

Here we can see that the date pattern has been altered for use -- it's been re-ordered, and the day has been removed.

Hazel Rule for Hertz Receipts

Thu, 14 Aug 2014 05:31:00 GMT

This article is a specific implementation of the concepts discussed in Hazel for Expense Receipts.

This rule sorts an emailed receipt from Hertz Rent-A-Car into a folder named for the year and month of the last day of the rental.

These are the details:

We just check that the document is from Hertz, and then try to pick out the correct date.

We have to look for a date (in the pattern below) that follows the word "Date", a colon, and some amount of other text. The first occurrance in the file is used, because this is the date that the receipt was generated (which is always the last day of the rental).

The pattern for this match, which is named to reflect what it matches. So two-digit month (zero padded), one digit day (no padding), four digit year -- all separated by slashes.

This just shows that you can reference the matched text from the "match" area in the "action" area.

Here we can see that the date pattern has been altered for use -- it's been re-ordered, and the day has been removed.

Hazel for Expense Receipts

Mon, 04 Aug 2014 04:45:00 GMT

Hazel is a wonderful tool for automatically sorting files. In fact, I've written a family of rules that sort differnt types of receipts into folders for expense report backup. These rules are assigned to my Downloads folder, which is used as a "sorting folder".

Most of the expense document sorting rules have the same general recipe:

Identify the type of document (usually PDF)
Pick at least one unique text string
Somehow match the a date in the document contents that is used to determine into which month's folder it will be sorted.
If the file name is not already unique, rename it such that it (probably) is.
Move the file into ~/Work/Expenses.
Sort the file into a subfolder, creating it if necessary, with the pattern YYYY-MM.

Building HDF5 for OS X Mavericks

Fri, 14 Feb 2014 15:45:00 GMT

There aren't always Mac versions of binary distributions of OSS, so sometimes the package needs to be built with Xcode. This isn't a big deal other than that I try to maintain a repeatable installation discipline, and I like to be able to undo operations that are performed on my systems. The best way to accomplish this is with packages.

I needed to build HDF5 for a project. The Python bits are trivially installed with pip, but they depend on native libraries... so I set out to learn how to package the non-python dependencies.

Brew and macports just don't interest me right now. All told, there are probably less than ten things that I need to compile and maintain, so adding another package manger into the mix is just silly.

After some research -- maybe an hour total -- this is what I came up with:

SZIP

./configure --prefix=/usr/local
make
DESTDIR=$(pwd)/DEST make install

pkgbuild --root DEST \
    --ownership recommended \
    --identifier org.hdfgroup.szip \
    --version 2.1 \
    szip-2.1.pkg

HDF5

./configure --prefix=/usr/local --with-szip=/usr/local
make
DESTDIR=$(pwd)/DEST make install


pkgbuild --root DEST \
    --ownership recommended \
    --identifier org.hdfgroup.hdf5 \
    --version 1.8.12 \
    hdf5-1.8.12.pkg

Obviuously the first paragraph of each example just configures and builds an autoconf'd package. The second paragraph is the best invocation for the OS X native package builder that I could make before my attention span ran out. :) It literally just specifies from where to get the files, what the installed permisions should be, the name of the package for the receipts database and the name of the output (package) file.

This was not hard.

Zero Configuration Web Galleries

Fri, 31 Jan 2014 02:28:00 GMT

Background

Having migrated to static web generation, a full-featured web gallery system just isn't an option. I don't want or need an RDBMS to store meta-data, and there's certainly no reason to install an entire CMS framework just to pubish some pictures. However, having a four-year-old and a family that doesn't actually live in my back yard makes some kind of web gallery a necessity.

Yes, there are many picture sharing social media venues. All of them:

have terms of service that can change with little notice and no consent
have some kind of profit motive, mostly undisclosed
are conflicted between security and accessibility

So we're on our own.

Problem Domain

Our household is firmly planted in the Apple Computer ecosystem. (No, that's not part of the problem!) This means that we have iDevices, and that we use iPhoto and Aperture to deal with the deluge of "kid pictures."

Aperture is fine photo management software, and it is capable of creating "web galleries". That is, it has built-in templates that can be used to export self-contained, nicely-themed, chunks of web space that one can upload to their own server. Unfortunately, Apple doesn't make it readily apparent how to create your own templates. Also the system to generate the galleries is IMHO more complex than required by the level of flexibiity allowed.

I knew that I wanted a cool Lightbox-style slide show, but I also wanted something that would "just work" if I uploaded a bunch of pictures into a directory. Again, trying to avoid any actual processing on the server.

Solution Landscape

Lightbox Software

I eventually settled on Fancybox for two reasons:

It has user-definable callbacks for many events. I was hoping that some of these could be used by other software to pull captions (and other information) from the EXIF data in the pictures and display them.
It's based on jQuery, and the Javascript EXIF parser that I found also had a jQuery version. Sharing code is good.

I also looked at other implementations:

Lightbox2, which is the rightious sucessor to the original Lightbox.
Lytebox, because there was already a project to make use of EXIF data.

Meta-data Extraction

Part of the original problem specification was to get a "caption" out of "the EXIF data." This goal is mal-formed.

EXIF doesn't really have a place for a "caption" -- there is an exntirely different standard for shoving meta-data into digital photographs called IPTC - which was created by journalists.

Of course Aperture does "the right thing" and puts the caption in the IPTC payload, not the EXIF payload. I had found a Javascript implementation of an EXIF parser, not an IPTC parser. Yeah... so auto-captions will have to wait for another day.

Aperture Export

Most Lightbox software requires two images - a full-size version and a thumbail. In my case, I also needed a manifest of the images in order to have Javascript dynamically insert the appropriate elements into the DOM.

I created three presets in Aperture:

export settings for the full-size images
export settings for the thumbnail images
a directory export setting that put the output in "thumbs" under the target directory

Next, it was straight forward to build AppleScript that would export the current selection using those presets. It took a little fiddling to get the file names out of the list of version objects, but I evntually made it happen.

Solution

Gallery Export AppleScript

This is the AppleScript that exports the current selection into a selected folder in such a way that the Javascript can build the Lightbox:

tell application "Finder"
    set destination to choose folder
end tell
tell application "Aperture"
    set lightbox to first export setting whose name is "Gallery Lightbox"
    set thumbnails to first export setting whose name is "Gallery Thumbnail"
    set dirPolicy to first folder naming policy whose name is "Project Name"
    set thumbDirPolicy to first folder naming policy whose name is "Gallery Thumbnails"
    set oVers to selection as list
    if oVers is {} then
        error "Please select some images to export!"
    else
        -- need to exclude versions with referenced, missing master
        set verList to export oVers using lightbox to destination naming folders with dirPolicy
        set thumbList to export oVers using thumbnails to destination naming folders with thumbDirPolicy


        -- Write one file name per line to MANIFEST
        try
            set projDir to value of other tag "MasterLocation" of the first item in oVers
            set default_delimiters to AppleScript's text item delimiters
            set AppleScript's text item delimiters to ":"
            set manifest to open for access file ((destination as string) & (projDir as string) & ":MANIFEST") with write permission
            repeat with ver in verList
                write text item -1 of (ver as rich text) to manifest as rich text
                write (ASCII character 10) to manifest
            end repeat
            set AppleScript's text item delimiters to default_delimiters
            close access manifest
        on error
            try
                set AppleScript's text item delimiters to default_delimiters
                close access manifest
                return false
            end try
        end try

        display dialog "Export to " & destination & "complete."

    end if
end tell

Dynamic Gallery Javascript

This is the Jacascript that will build a Lightbox, given an export arranged by the preceeding AppleScript:

   $(document).ready(function() {
       $.get("MANIFEST", function(data) {
           var lines = data.split('\n');    // one pic per line
       var gallery = $('#gallery-container');
       lines = $.grep(lines, function(n){ return(n) }); // remove empty elements

           $.each(lines, function(lineNo, line) {
               $("<a />", {
           "class": "fancybox",
           "data-fancybox-group": "gallery2",
           "href": line,
           "html": $("<img />", {
           "src": "thumbs/" + line
           })
       }).appendTo(gallery);
           }); // each

       }); // get MANIFEST


       /*
    *  Simple image gallery. Uses default settings.
    */

       $('.fancybox').fancybox({
           afterLoad: function() {
           }, // afterLoad
           beforeShow: function() {
           } // beforeShow
       }); // fancybox
   }); // ready

Apache Configuration

In my web space, each gallery is a sub-folder of /pics. In order to avoid special set-up for each new gallery, we to do the following:

let mod_index create the list of galleries, prepending a header and appending a footer generated for the web site theme -- this is the only server-side "processing"
for any subdiretory of /pics, use gallery.html as the index file (for the index.html document or just the gallery location URL)

This .htaccess fragment accomplishes that:

Options +FollowSymlinks
IndexOptions NameWidth=*
IndexIgnore FOOTER* gallery.html

HeaderName HEADER.HTML
ReadmeName FOOTER.HTML

RewriteEngine on
RewriteCond %{HTTPS} off
RewriteRule (.*) https://%{HTTP_HOST}%{REQUEST_URI}

RewriteBase /pics
RewriteRule ^.+/$ /pics/gallery.html [L]
RewriteRule ^.+/index.html$ /pics/gallery.html [L]

Summary

It's not trivial, but all of the components are pretty simple. At least now I can spend my gallery management time curating pictures.

A Tale of Two Chickens

Fri, 13 Sep 2013 23:04:00 GMT

A while ago, I decided that I wanted to develop better skills for working with whole food products. Even though I had been cooking for years, I had never broken down a whole chicken before it was cooked! Also, we were spending way too much money on food...

Most food products can be acquired in a less processed form, but the easiest thing to tackle seemed to be chickens. By tackle I mean cut up, because it would be silly for me to actually chase chickens around and tackle them (unless we then proceded to eat them). At that time, we were buying bags of boneless, skinless, Individually Quick Frozen (IQF) chicken breasts from Sam's Club -- which is a convenient, but very expensive way to buy chicken.

So the plan was to buy and use two whole chickens a week. Prices increase during the winter, but for most of the year whole chickens cost about 99 cents a pound at our local supermarket -- so two chickens are about $10.

The chickens get broken down, and the wing tips, back, neck, and keel bones are frozen for stock. The leg quarters and wings are used immediately to cook-ahead some meals for the week. If I'm on the ball, the cooked chicken is pulled while it's still hot and the roasted bones go into a different bag in the freezer for stock. The breasts get deboned, vacuum sealed and frozen for future use.

That's 8 chickens, or $40, per month. From that, my family gets:

16-18 meal portions, depending on the application (leg quarters and wings)
2-3 gallons of home-made chicken stock (all of the bones)
Equivalent of 1.5 bags of IQF chicken breasts (deboned breasts)

That makes the leg quarters about $2.25 per meal. Now thats not the best food cost, but it's so much less than we were paying before... and that doesn't even take into account the $60 worth of chicken breasts and stock!

So far the favorite applications for pulled chicken seem to be:

Just eating it (usually the first day)
Enchiladas
Chicken noodle soup (with homemade stock)
Quesadillas

TSA "Response" to my complaint

Fri, 27 Jul 2007 22:45:00 GMT

This is a copy of the response I received from the TSA about my complaint:

Thank you for your e-mail.

The Transportation Security Administration's current security screening procedures require all carry-on luggage and accessible property be screened before passengers take them onboard an aircraft. Regardless of whether an item is on the prohibited or permitted items list, the Transportation Security Officers (TSO's) have discretion to prohibit an individual from carrying an item through the screening checkpoint or onboard an aircraft if the item poses a security threat.

Therefore, TSA security screening personnel make the final decision on whether to permit items like a Tide pen into the sterile area of the airport. Should you need additional assistance, feel free to contact us at toll free 866-289-9673.

Please visit our website at www.tsa.gov (http://www.tsa.gov/) for additional information about TSA. We continue to add new information and encourage you to check the website frequently for updated information.

We hope this information is helpful.

TSA Contact Center

My TSA complaint

Fri, 27 Jul 2007 13:30:00 GMT

This is the copy I received of the complaint I filed using the free wireless access from the secure area of the Gainesville, FL (GNV) airport.

To: tsa-contactcenter@dhs.gov
Category: Complaints
Sub Category: All Other Complaints

Message:

While passing through security at the Gainesville Regional Airport (GNV), my Tide(R) pen was confiscated from my quart zipper-top bag by a TSA agent.

When asked why, I was told that bleach was not allowed on the airplane. When I pointed out that the product does not contain bleach, I was told that all hazardous substances were not allowed. I asked that about the soap and water inside the Tide pen was hazardous, and was told to "get going".

I can understand an agent at a busy airport having a bad day -- but GNV is by no means busy, the TSA checkpoint was (over)-fully staffed, and there was no reason to confiscate my item.

It is very clear to me that the agent made a mistake and then didn't want to admit to that mistake in front of his co-workers or a customer, there was very little that was professional about out interaction.

I have the right to understand why items are confiscated form me - particularly common items that I have flown with -- form the same airport, with the same agent checking my bag -- dozens of times.

Please educate your agents, and maybe start looking out for security rather than buys-work.

Regards,
Stephen Ulmer

Remember, Federal is Professional...

Fri, 27 Jul 2007 13:10:00 GMT

Yet another example of idiocy provided by the Transportation Security Administration (TSA): While travelling from Gainesville, FL (GNV) to Atlanta, GA (ATL) on Delta airlines, my Tide Pen was confiscated.

Why am I angry about this? Well, I can tell you it's not because of the $4 that my government has illegally confiscated -- if that bothered me I'd make a FairTax reference. No, I'm angry because the reason that my Tide Pen was confiscated is because the dolt of a TSA agent arbitrarily decided that he was going to take mine. That's it. More you say?

So the agent looks at the items in my 1 qt. zipper-top bag, removes my Tide Pen, and then tells me that I can't have that in the airport. When asked why, I was told that you can't take bleach on an airplane. Well duh. So I pointed out that the confiscated product did not contain any bleach what-so-ever. I was then told that all hazardous substances were banned form airplanes. Okay. So i asked what about the product was hazardous, and if the rules had been change recently. That was when I was told to move along. So the guy who has probably just figured out that he is a federal employee has refused to answer my question.

While cro mangon man was pointedly ignoring me, I asked to speak to a supervisor. It was at this point he told me that I should move along or face arrest. For asking a question in a not-busy third-tier airport after having been deprived of my property? Arrest?

Had I been traveling under different circumstances, I might have called his bluff -- I could do with owning where-ever this guy lives...

Renewed Interest in Music

Sun, 09 Apr 2006 04:00:00 GMT

I listen almost exclusively to talk radio and music to which I've danced. Of course there is the occasional southern rock band, or novelty record. Okay, lots of novelty records...but I digress.

WSKY, 97.3 FM, is a local News/Talk station in Gainesville, FL. Some of the local jocks had been using tunes by The Right Brothers as bumper music. Well one of them managed to get the the whole band (both of them) as guests on an afternoon show. They're hilarious! In particular, I like their song, "What About the Issues?" (free download)

They composed this song after getting several thousand emails, of which only two were interested in having an actual persuasive discussion -- the rest were just as you might expect from the title. Their music seems to be varied in style: I would describe some of it as metal and some as country (go figure). These guys appear to be real musicians -- not synthesizer pilots. They lyrics are what you might expect if Rush had had Neal Boortz writing their songs instead of Neil Pert -- well, if Boortz had been introduced to them before Libertarianism had taken over his entire brain.

Come to think of it, I'd like to hear a collaboration by those two...

Sell Me What's On the Label!

Mon, 13 Mar 2006 04:00:00 GMT

One of my pet peeves is when a store tries to hide the fact that they're selling me a returned item.

Now don't get me wrong, I'll buy the price-reduced open-box item at Best Buy before I'll buy the new one. However, in that case, the store actually lists what's missing from the package. At the very least, they've marked the item such that I can compare it to a new one and decide for myself if I'm willing to accept it instead of a new one.

I went to the local Lowe's Home Improvement Store yesterday to buy some sandpaper. I picked up a roll of adhesive backed paper that's labelled "4 1/2in x 10yds, 120 grit" -- it's clearly a roll of 80 grit sandpaper. How can the person who accepted that return possibly be worth whatever they're paid to work there. I understand that not everyone is handy, but it's hard to mistake 80 grit paper for 120 grit paper.

But wait, there's more!

I pick up another roll of paper that's maybe 1/3 the size of the first roll -- and it has the same stinkin' label. Obviously these rolls of sandpaper can't be the same length! So I took both packages to the service desk and explained that I wanted to complain. After only 5 minutes of explaining I managed to convince them that maybe someone should go look at all of the paper on the display (I'm still pretty sure that they didn't understand that two identical products shouldn't be different shapes, sizes and weights).

So I came home and ordered everything I needed from Online Industrial Supply Corporation, who ironically has better prices.

My congressman isn't listening

Wed, 15 Feb 2006 04:00:00 GMT

I sent my congressman Representative Corrine Brown a request for support from the Fair Tax Website. Her reply (which was sent twice, 13 minutes apart) did not contain the word "tax" , and the only occurance of the word "fair" was in reference to the 2000 and 2004 elections.

Her response, clearly a form message, is only surprising in that it doesn't contain the word "tax" at all -- I'm surprised that any congressman is able to avoid that three letter word in a 606 word email.

I am also amused that it's 2006 and a point of focus for my elected U.S. representative is the 2000 Presidential Election. Shouldn't we, in the year 2006, look forward? How about focusing on something that I care about? Oh, wait! Maybe the thing I asked about, the Fair Tax!

It disgusts me that I might have to become a single-issue voter.

ulmer.org

Empty Mail.app Outbox

Background

The Problem

Solution

Restart Mail.app AppleScript

Hazel Rule for Hurley Travel Receipts

Hazel Rule for Hertz Receipts

Hazel for Expense Receipts

Other Articles

Building HDF5 for OS X Mavericks

SZIP

HDF5

Zero Configuration Web Galleries

Background

Problem Domain

Solution Landscape

Lightbox Software

Meta-data Extraction

Aperture Export

Solution

Gallery Export AppleScript

Dynamic Gallery Javascript

Apache Configuration

Summary

A Tale of Two Chickens

TSA "Response" to my complaint

My TSA complaint

Remember, Federal is Professional...

Renewed Interest in Music

Sell Me What's On the Label!

My congressman isn't listening