Libertarians Swinging Elections?

While reading the Economist I came across a very interesting article (I think you have to have a subscription to read it) about a study released by the Cato Institute describing small "L" libertarians as an overlooked swing voter.  Analyzing the data, Cato maintains that around 13% of the population fit into the libertarian category.  Most recently libertarians strongly supported Bush in 2000, 72%-20% but that support slipped considerably in 2004 to 59%-38%. 

My main concern is that to be a swing constituency the major parties have to first recognize you and second, reach out to you.  However, I do not see this happening on either side of the aisle during this years elections leading to my apathy this year for voting, and leading me to vote on the lesser of two evils basis (this philosophy will be explored in a future post).  The Economist said it best:

"Libertarians are ignored partly because they are hard to find, not least because they just want to be left alone. (There is a Libertarian Party, but it gets hardly any votes.) Politicians can reach social conservatives through churches or union members through their unions, but where do libertarians gather? Parties will always court the votes that are cheapest to court because, for once, they are spending their own money."