Category: Mac

Moving iTunes libraries from one hard drive to another

For the love of me, I don’t know how I ended up here again. The last time I moved my iTunes library to a bigger disk, I was able to use the Consolidate Library command and let iTunes do all the file moves. This time… not so much.

I was trying to do two things at once with this move: put all my music onto a larger external drive (a 1TB MiniStack from OtherWorld Computing. Can’t recommend the enclosure enough for form factor, ports, and reliability; my older 500 MB drive is in the same enclosure), and move to the new iTunes library layout, where there are separate top level folders for music, movies, podcasts, etc. This didn’t work, because partway through the process writing to the disk errored out. I quickly realized that the problem was that I was doing it over the network (the new 1TB drive and my older drive were both connected to my AirPort Extreme). So I directly connected the new drive via FireWire, left the old one on the AirPort, and tried to consolidate again. Only this time, it told me I didn’t have enough disk space. On the new 1TB drive.

What?

Then I realized what was going on. The restructuring of the library wasn’t moving files, it was creating another copy of the files on the same drive. I had started consolidating before I did the library restructuring, so now it was trying to write a second copy of all my music on the drive. Since I probably have about 515 GB of music to work with (some resident on my MacBook Pro’s internal drive), two copies weren’t going to fit on the new drive.

So now I had: a full copy of my library spread across the old drive and my hard drive; one partial copy at the root of my new drive; and another partial copy in the proper location in a Music subdirectory. I didn’t want to delete either of the partial copies because songs in my library were mapped to both locations; I couldn’t reconsolidate on the old drive for lack of space. But I still had over 160 GB free on the new drive, so I could probably copy over the missing files by hand.

So I’m going the manual route to clean up. First, I went to the Terminal and ran the comm command, which compares two text files line by line; I fed it the directory listings of the old external drive and the new final destination, and it spit out about 165 differences, directories that didn’t get copied from the old drive to the new one.

Second, I’m going line by line through the results of the comm listing. For each line, I:

  1. Copy the missing files from the old drive to the new one.
  2. Delete the old files from the old drive.
  3. Go to the matching tracks in iTunes and do a Get Info. Amazingly, since I’m copying the new files into the correct directory structure, a lot of the time I don’t have to do any more work and the library automatically finds the files in the new drive. Sometimes I have to browse one file at a time to link up to the new files, which is a drag.

I expect I’ll be done with the process sometime next week. Painful, but at least no data is lost. Then I can repeat with any files from my laptop’s disk, a much shorter list.

The final cleanup may take some XSLT fu. I will need to triple check the final library to make sure no tracks point to locations on the old drives. I’m going to try using XSLT on the iTunes Library.xml file to see if I can cull out the problem tracks that way; if not, it’ll be a matter of trial and error, because there’s no convenient way to find the file system locations of iTunes tracks from within iTunes itself, other than one at a time.

I’d love to have this be  a more error-free process. I’m beginning to think that iTunes libraries on external drives simply isn’t a well tested scenario by Apple.

Apple iPad: first reactions

Four reactions that I agree with (parts of) in response to Apple’s iPad announcement yesterday:

  • Doc Searls places the iPad in the context of vertical integration (apps all the way down to CPUs) and horizontal playing fields and says, “What you have to appreciate, even admire, is how well Apple plays the vertical game. It’s really amazing. What you also have to appreciate is how much we also need the horizontal one. The iPad needs an open alternative, soon.”
  • Dave Weinberger says that the iPad is the “future of the past of books” and says it’s missing interactivity and collaboration as key features.
  • John Gruber says that the iPad user experience feels like it’s all about speed, and says that Apple’s vertical integration play (the aforementioned Apple A4 chip) is responsible, and that “this is Apple’s way of asserting that they’re taking over the penthouse suite as the strongest and best company in the whole ones-and-zeroes racket” ahead of Sony, Nokia, and Samsung.
  • Michael at Cruftbox sums up the reactions of the rest of the world and says, “You’ll bang on about features, data plans, DRM, open source, and a multitude of issues. You’ll storm the message boards, wring your hands, and promise you won’t buy one till ‘Gen 2.’ The din will grow and grow as time passes. And then one day, in a few months, you will actually hold one and use it. And you will say, ‘I want one. Iwant one right now.'”

I think what disappointed me about the launch was not the device but the position it occupies. Jobs sees the iPad as occupying empty space in the consumer world between a PC (laptop) and phone. And there is probably room in that position. But the iPad seems also to be firmly positioned, at least for now, as a companion device. You sync it to another computer over iTunes. There’s no USB port or optical drive. It’s not going to be replacing anyone’s laptop any time soon.

And, frankly, that’s what I was hoping it would do. Because while it looks like it blows away its target use cases (web browsing, mail, calendar, gaming, music, book reading, even office apps), there are some very real use cases it doesn’t handle. And not just being a development platform. Like:

  • Preparing taxes (though Intuit could probably do a tax application for it)
  • Scanning documents (no USB port…)
  • Printing (ditto–though I wonder if it supports network based printing?)
  • Videoconferencing (no camera and no ports)
  • Organizing photos
  • Making a calendar or Christmas card

Additionally, I have question marks about some of the use cases that it seems to handle well otherwise. Like: can I point its version of iTunes at my 500 GB network drive and play music from there? How do the new iWork apps manage their files? (Remember, there is no user visible file system on the iPhone OS, on which the iPad is based.)

But, my quibbles aside, I have to confess that I’ve already talked with my wife about getting one. We’re pretty excited for the brave new iPad future. Because for most of what it does, it does beautifully.

iTunes Plus de-emphasized in iTunes Store?

Looking at the new iTunes Store experience in iTunes 9, I had difficulty finding any information about iTunes Plus upgrades, Apple’s offer that allows you to upgrade your old DRM-crippled protected files to the new “purchased” format.

Fortunately, it seems that the page is still there and working in the store, just not promoted. Bookmark the link…

Update: In the comments, David C. points out that the link is there, but it looks like it’s not loading reliably–it certainly didn’t ever load for me yesterday. The box in the upper right corner of the store loads progressively, and the bottom links (including iTunes Plus and Complete My Album) load after a delay.

Snow Leopard: Initial thoughts

I did the Snow Leopard upgrade last night, and it went OK.

First step was to back up my MacBook. It’s an exaggeration to say that it had never been backed up–I do, or did, regularly back up files to my .Mac iDisk, but rarely if ever did a whole system back up. A $99 external USB hard drive let me use Time Machine for the first time and I let that run for about three hours. Once it ran, I kicked off the installer and went to bed. (Yes, tempting fate.)

In the morning, I came down to the login screen. After login, about five copies of Software Update popped up, prompting me to install Rosetta so that “HP IO Classic Proxy 2” could run. I cancelled all of them, and went to HP’s site, where I found a suggestion that I didn’t need that driver, or any of HP’s software. Seems that the printer drivers are included in Snow Leopard, and scan support has been added to the built in Apple Image Capture application. Um, yay. Scan support from pressing the printer button is gone, but I never used that.

I couldn’t get my Cisco VPN working, but I should be able to get a later version of the client from work on Monday. Even better, I’ll be able to try out the built in VPN support once I turn up my connection file (it’s in a directory that’s not indexed by Spotlight, apparently).

Best of all? The update did free up disk space. About 11 gigs. Now that’s what I call a good upgrade.

Snow Leopard arrives Friday

You can now pre-order Mac OS X 10.6, aka “Snow Leopard,” at the Apple Store for delivery on Friday. I forgot what it feels like to be excited and waiting for a Mac OS X release, even what is admittedly a point release with a handful of features. Some of those features are pretty cool, though, like Exchange support.

I’ve decided to get ready for the new Exchange features by doing something I should have done a while ago: I created a new dedicated “work user” on my laptop for those times I need to get into the office from home, and locked down the account–deprivileged it, used File Vault for the home directory, the whole nine yards. When Snow Leopard comes out, I’ll hook that user’s Mail and Calendar into the office Exchange server over the VPN. Nicer experience than Outlook Web Access and still secure.

I think, though, that most of all I’m looking forward to getting up to 7 GB back on my hard disk.

Improving iPod FM adapter reception in a VW Passat

This one was counter-intuitive, but it worked. I’ve been suffering through static and interference ever since my Monster iPod FM adapter burned out and I replaced it with a different model. My Passat has the rear-roof-mounted antenna, and it’s apparently too far away from the FM adapter that I use for my iPod. It’s great at pulling in distant radio stations, which tend to swamp the empty channels that I’d normally listen to the iPod on.

So I removed it.

Yep, just unscrewed the antenna and now the reception for the iPod is crystal clear. Smart but totally counter-intuitive.

Credit goes to this anonymous poster on MacOSXHints. I read this a while ago and just today had the nerve to try it. No more static for me!

Recovering from an iTunes 13001 error

I hesitate to write this post, but since I found very few reliable aids for surviving this error, I’m writing it up in the hope that it will help someone else.

My MacBook Pro (first generation, dented side resulting in unreliable power cord connection, weak battery) shut off sometime overnight. Unfortunately, when I booted it back up, iTunes told me that the library file was corrupt. Given the size of my library and the fact that I’ve got somewhere close to 100 playlists, and that I just spent about two years going through and listening to everything at least once after the last library deletion, I freaked out.

Then I quit iTunes and started thinking. There are now quite a few files that constitute the “iTunes library,” including iTunes Music Library.xml, iTunes Library Extras.itdb, iTunes Library Genius.itdb, and iTunes Library itself. I knew from past experience that it was iTunes Library that held the playcounts and playlists, so I crossed my fingers, moved everything else out of the folder, and started iTunes. Now it started up, but when it tried to rebuild the Genius data, it told me that it couldn’t save it because of a 13001 error.

I did a lot of research, and through some trial and error I hit upon the following steps:

  1. I moved all my non-Apple codecs out of the Library/Quicktime folder. In my case, this was a DivX decoder and encoder, and three component files from Flip4Mac WMV. (This was nonintuitive; thanks to this Apple support discussion post for suggesting it.)
  2. I deleted the ~/Library/Preferences/com.apple.itunes.plist file. (This is iTunes preferences, including your default settings for importing and your library location. You’ll want to reset these at the end of the process.)
  3. I re-deleted the the iTunes Library Extras.itdb and iTunes Library Genius.itdb files.
  4. I temporarily moved my external music hard drive from my AirPort Extreme and attached it directly to my Mac. (This might not have been a factor, but I figured it would be a lot faster to get through the Genius rebuild if it didn’t have to do it over an 802.11g network connection. Yes, the MacBook Pro 1st gen only has an 802.11 card, alas.)
  5. I restarted iTunes and let it rebuild the Genius database all day.

When I came home, it had succeeded.

I don’t know if all these steps were necessary, but I do know that when I didn’t delete the preferences file or the codecs, rebuilding was not successful. Whatever: it worked.

Requiem for a dying iPod?

I’ve had three iPod-like devices since 2001, four if you count my iPhone. The first one was the classic iPod 5GB with the mechanical clickwheel (that was a happy Christmas day). The FireWire port famously broke on it, and I picked up a 10GB model in time for my cross-country drive. I bought a 30GB fifth-generation model in late 2006 when the 10GB model stopped taking a battery charge and developed hard disk problems. The iPhone followed in late 2007 (I wasn’t an early adopter, but I did buy before the 3G model came out).

And now? Well, last night I tried to sync the 30GB iPod about four times. The first time it copied 200 songs, then I couldn’t eject it from the OS and had to reboot and grab it and go. And none of the new songs made it over. The second time it synced successfully but the songs still weren’t there. I rebuilt the smart playlist that had the songs in them, resynced, and this time the sync hung iTunes. Finally I restarted both the iPod and the machine, finished syncing–and again the iPod refused to eject because iTunes claimed that it had files that were open from another application. When I finally got it free, the songs still weren’t there.

Based on what I hear on the Apple support boards, I probably have a bad hard disk in the little bugger, which is consistent with the “clunking” sounds I occasionally hear while it’s trying to sync. So, it’s gone. Maybe tomorrow, maybe in a month, but it’s on its last legs, because replacing the hard drive is not a cost effective move.

So the question is, what do I do next? I can only get a fraction of my 475GB music library on it, but that’s more than I could get on the iPhone, so going to the iPhone alone isn’t an appealing option. And paying $399 for a 32GB iPod Touch isn’t going to happen right now, either, as much as I like the form factor. (I’m a big fan of the scroll wheel but would go to the Touch in a second if price weren’t a factor.)  I don’t know if I can swing $249 for the 120GB “classic” model either, but it’s the only model that has a fraction of the capacity I’m looking for. We’ll see what happens.

Meantime, anyone have a good project that involves rebuilding a 5th generation iPod with a bad hard drive?

Sweating off the gigabytes

Since my budget doesn’t move as fast as the hard disk industry increases capacity, I periodically use OmniDiskSweeper to go through and clean a few gigabytes of dross off my MacBook Pro’s 80 GB drive. It’s necessary, because without going through the exercise, I end up with less than a gig of free drive space and everything grinds to a halt.

I don’t always remember where I find the disk space hogs, so this time I’m writing them down:

  • A mail folder for the Blogcritics mailing list: 899 MB. (This one was a surprise, since I’ve been religiously deleting the mails since I stopped regularly writing for the site, but there was a ton of old mail in there.)
  • Four iPhone software updates—I kept the last two or three there, but didn’t see the need for the 1.x updates or the first 2.0 one—about 800 MB.
  • The ~/Library/Caches/Metadata/Delicious Library Items folder. Appears to date to Delicious Library 1.0, since there’s also a Delicious Library 2 folder: 220.6 MB.
  • ~/Library/Application Support/NetNewsWire/Backups: old subscription lists, 289 of them: 90.9 MB.
  • ~/Library/Application Support/NetNewsWire/SearchIndex: last updated in 2005. 146.3 MB.
  • ~/Music/iTunes/Previous iTunes Libraries: three old copies from last year. About 250 MB.

What’s interesting this time is how little of this was real content as opposed to just old cache files. My free disk space now, even before a reboot (to clean up the VM and flush various other system caches), is up from 80 MB (yeah, I know) to 3.28 GB. Every little bit helps.

When your PowerBook G4 screen goes dark

I had a panicked call last night from Estaminet, whose PowerBook G4 laptop screen was going dark just seconds after booting up and staying dark. She had a paper due tomorrow morning. Could I help her out?

I have a karmic obligation to answer these kinds of support calls, considering that the lemon laptop in question used to be mine. So I Googled the problem while I talked her down. The most likely answer (though we’ll know for sure once she has it seen by a specialist) was that the inverter board went south. This is a hardware failure and can’t be remedied by poking about in the system, but since it’s confined to the video subsystem the rest of the PowerBook was still working.

Racking my brain to figure out how to get her paper-in-progress off the machine, I had her try a tip from the MacOSXHints forum: shine a bright light, like a flashlight, directly at the screen to see what the computer is doing, then turn on iChat. I then sent a screen sharing request, which she was just able to see and accept, and then I saw her whole desktop clear as day on my machine. I fired up Firefox and Gmailed her paper to her so that she could work on it on another machine.

So, in summary: iChat screen sharing is your friend if your screen fails.

Reunion on the iPhone: Genealogy on the go

reunionI got an email from someone the other day asking about one of my ancestors (Andrew Hershey, 1702-1792). I get this sort of email all the time, since my family tree is online, and normally I’d have looked up the answer to the questions and emailed back. The problem was, I was on my iPhone and didn’t have access to my detailed genealogy research. I found myself thinking, I wonder if there’s a good genealogy app for the iPhone. Maybe something that will read my GEDCOM export and display it nicely. It would be really great if Reunion were on my phone, though.

So I hit the app store, and the first app in the search results for genealogy was … Reunion! Leister Pro has done an iPhone client that allows you to bring your genealogy data with you, and sync it back to your Mac when you’re done… sort of.

I have about 4000 records in my family data, and opening and browsing it is quick and painless. The UI is splendid, taking all the best parts of the Reunion “family card” display and porting them painlessly to the iPhone. Images are supported, and the experience is almost like sitting in front of my Mac.

There was one glitch I encountered–somehow my sources data didn’t seem to move from my Mac, something I’ll need to investigate further–and two missing features. On the iPhone it would seem natural to provide the ability to add a photo from the phone’s photo list or from the built-in camera to an entry; neither is currently supported. And the app relies on a Bonjour based syncing strategy — turn on your phone, click a button on your Mac, and the syncing happens over your WiFi network — that happens separately from the phone’s main sync loop. Based on your opinion of iPhone syncing, this may be a good or bad thing, but surely there are other sync methods available that wouldn’t require a separate action.

Right now these are quibbles–I’m generally very pleased with the app, and thrilled Ididn’t have to find a new genealogy app just for the iPhone.

Is it new MacBook time yet?

I have a  feeling, like a disturbance in the Force. It’s the feeling I get when it’s time for a new Mac.

I’ve been a Mac user for a long time… since my first year of undergrad, when my dad splurged on the best Mac ever made, the SE/30, for me. I’ve had, including the SE/30, two desktops and three laptops since then, as follows:

Machine Purchased Duration Fate
SE/30 September 1990 5 years Given to younger sister; recycled
Power Mac 7200/90 ca. October 1995 ca. 5 years Given to father; recycled
PowerBook G3 (Pismo) August 2000 2 y 11 mo Given to younger sister; then to cousin
PowerBook G4 1GHz July 2003 2 y 9 mo Given to younger sister
MacBook Pro 1.83 GHz March 2006 2 y 10 mo to date Current

So there have been a lot of machines and my laptops have been lasting a little under three years; why? Two words: case problems and capabilities.

The G3 was great; had no problems with it other than having to replace the power adapter four times. But when we moved out west to Seattle we decided that we’d keep in touch via videoconferencing, so upgraded to a machine that could handle video on iChat. The G4 had terrible case problems–a hinge stuck, then broke the bezel when it got forced open–and also had power adapter problems. We fixed the case and upgraded to a MacBook Pro when they first became available.

The MacBook Pro has been great; except… well, it got dropped. It landed on the side where the power connector was, which dented the case near the power connector, making it difficult for the MagSafe to function properly. It charges but you have to fiddle with the connection, and lately it’s been turning itself off. Plus, I haven’t been able to prune the data on the hard disk enough to keep more than 3 GB free at any given time, meaning the machine is prone to slowing to a crawl.

The cost to me to repair the case and the power board was quoted by the Apple Store as a minimum of $500, and I’m thinking very hard about doing that. But I’d also want to replace the hard drive, and that starts to bump up the cost close to the lowest-end MacBook.

Yes, MacBook. For the first time, I think that my needs are converging on Apple’s consumer line rather than the Pro line. The MacBooks are much more capable than they were three years ago, and I’m no longer doing the sort of programming that made me want a faster machine then. And I’m not sure that spending an additional $600-$1000 would give me a comparable increase in value. There are numerous side-by-sides that attest to this (Gizmodo, MacRumors, Engadget). The main issue appears to be the screen in the MacBook, and I’m going to have to go in and look at it to decide if that’ll be OK. (I don’t watch DVDs on my laptop much anymore, but I might be watching more TV there.) There’s also no FireWire support, and no card slot to plug in an expander–a problem if we want to keep using our ca. 2000 digital video cam. And there doesn’t seem to be a way around that, so we might have to keep the old Pro around just to do video.

We’ll have to think a little more about it, I suppose.

Macworld Keynote 2009

It’s not going to be a Stevenote (and on that note, best wishes to Steve as he gets his hormones back in balance and gets some protein in his system). But I’ll be watching all the more closely, to see how Phil Schiller takes on the challenge of igniting excitement in the Mac faithful. Like many product managers, I have picked up a few tips about presenting product over the years from Steve, and Phil will have his own style and his own techniques which I can hopefully also snarf.

Product predictions? I like John Gruber’s, and can lend credence to the iLife prediction because I finally got the most recent version as a Christmas present. Pretty sure there won’t be any new iPhone products announced today though (outside of the iPhone version of Delicious Library).

I’m pretty sure that Apple won’t be announcing the Mac Wheel today, though (hat tip to Chris Eng for the pointer):

Apple Introduces Revolutionary New Laptop With No Keyboard

Stupid breakage of the day: Ubiquity and MobileMe

This morning I tried to log into MobileMe, which has mostly been working well recently, and got an unsupported browser screen telling me I needed to be running Firefox 2 or later, or Safari. Only problem was I was running Firefox 3.0.5.

I figured it was a bug in MobileMe’s browser check logic, so I used some JavaScript to check what my browser was reporting as its user agent:

javascript:document.writeln(navigator.userAgent)

It told me I was running

Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.5) Gecko/2008120122 Firefox/3.0.5 Ubiquity 0.1.4

Looking at the user string, I wondered if all the addons at the end, in particular the Ubiquity one, were breaking the browser check. So I disabled Ubiquity and restarted the browser. But the user agent string still showed Ubiquity.

I had just updated to the newest Ubiquity release this morning and was starting to think that something in the add-in was causing the problem. So I uninstalled it … and the user agent string was still the same.

Now I was curious. Did it leave a setting behind that the uninstall didn’t clean up? I looked under the hood in the browser preferences at about:config and searched for Ubiquity, where I found a very interesting preference under general.useragent.extra.ubiquity. There didn’t seem to be an option to delete the key, so I simply set its value to an empty string.

Doing the browser check now reported

Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.5) Gecko/2008120122 Firefox/3.0.5

And I could log into MobileMe again.

Lessons:

  1. Uninstalling an add-in doesn’t always totally uninstall it.
  2. You might be better off without Ubiquity.
  3. Apple needs to fix the MobileMe browser check (aka Trampoline).

Notebook lust: the new MacBooks

My first generation MacBook Pro, purchased back in 2006, is starting to look a little long in the teeth. The basic machine has been just fine, but I knew when I bought it that 80 GB wouldn’t be enough disk space, and the battery is coming perilously close to the end of its lifecycle; I now get maybe 30 minutes on a full battery.

More damningly, there’s a power cord issue (and if you’ve followed my Mac experience through three Apple laptops over the past eight years, this shouldn’t be a surprise). MagSafe eliminated the problem I had on old machines, where the cable would break or fray. Unfortunately, I found a whole new problem with the design: small beings can knock the laptop off the table or chair where it’s sitting, and if it falls on the side with the MagSafe connector, the case dents around the power cable and makes it much harder for the power connection to complete successfully.

All of which means that the new MacBook Pro looks pretty good right now. Killer graphics, more capacity, AND a case carved of solid aluminum that I would bet is much more dent resistant.

But you know? The new MacBooks are also solid aluminum cases, have more capacity than what I have today, and are about $700 cheaper than the MacBook Pro. And increasingly what I’m thinking is a lower end laptop and a dedicated home media computer (or appliance) is the way to go rather than trying to drive everything off one machine. Unfortunately, this is the wrong part of the stock market cycle to make that happen, but it’s a dream I can have.