How to Manage Large Image Libraries with iPhoto 2
by Derrick Story, coauthor of iPhoto 2: The Missing Manual06/17/2003
A question that I hear often at iPhoto workshops and user group meetings is, "How can I manage large image catalogs with iPhoto?" It's widely known that iPhoto bogs down when picture libraries swell to multiple gigabytes in size. And since 4-megapixel cameras (and larger) are commonplace these days, it doesn't take long to top off your hard drive with pictures, especially since it's already brimming full of music and movies.
Fortunately iPhoto 2 includes a few key improvements to help manage large image catalogs. In this article, I'll show you how to combine these enhancements with some third-party applications to build a robust solution for handling mountains of snapshots, scans, and illustrations.
The Importance of Optical Media
You'll notice that when you're in Organize mode, you see the standard Apple Burn icon in the lower right corner of iPhoto 2. This new function is vital to my strategy for managing and archiving image libraries.
Prior to iPhoto 2, the only way you could burn a Photo Library to optical media was to do so at the Finder level. And once you did, iPhoto could not read your Photo Library directly from the CD or DVD. Therefore you had to copy the library back to your hard drive, rename it, then relaunch iPhoto. What a pain in the USB port that was.
But things have changed. You can burn entire libraries, or portions thereof, to CD and DVD from within the iPhoto application. And what's even better is that you can later use those libraries directly from the disc without having to copy them to your hard drive and relaunching iPhoto. Now your disc of images appears right beneath your Photo Library much in the same way a CD appears in iTunes.
|
|
|
|
|
Before I explain any more about the strategy for managing massive volumes of pictures with iPhoto, I should say that if you're serious enough about digital photography to have this many images, you probably should get a Mac with a DVD burner built in or at least purchase a third-party unit that you can plug in. I find that the limited capacity of CDs (700 MB) is impractical for storing image files, especially compared to DVDs that are the same size, but hold 4.7 GB. The name of the game is efficiency, and DVDs are just better for digital photography.
Regardless of which type of optical media you use, I recommend that you take advantage of this new feature in iPhoto 2. You could store all of your Photo Libraries on a separate FireWire hard drive. In fact, that's exactly what I do. But those are strictly my working libraries. I also have all those images on DVDs for archiving purposes.
You don't want to risk losing all of your pictures to a hard drive crash. And if you want to share a particular library with someone else, or among your own machines, it's much easier to hand over a DVD than schlep around your massive FireWire drive (iPods being the notable exception). More on all of this later.
Limiting the Size of a Photo Library
If you have a DVD burner, you can let your Photo Library swell to a little over 4 GBs before archiving it to disc and cleaning it off your hard drive. But even with the most powerful Mac, that's too much information for iPhoto to handle with speedy efficiency, or even sluggish efficiency.
More powerful machines such as the current dual processors should be able to manage libraries up to 2 GBs. If you notice performance degradation with that many photos, then scale back the size of your library accordingly. All modern Macs should be able to handle at least 1 GB image libraries.
As your library grows, I recommend that you use intermediate back ups to a separate hard disc. Simply drag your iPhoto Library folder located inside your Pictures directory to the hard drive. If you're managing multiple libraries with iPhoto Library Manager, then be sure to keep them all backed up as you make changes to them. You can also burn parts of your library to CD, but that's a much slower process.
Once your Photo Library has reached the size where performance is beginning to lag, then use the burn function in iPhoto 2 to copy it to your archival media. I recommend that you make two copies: one for home and one for a remote location. If something unforeseen happens, you won't lose your entire image collection.
|
|
Add Metadata to Your Photo Libraries
As you'll see when I pull all the pieces together, a key part of this strategy is being able to search across discs to find the one containing the pictures you're looking for. The best way to create searchable data is to make custom albums, create unique names for your pictures, and add text to the comments field. This forces iPhoto to include this data within the Photo Library enabling you to catalog it for retrieval later.
As a related note, your camera creates lots of metadata on its own. Make sure your date and time are set correctly so that it records accurate information. For more on the value of camera metadata, see my article, Use Metadata to Improve Your Pictures.
Find Good Cataloging Software
Now the pieces of this strategy are starting to come together. You have iPhoto libraries full of searchable data stored on high volume DVDs (and possibly FireWire drives, too). When you want to find a particular photo on one of these discs, how do you do it?
Personally, I like CDFinder by Norbert Doerner for cataloging and retrieving my discs. The application will also catalog hard drives and other media, so it's quite versatile.
As with any search tool, the better information you've included with your images, the easier it will be to locate them. If nothing else, create custom albums for your various photo shoots. If you have time, add data to the Comments field too. By doing so, you give CDFinder, or whatever app you're using, a decent chance of returning accurate results from your search.
Pulling It All Together
OK, you have your tools in place, here's how to build your system:
Add lots of metadata to your picture libraries.
When your library size grows to the point that iPhoto performance begins to lag, click on Photo Library to highlight it, then click the Burn button (while in Organize mode).
Enter a distinct name for your library disc in the Disc Name field. See Figure 6.
Figure 6. Enter a name for your library disk.Click the Burn button again to begin the writing process. I recommend that you burn at least two discs and store one in a separate location.
Test all discs by inserting them into a computer with iPhoto launched. The disc should appear in iPhoto as shown in Figure 7. Note that in iPhoto the disc has the distinct name you gave it, but in the Finder it simply says iPhoto Disc.
Catalog your newly burned disc with CDFinder or an application of your choice. As mentioned previously, the default name for the disc will be iPhoto Disc. Once it's cataloged, rename it in CDFinder to the custom name that appears in iPhoto.
Store the disc in a 3-ring binder with optical disc inserts. Make sure the binder and the discs themselves are clearly labeled with the same names you entered in CDFinder.
Quit iPhoto and drag the iPhoto Library folder (inside of your Pictures directory) to the trash. When you relaunch iPhoto, it will create a brand new iPhoto Library folder that you can populate with fresh pictures.
When you need to retrieve a photo, launch CDFinder and search using keywords that you likely used for album names or in the Comments field. This is where labeling your discs on the outside is important so you know which one to pull once CDFinder gives you the search results.
Pull the disc from your storage binder and insert it into a computer that has iPhoto launched.
Use the image as needed.
|
|
How to Handle Scanned Images
If your photo management process includes using scanned images, you can tweak the process I've outlined with just one minor adjustment.
I recommend that you organize your scanned images in the Finder and create folders for them with descriptive names. Then all you have to do is drag each folder to the Photo Library column in iPhoto, and the application will import the images and create a custom album with the same name as the folder containing the original images.
I usually burn those organized master images to DVD, just for an added measure of protection. For many this is overkill, but I like having these original scans that's never been touched by any application.
Final Thoughts
Many people seem surprised that I use iPhoto 2 for my photography business. I've tried different methods over the years, and of course I'm still keeping an eye on new applications to handle these tasks.
The reason why I've stuck with iPhoto is because I really like the variety of output options, such as web pages to my .mac account, client CDs using the BetterHTML plug-in, one-click print ordering, custom linen books, and QuickTime slideshows. I also like the iPhoto interface and am comfortable with the way it handles my picture metadata, both created by the camera and the additional information I enter via custom albums and the Comments field.
|
Related Reading iPhoto 2: The Missing Manual |
And now that iPhoto 2 is AppleScriptable (see my article, Automating iPhoto 2 with AppleScript for more details), iPhoto makes even more sense as the central repository for all of your digital images. I use an AppleScript to automate Photoshop adjustments to my iPhoto images. It works fabulously.
But no matter which system you use for archiving your digital images, please stay on top of it. Losing a Word document is bad enough, but letting a hard drive crash steal your precious photo memories is a heart-wrenching experience you'll want to avoid.
Derrick Story is the author of The Photoshop CS4 Companion for Photographers, The Digital Photography Companion, and Digital Photography Hacks, and coauthor of iPhoto: The Missing Manual, with David Pogue. You can follow him on Twitter or visit www.thedigitalstory.com.
Return to Mac DevCenter.
You must be logged in to the O'Reilly Network to post a talkback.
Showing messages 1 through 19 of 19.
-
How do you delete images to save hard drive space?
2004-02-10 14:31:48 rocketgir1 [Reply | View]
Hi there,
I find that when I shoot, I generally want to delete about 75% of all the pictures I shoot. This not only helps keep my image repository clean and easy-to-browse-through, but it helps keeps down the size of my image files. (I've already amassed about 20 gigs of images!)
So far, I've been avoiding iPhoto because it doesn't seem to give you the power to delete images off your hard drive easily. For instance, when I go into my picture directories, I see folders labelled "Originals" -- does iPhoto store a second copy of all my images there?!?! That's going to be a lot of wasted storage for me!
Can anybody explain iPhoto's storage hierarchy to me? Do you have any suggestions for file management?
Thanks,
Kathy
-
Question regarding viewing thumbnails
2004-01-18 21:20:52 anonymous2 [Reply | View]
Derrick,
I'm a relatively new user to the Mac, so the article helps out a ton.
I had a question that has been bugging me for some time. In iPhoto, I have been rotating all of the verticle pictures, as they show up initially horizantal on iPhoto. After rotating the picture 90 degrees, when I go to the iPhoto library on my hard drive, I have noticed that all of the "unaltered" photos have the actual picture as a thumbnail. However, all of the pictures I rotated don't have pictures as thumbnails, but rather have "jpeg" as the thumbnail. This is annoying if I am looking for photos from the hard drive to use for other applications.
Is there anyway to change this? Please let me know if you have any suggestions. Thanks.
-
Library Mgr. download shut down
2003-11-18 22:57:07 donbmix@yahoo.com [Reply | View]
Help me please. I went to your site to download the Library Manager and it shut down most of the programs on one side of my partition. Email, iMovie, Explorer and other things won't work. How do I fix this?
-
How to get iPhoto to recognize .jpg pix
2003-09-27 13:42:19 anonymous2 [Reply | View]
I have about 70 pictures of granddaughter’s trip to Sequoia Park in what I believe to be the correct locations, with the suffix .jpg for each, but somehow iPhoto does not recognize them, which is what I want. I can view them in Preview or Photoshop Elements. I hope you have a suggestion. I have tried to follow the instructions in "iPhoto 2: The Missing Manual" dealing with an alias in Pictures and renaming the alias to iPhoto Library. (If you need more information to respond, I can provide as much detail as you would need). iPhoto 2, iMac, OS 10.2.6, lots of RAM.
FUNDAMENTAL QUESTION: Is there some way I can export (or copy, or something) those pictures to somewhere so that they can be imported (or something) into iPhoto?
-
Changing bytes
2003-09-11 09:38:56 anonymous2 [Reply | View]
I tried to burn a backup CD but ran into a problem with the amount of data being written.
When I clicked on Photo Library the info below the library/album window said 840 photos and 606 MB. But after iPhoto 'prepared' the blank CD I inserted for burning, the info panel listed 840 photos and 738 MB - too big for a standard CD.
I first thought this might be due to having some photos appear in multiple albums but remembered that only aliases of the photos are created, not actual file copies.
Does anyone have any ideas on the increase in total size?
Thanks.
-
managing the library
2003-09-06 17:06:11 anonymous2 [Reply | View]
This article was so helpful. I'm left with one question. I will make new libraries for new pictures but can I segment my big slow library into new libraries so I can work with it?.
-
Managing large picture libraries
2003-09-01 07:47:26 anonymous2 [Reply | View]
I appreciated your article on iPhoto 2. I recently switched from OS9 to OSX, at which time I looked at iPhoto 2. I did notice how iPhoto bogs down with large libraries. The article does not mention why this happens, but does suggest how to work around this problem.
My recommendation, not mentioned in the ensuing discussions, is to use Extensis Portfolio, with which I manage a library of over 30,000 pictures under OS9 or OSX. Not only does the catalog not bog down under such a large collection, but I feel Portfolio also provides the various output possibilities which some iPhoto users require.
Another thing I find undesireable about iPhoto is its cryptic method of filing the pictures into myriad subfolders. I much prefer the Portfolio method, which leaves untouched the user's filing system.
Comments?
Mark Lulham
lulham@yahoo.com
-
Solutions Wanted for Managing Large Multi-Media Libraries on My G4
2003-06-25 11:14:38 outlawv [Reply | View]
Great article and the tip for creating import/album creation from a Finder folder worked great. Even when the folder had other media in it. Which leads to my question (which you may have previously answered)...
Is Finder my best bet for managing large multi-media libraries? I am not only capturing photos of events, but with my digital camera I additionally capture audio captions and quicktime movies. I eventually want to merge them all using iMovie, but I want to also utilize them in iPhoto (as I did above) and iTunes (for building soundtracks from the audio captions, for instance). Are there any tips for managing these and getting the most out of the iLife applications that can use them?
Thanks for all the great articles and such.
VO
-
myPhoto
2003-06-22 21:26:26 anonymous2 [Reply | View]
http://agent0068.dyndns.org/~mike/projects/myPhoto/index.php
Taken from the web site ....
"... Not all of us want to tell iPhoto to export our photo album to HTML now that we've added a new photo or two to the collection. ..."
".... myPhoto is a PHP program that will generate a full-featured photo album on your web site for you. .... "
"... No exporting every time you have new photos you want to put online. No subscriptions. No messing with HTML or learning how to make a web page. Once installed, it requires no work on your part to keep your photo album on the web up-to-date.... "
"... Install. Take photos. Share. As simple as that."
-
editing before import to iphoto
2003-06-19 10:50:59 mr_magicfingers [Reply | View]
Hi Derek,
very interesting article, and one that was very timely for me, as I'm getting to that stage now.
One thing that I wanted to ask you, as you're a pro photographer, do you do your editing (photoshopping) etc before importing the images to iphoto.
As a new entrant to the world of digital imaging, It seems to me that I would want to do all my deletions and editing/levelling etc in photoshop (elements 2) using the it's own browser before importing the folder full of final images to iphoto. The originals go on a separate cd/dvd for archiving.
Just wondered what your opinion was.
Many thanks,
Justin Peer.
-
Create Disk Images of Your CD's for Quicker, Easier Access
2003-06-19 10:13:16 anonymous2 [Reply | View]
Derrick,
I've taken the extra step after archiving selected albums as you described above to then make a Disk Image of the CD archive using Disk Copy. That way I can keep the Disk Images on my home file server so my wife can access the files any time she wants without having to go and retrieve a CD. This serves the dual purpose of cutting down iPhoto's library to increase performance but at the same time keeping the images easily accessible.
When you mount the disk image, it comes up in iPhoto just as it would when you insert the CD. I've even started to do the archives using a CD-RW disk that can then be erased and reused. That way I can create many smaller archives that I then burn onto a DVD as an emergency backup.
Just thought someone else might like this idea...
Brian
-
Photo Rolls don't show up on burned CDs!
2003-06-18 22:18:20 anonymous2 [Reply | View]
Hi, Derrick --
Very nice article, thanks. There's one problem that makes iPhoto's CD/DVD archives much less useful in my view: the "Film Roll" separators are lost! Regardless of how many "rolls" a burned CD may contain, it appears as one huge, unsorted library. True, the photos are in the same order as the original rolls; but I use the roll titles as a way to organize my photos (at a more basic, chronological level than Albums), and it's really a pain to lose those.
Anybody have any idea why this happens? Or better yet, am I wrong -- is there some way to see the roll dividers on a burned CD?
-
Managing and Capturing the Metadata
2003-06-18 19:58:43 czygmont [Reply | View]
Thanks for the article Derrick,
I have an unanswered question, how do you manage and handle all the "metadata", in other words creating it, the film roll titles, the titles for the pictures, the comments. I find this aspect to be the most challenging. I take lots of pictures, but then I find myself wanting to just dump them into iPhoto and continue taking more. As a pro yourself, do you make it a habit to write down notes as you take pictures, or do you just rely on spending some quality time and remembering all the photos you took? I see real value in coming up with clever titles and comments, but I find I don't have as much time as I'd like to force myself to do it.
Thanks,
Chris
-
Overide iPhoto startup when mounting disc?
2003-06-18 09:01:05 anonymous2 [Reply | View]
Discs burned via iPhoto will automatically launch iPhoto and load. Is there a way to over-ride this behavior? I've been developing a lite slideshow program; it would allow one to slideshow archived photos without the memory/processor overhead of iPhoto. It works well for finder burned discs and I would like to extend it use to iPhoto discs as well.
-
or you could just use iView Multimedia...
2003-06-18 07:02:27 surajrai [Reply | View]
If you are a pro or somebody who deals with thousands of files, you should really look into iView Media Pro. It is very good and higly efficient program. I have over 4,000 images in a catalog and it loads the catalog in no time even in a 500 Mhz iBook.
S.r.
-
Archiving problem?
2003-06-18 04:08:04 anonymous2 [Reply | View]
I have an old iBook model with a CD-RW drive and iPhoto 2 cannot archive the photos I selected! It will always end with a buffer underrun error and my disc will be ruined! Any clue on how I can get around this?
Here's the log file:
iPhoto: Burning to SONY CD-RW CRX700E 1.3s via ATAPI.
iPhoto: Requested burn speed was max, actual burn speed is 8x.
iPhoto: Burn started, Fri Apr 25 22:53:15 2003
iPhoto: Burn underrun protection is not supported.
iPhoto: Write (10), block: 278176, count: 32 -> 3/0C/09 Medium Error, Write error, loss of streaming
iPhoto: Burn failed, Fri Apr 25 23:01:12 2003
iPhoto: Burn sense: 3/0C/09 Medium Error, Write error, loss of streaming
iPhoto: Burn error: 0x80020060 The device drained its buffer without burn underrun protection.
My email: terkwong@lycos.co.uk
Cheers,
ter
-
Fine, but WHY won't iPhoto scale?
2003-06-17 19:13:16 jfaughnan [Reply | View]
Derrick, I was a bit disappointed in this article, and I'm a big fan of yours. You did tell us that iPhoto bogs down on all but high end machines with 1GB libraries, but you didn't explain why.
1GB isn't all that big. Heck, it's only 500 or so images!! My original Mac SE/30 handled a FileMaker database with several thousand records with aplomb. True, the records did not contain images, but that's what the file system is for, the records only contain pointers to files. Surely HFS+ can manage 500 files! (I'm joking of course, you know it can handle tens of thousands of files.)
So the really interesting question hasn't been touched. Why won't iPhoto scale to an even trivial number of images?
john
PS. I do 1000 images in 6 months. No sweat.















- geoff