Technology – Never Enough Storage Space.
Although the capacity of hard drives has increased, and the cost/(MB, GB, TB) has gone down, technology lets us collect more and more data. Each image I take with the 36 MP Nikon D800 and save in RAW format takes up ~40 MB of storage space. I’m the type of person that saves every image (other than the ones that are totally white or black, totally out of focus). I like to go back and review the images to learn from my mistakes, and also get ideas of things that I want to do better when returning to a site I have photographed before. As the image processing software has improved, I find that I can reprocess images to get something good/interesting out of a previously rejected/not-interesting image. (Just ask the photographer that had images of Monica with Bill).
Well, this year with all of my travel I hit the wall again with my data storage. I started off a few years ago with one (Lenovo ThinkPad W700ds) then a 2nd (Lenovo ThinkPad W510) computer at home that I use to process images, each with a collection of disks with images. I also keep a 3rd set of the original images offsite. I first used a collection of Western Digital MyBook 2-disk arrays – but ran out of USB, Firewire, and eSata ports on my computers. I then upgraded to a Drobo 800i (8 x 2 TB disk array) that was connected to my primary computer via gigabyte Ethernet. I finally had all of my images in one place. Life was good until I needed to expand the storage space. To upgrade to a (8 x 3 TB disk array), I had to replace the disks in the Drobo one at a time and then wait 2-3 days for until I could replace the next drive. The same thing happened when the Drobo indicated that a disk had failed – and unfortunately the log files on the Drobo are encrypted so you can’t tell what caused the problem. One of the “failed” disks that I replaced, I ran a full analysis using the Seagate SeaTools – and found no errors/problems with the disk (I ultimately repurposed the hard drive and have been using it for a year with no problems). I had also been reading other reports on the net about Drobo’s that became bricks, and issues with lack of support after the warranty ended. I decided to investigate other large capacity storage systems, and ultimately decided to try out a Synology DS1812+ system initially with the 8 x 2 TB drives that I just removed from the Drobo 800i.
The Synology disk arrays runs on Linux using a program they call DSM. Much more flexible than the Drobo, and a lot more real-time diagnostic information about the health of the system. The other neat thing about the Synology DS1812+ is that it has two eSata ports that you can add Synology DX513 (five disk arrays). As soon as the Seagate 4TB drives became available at a reasonable cost I added a Synology DX513 with 5 x 4TB Seagate hard drives. You plug it in, and all of a sudden you have another 14.3 TB (one disk fault tolerance) of storage space. This was working well through the beginning of this year – my primary image processing computer (Lenovo W700-ds) using the older Drobo 800i and the secondary image processing computer (Lenovo W510) using the Synology DS1812+ and DX513. I would keep the two disk arrays synchronized using sneaker-net and FolderMatch. (Future project – home server and networking).
After the Semester at Sea Spring 2013 Enrichment Voyage, and my recent trip to Iceland I was getting close to running out of space on my primary system. Then I got a warning light on the Drobo that another drive failed. I ordered a new Seagate 4TB drive and when it arrived (Amazon overnight is great) it took 6 days before I had all green lights on the Drobo again. The other problem that I had was that the Drobo array was not recognized after rebooting the computer. I thought I had a Drobo brick. If I was really patient, the computer would finally see the Drobo array after 30-60 minutes. I can see where others with this problem were not patient enough, gave up on Drobo – and published there rants on the internet. I was beyond the warranty and didn’t want to sit on the phone and pay for support. Enough was enough and I decided it was time to give up on the Drobo, and ordered the newer Synology DS1813+ which I populated with 8 x 4TB Seagate NAS drives and a DX513 with 4 x 4TB Seagate NAS drives. Each array is set up with one disk fault tolerance, and gives me a total of 25.3 + 14.3 = 39.6 TB of capacity for my primary image processing computer. This should get me through another year (or two or three) unless the Nikon D4x comes out at 54 MP The Drobo 800i will probably become part of my offsite data storage.