Mac Pro Upgrade – Mountain Lion, SSD, eSata, USB 3

My main editing computer has been an early 2009 Mac Pro 8-core Intel machine with 14gb RAM and an NVIDIA GeForce GT 120 graphics card, running OSX 10.6.8 Snow Leopard.  It’s been a workhorse but it was getting tired, taking a long time to boot up and do disk-intensive tasks.

I decided it was time to look into some upgrades to speed things up.  The first thing I did was to try using USB 3 on the Mac Pro to get some speedy external hard drives.  I found a Sonnet Allegro PCIe USB 3 card on Amazon.  It works with a 3 tb WD MyBook USB 3 drive getting up to 92mbs sequential write and 85mbs read.  But the two-slot card will only work with one device at a time and the drive will mysteriously disappear sometimes, only reappearing when I reboot.  I give the setup a 5 out of 10 because it works but is a dead-end since I can’t add a hub or another drive.

Next I tried a eSata card to get better speed from my Newer Voyager and NexStar external  drive docks which I’ve been running with Firewire 800.  I decided on a NewerTech MaxPower eSATA 6G PCIe 2.0 RAID Capable Controller Card from OWC because it supports RAIDs and they claimed it would run on the Mac Pro.  Speed increase was not dramatic, but I’m getting about 22% faster read/write from external drives.   I give it 7 out of 10.

I’m kind of late to the party with Solid State Drives (SSD) but from many accounts putting the system and main software on an SSD boot drive would be the best and speediest upgrade.  I decided to upgrade to OS 10.8 Mountain Lion first to see if it was stable, then install an SSD.

I ran Mountain Lion on a separate drive for a couple of weeks, only copying over software that I actually used during that time to see if I could eliminate a lot of the clutter in my Applications folder that I had accumulated over the years.  Plus Mountain Lion was not compatible with some of the old programs so I wanted to see what needed to be updated.  All the main programs I was using — Final Cut Pro 7 and X, Photoshop 5.1, After Effects, Compressor, ClipWrap, MPEG Streamclip, MS Office — seemed to work fine under Mountain Lion.  I had to upgrade Pluraleyes to the new Red Giant version, and I had to update drivers for Matrox Max, the Sonnet Allegro USB 3 card and a few other utilities.

All was good except that if the system went to sleep it would not wake up when you hit the keyboard or mouse, and I’d have to do a hard restart.  I didn’t lose much work because I usually save everything before getting up from the computer, but it was really annoying.  After checking a lot of posts by people with the same problem, I stumbled on a solution posted by Bonfire to upgrade the Nvidia graphics card drivers.  After downloading and installing the QUADRO & GEFORCE MAC OS X DRIVER RELEASE 304.00.05, everything is working fine.

Next the SSD.  I  picked up a Sandisk Extreme 480gb SSD on eBay for about $300.  Mounted it in an Icydock 2.5 to 3.5 converter box.  Loaded Mountain Lion and essential applications and swapped out my old boot drive in bay 1.  Startup time went from almost 2 minutes down to 45 seconds.  It’s reading/writing about twice as fast as my old drive according to Xbench.  9 out of 10 with just a knock for the expense.  I hope SSDs will start to drop in price like SD cards have.

So I’m happy with the upgrades.  For about $400 in parts it feels like a new machine, which will suffice until or if Apple decides to update their Mac Pro line.

 

Hacked and Fixed

This blog was hacked last month.  Google said it was blocked because of malware.  I never heard of this before, but I downloaded the files and checked them with ClamXav, a free virus checker, and found that 673 out of 1670 files were infected with something called Trojan.PHP-33.  The support desk at Bluehost where my website is hosted suggested using a malware scanning service to help clean out the bad code.  I decided to contact wewatchyourwebsite.com since it got some good reviews and was considerably cheaper than the alternatives.

Thomas J. Raef at We Watch Your Website had the site cleaned up in one day and now we’re back up and running.  The service monitors the site and will clean it as many times as necessary.  I also installed the anti-malware plug-in Anti-Malware by ELI (Get Off Malicious Scripts) on WordPress to prevent re-infection.  Finally, I contacted Google to unblock the site and it was cleared in a few hours.  All in all it was a pain to deal with.  I’m not sure why anyone would want to hack this little blog, but I hear that it’s pretty common.  I’m glad I was able to get rid of it.   If you are using WordPress I’d suggest at least installing the Anti-Malware plug-in, and subscribe to We Watch Your Website if you want to be proactive.

Shooting Video at Yoshi’s Oakland

We recently had the opportunity to shoot a performance at Yoshi’s Jazz Club in Oakland’s Jack London Square, one of the oldest and most respected jazz venues in the Bay Area.  It’s a 330-seat jazz club with a state-of-the-art sound system.

I talked to the contact person there a few days before the show to just check in and see if there were any issues to be aware of.  He said the floor manager would help us find places to set up cameras and that we could get a stereo feed from the sound board.

The night of the show we loaded-in at 5:30pm at the side entrance and found street parking.  (There’s a large paid parking lot above the club too, but at sound-check time there’s plenty of street parking.)

The club has a semi-circular stage with small cafe tables and some circular upholstered seating. Stage lighting is all tungsten which makes color balancing easy.  The house manager cleared one table area next to the sound board for our stationary wide camera and audio recorder.  We were given another table spot on the left for a manned stationary camera.

I put the small Canon HF-G10 on a tripod without opening the legs and gaffer-taped it to one of the table dividers on the right.  Finally I had the Canon 5D mkII on a monopod with a 70-200 f2.8 lens that I could use to roam on the right.

The lighting operator agreed to keep the light levels constant through the performance, and she gave us a few minutes to meter the actual stage lighting after sound-check.  The Sony AX2000s were set at f3.2 @ 1/30th with 6db gain.  The Canon G10 needed about 15db gain at the same settings.  The 5DmkII was at f3.2 @ 1/30th at 1250 ISO.

The audio feed from the board was line-level through XLR cables.  My standard audio recording setup now is to run the line-level signal through a portable Shure FP-33 mixer and send mic-level signals split with Y-cables to the camera and to a Zoom H4n.  This solves the problem of the Zoom distorting from a hot feed, and also gives me automatic backups to the camera inputs.  I had plenty of time during sound-check to set levels and make some test recordings.

As performance time approached we started rolling sound and the stationary cameras.  Luckily the house was about 3/4 full so there was some room to roam on the right side, mostly in the back row and against the wall.  The distance from there was a little long for the 70-200mm.  I was getting some medium close-ups of the performer, but couldn’t get in to tight head shots.  Getting physically closer would have blocked some of the audience’s views, which we had promised we wouldn’t do, so I just shot what I could.  The manned Sony on the left could get in closer with a longer zoom, so we’d have some tight shots from that angle.

If the show was sold-out it would have been very difficult to shoot with any kind of mobility, and I probably would have manned a stationary camera on the right.

We didn’t eat dinner at Yoshi’s that night, but they have a pretty good Japanese restaurant attached, and a decent bar menu with sushi, chicken skewers, etc., and a full bar.  There are also a lot of other restaurants in the area like Scott’s Seafood, Miss Pearl’s, Bocanova, etc.

All in all it was an excellent shooting experience.  The management and technicians were very accommodating and helpful, and treated us like professionals.  They charge the performers a fee to allow video shooting, so that could be an issue for some people.  We’re looking forward to shooting there again, or at Yoshi’s other location in San Francisco.

Studio Portraits: Tethered Shooting

I had the opportunity to shoot some corporate portraits this week in a temporary conference room studio.  My setup is pretty simple — 4 Alien Bees strobe heads: key, fill, background light, and a hair light from behind the background.  Canon 5dMkII with a 70-200 f2.8 lens.

Since it was a static setup I thought I would try tethering the Canon to a MacBook Pro so the clients could see the results immediately.  I used the Canon EOS Utilities software for remote shooting and it worked great.

First, it helped with the set up because you can take test shots without writing to your CF card or disk.  There’s an integrated histogram to help with exposure settings.  You get a nice big image to evaluate.  And you can change the camera settings remotely from within the software, including ISO, speed, aperture.  The only things you can’t change are the physical zoom and framing of course.

During shooting it helps with the large image to monitor shots.  The clients can then check the images and select the best ones, or we can talk about trying different poses.

Finally, and best of all, you can set it to write both to the CF card and your hard drive, so you get instant redundancy for safe backups.

I only wish there was a more portable version of this.  Lee Morgan of fstoppers.com showed a way to wirelessly monitor photos instantly on an iPad a while back, but it’s just for monitoring, not controlling the camera.  I wouldn’t mind a wired connection if it added controls, but I don’t think it’s possible with Apple’s connector.

There is promising beta software called DSLR Controller available for Android tablets as reported by Petapixel last year.

Archiving Video Projects to Blu-Ray

I’ve had a few hard drives fail in the past but luckily didn’t lose anything too valuable.  But I get paranoid that something I put a lot of time into will be lost forever with a drive crash. I routinely back up original media to a separate drive, and the Final Cut Autosave Vault has saved me many times, but when I’m done with a project I needed a way to archive everything.  A long-form video project can eat up from 300 to 600gb so I needed something that can handle that amount of data, be relatively stable and cheaper than just buying more 3tb hard drives.

A lot of pros recommend archiving to LTO tape systems, but those drives are over $1000 and the tapes aren’t cheap either.  So I started archiving video projects to Blu-Ray discs as a cheaper alternative.  They hold up to 25gb per disk (50gb on double layer disks) and are rated to last up to 50 years — a lot longer than hard drives or tape.

I picked up an internal LG 12X Blu-Ray burner ($87 from 3btech.net) and installed it in the second bay of my Mac Pro in about 10 minutes.  After researching different brands of media it looks like Sony Blu-Ray discs are consistently rated highly, and I found 50-disc packs for about $75.  I used Toast Titanium 10 to gather all the files from various on-line drives, and set them up for burning.  Toast will automatically span as many discs as needed for a large archive.

To keep things to a reasonable size I archive the original camera and audio files and everything from the project except render files and transcoded media since those can be recreated from the originals if needed.  A recent long-form project with about 3.5 hours of final video took 14 Blu-Ray discs to archive, costing about $21 for materials.   Each disc takes about 15 minutes to burn and verify, but you can work on other things while waiting.

A boring task, but I figure it’s good for clients to know you’ve got their material archived, and it’s good for your own peace of mind.

 

Faster YouTube Upload Success – Fiber Optic Internet

I have a potential client who needs one-hour HD videos uploaded to YouTube within a very short time window.  After compressing a test video with the Matrox CompressHD card to 720p h.264 with Compressor (45 minutes) the file size was 2.32gb.  Uploading through my Comcast residential connection at about 4Mbps took over 4 hours.

I tried a Comcast business connection which Speedtest.net said was uploading at 9.1 Mbps, but that still took almost 3 hours.  I tried at different times of the day but although Speedtest said some upload speeds were faster than others it didn’t make a lot of difference in the time it took to upload.

After an extensive search and posting on several forums for help I finally found a local office building which is home to many non-profit organizations, and which has a fiber optic connection to the internet.  Plus they have free public wi-fi.  The upload speed is still only 9.9 Mbps, but the YouTube upload of the same file took only 38 minutes!

I don’t know why there is such a huge difference in speed.  Is Comcast somehow choking the upload process, or does a fiber optic connection make it faster even at the same upload speed?  More research is needed, but at least now I know I can meet the client’s need for speed.

Project Management for Video Files: Post Haste+DiskTracker+Voyager

I’ve been using Post Haste since I read a tip from EditingWhiz about keeping your video files organized so you can find what you’re looking for.  It’s a free program from Digital Rebellion that has templates which automatically set up folders for different media from FCP, After Effects, Photoshop, etc., and creates a dummy file in each folder with a consistent naming convention based on customer name and date for that project. It’s customizable for your own situation. I’m on a Mac but I think they have a Windows version too.  Coupled with a disk cataloging system like DiskTracker, you can find files easily across multiple internal and external drives.

I’m using a Newer Technologies Voyager quad interface external drive dock and about a dozen (and growing) 1 to 3tb drives that I use to archive projects.  The Voyager has Firewire 800 & eSATA which speeds up write times a lot over USB.

Shooting Video at The JazzSchool, Berkeley

We’ve shot some great music at the JazzSchool in Berkeley, such as The Primavera Latin Jazz Band last year.

Our most recent shoot was at a recital of jazz vocalist and educator Maye Cavallaro‘s students.

The facility is located in the basement level of a large office building.  The performance space is small – maybe 100 seats max, mostly seated around cafe tables.

The stage at the JazzSchool, Berkeley

We set up a tripod next to the sound booth in the back and had one roving camera on a monopod.  When the audience fills up the place it’s very hard to move around, but you can usually squeeze into an aisle on the right or near the main desk on the left.

The audio engineer that night (Lou Judson) was kind enough to give us a good mic-level XLR feed to the camera.  Sound was good but dry, so I also captured audio through a Zoom H4n to get audience reaction and mix in a little room sound.

Unfortunately the lighting is mixed, with stage lighting mounted on the somewhat low ceiling, but also recessed compact-fluorescents overhead on the stage, and some daylight coming in from windows near the ceiling on the right.  The stage lighting was uneven that night, with a bright spot on the left front but falling off by about a full stop on the right side of the stage.  We didn’t have the time or authorization to mess with the lights so we shot it as-is with a tungsten white-balance.  It was evening so the outside light didn’t intrude much.

I was using the small Canon Vixia HF-G10 on a Manfrotto monopod because it’s less conspicuous and easier to maneuver than the 5DmkII with a big lens on a tripod.  It worked well and intercut nicely with the AVCHD footage from the Sony HDR-AX2000 in the back.  The only thing I missed with the G10 is a decent zoom control.  I was using both the zoom lever on the top and the remote control, but neither gives a very controllable zoom.    I might look into a simple external LANC zoom control.

The JazzCafe is adjacent to the performance space and serves beer, wine and light meals.  And of course downtown Berkeley has dozens of restaurants within walking distance.  There is ample garage parking nearby and street parking if you’re lucky.  Bring a good equipment cart.  There’s an elevator to the left of the main entrance.

 

Compressor: Looking for Speed — Update: Matrox CompressHD

In the continuing quest for speed using Compressor, after testing to find the fastest workflow for me I started looking for hardware acceleration.

It looks like the main player in this is Matrox with their Max Technology as an option on their hardware In/Out boxes and cards.  The cheapest implementation is the Matrox CompressHD card ($499 retail) which only gives you H.264 acceleration, no I/O.  After finding several bad reviews of the video capabilities of the next cheapest product, the Matrox Mini02, I decided to just try the CompressHD card.

I found one on eBay for about $100 less than retail.  Being used, I was taking a chance, but the guy said it tested perfectly.  The card arrived today in a plain brown box with lots of bubble wrap but nothing else.

I installed it in an empty PCI-e slot in the Mac Pro and fired it up.  Then I went to the Matrox site to download the software.

(Note to self:  Write down the serial number of a used card before installing it!  Matrox required the serial number to download the software & I had to open the Mac back up and pull the card to find it.)

There were about a dozen choices of software to download, based on the Mac OS you’re using and whether you’re using Compressor or Adobe Media Encoder.  None of them matched OS 10.6.8 that I’m using, but I picked the closest one before it.  Software installation was straightforward but caused some anxiety when it automatically updated firmware on the card, since I didn’t even know if the card was working yet.  Luckily things went smoothly and after a restart I was ready to go.

The software installs the Matrox Max H.264 settings into the Custom folder of Compressor’s settings.  I loaded up the 90 second ProRes LT test file from my previous tests, grabbed the High Quality 720p/29.97 Matrox setting and started the compression.

Previous fastest encode was 03:07.  Encoding with the Matrox Max CompressHD card:

01:22 — More than twice as fast with the card, and 8 seconds faster than real time!

I also tried Fast Encode, which finished in 50 seconds but the quality suffered a bit.  I could see some stairstepping in the titles and the image appeared softer.  So I’ll probably stick to High Quality unless it’s just for a quick approval clip.  Good to know it’s there if I need it.

Matrox Max High Quality Encode - 720p 100% Crop

 

Matrox Max Fast Encode - 720p 100% Crop

I’ll try a longer file soon, but this is very promising.

Tascam DR-40 Sync Drift / FCPX Audio Fix Missing

I was editing an hour+ long performance video in FCPX using audio from both an audience mic into a camera, and audio from the front-of-house board recorded on a Tascam DR-40.  I synced everything with PluralEyes, but I noticed an echo toward the end.   Zooming in to the waveforms I could see that the two audio tracks were in sync at the beginning, but slightly out of sync after an hour.

I couldn’t find a way to change the speed of the Tascam track in FCPX.  In FCP7 there’s a Change Speed feature where you can input the percentage or duration change down to 3 decimal points.  I searched the forums and blogs and it looks like FCPX can’t do it.

I went back to FCP7 and re-synced everything there.  Zooming in tight to the waveforms and using Modify: Change Speed (command + J) I adjusted the speed of the track with trial & error until it matched up.  Speed change was 100.008 percent.

Out of curiosity I ran a test with a Sony HDR-AX2000 camera, a Zoom H4n and the Tascam DR-40.  I found that the Tascam track was 9 frames slower than the audio from my camera after one hour.

Sync Drift After One Hour: Tascam +9 Frames, Zoom +2 Frames

Interestingly, the Zoom H4n was 2 frames off too, so eventually it would also need to be adjusted.  But at one hour the sync difference was not noticeable.

I went to Change Speed and entered 100.008 %, re-synced at the beginning and got the Tascam track to within 1/2 frame.

Sync After Speed Change

Interestingly, I couldn’t change the speed of the Zoom track less than 100.005%, so it couldn’t be improved.

So for sequences of less than 15 minutes or so the Tascam should be ok, but for long form shoots (which I do a lot of) it’s kind of a pain.  As much as I like the DR-40 (for the line/mic switch, the locking XLRs, and light weight) I think I’ll have to get rid of it and stick with the Zoom H4n.