I gotta agree with Cady
All things being equal the taller person is going to be slower, it's just plain physics. For Swordsmanship I think one of the most important aspects is how your wrists are built (bonewise). Point of comparison...my brother and I are built roughly the same, weigh about the same, about the same height etc. The only major difference is the size of our wrists. His are very thick, about 12 inches around, where as mine are just a hair over 9 though my forearms are likely stronger (from years of flying stunt kites and rock climbing) his ability to handle a sword is remakably differant. The sword "seats" well with him where as on me it sorta becomes an add on if that makes any sense. This was even more apparent to me (and a few others) when he switched to a Shinken. I have spent a while working on Unka Kims Tanren exercises to increase my wrist endurence but I'll likely never have the thick "swordsman's wrists" Personally I thick we non japanese have the advantage in this regard but thats just my opinion.
Suck, Squeeze, Bang, Blow...
...that's what makes my thumper go