I actually figured this out and wanted to post my solution if anyone else had the same problem. Seems the mower was edged slightly to be in reverse when the bars were in neutral. I adjusted the 2 nuts, one on each side of the hydro couterclockwise and neutral is neutral and forward is fast again and most importantly the brake can be applied with out problems.
If you have the problem of your toro SS pulling to one side there is a bolt beside the seat- one on each side that if you inch it forward or back it will adjust the tracking. I have seen this problem more than anything and Toro was able to help me so iam passing it on.