Share the Road

I nearly ran over a cyclist on my way to work this morning. I was rolling up to a left at a left turn yield on green intersection and the oncoming lanes were completely clear. There was no one in the crosswalk. As I began my turn, a cyclist sped into the crosswalk from the sidewalk behind and parallel to me, going the same direction as me---the wrong direction for bicycles. I slammed on my brakes and on my horn and did not hit him. He looked at me as if I were crazy, as if I were the asshole.

Oh, and he wasn't wearing a helmet.

Look, dude, I know you probably had a walk signal on the crosswalk but, guess what, you weren't walking. You were going the wrong direction. You are not a pedestrian! Pedestrians don't travel at 10 - 15 MPH through crosswalks.

This incident was not my fault, right?
EDIT: Charlie pointed me at the appropriate Washington code, RCW 46.61.235,  and I remain, in my opinion, without fault. The cyclist was more than two lanes away from my starting and ending point when he initiated the cross and he left the curb suddenly.