Can someone be a pacifist and still defend themselves?

Yes. There are whole schools of Martial Arts based on the idea of defending without causing harm. The actions revolve around avoidance and changing the direction of the attacker's movements.