I'll usually start on normal unless it's clear beforehand that the game is going to be really difficult, and if I run into trouble, I'll switch to easier modes if I can. If normal feels too easy or if I'm in the mood for a challenge/want to complete a particular difficulty level for an achievement or something, I'll amp things up.
no subject