When a man is depressed and is feeling down, his testosterone’s low too – and decreased sex drive is a common side effect of many anti-depressants, making it a little bit of a lose-lose lust situation.