Sounds like the old thing called stress. It can cause two probs:
1. (your version) You cannot relax and enjoy. My tip: relax and enjoy. That simple.
2. You become impotent (no hard-on) for longer time. Remove the source of stress and enjoy later. That simple.

__________________
If every material thing is gone, my smile and my tears stay left.