Silence Is Not A Cure
It is not enough to go in for a physical and be told, "You are ok, come back in a year." I believe rising PSA numbers combined with a family history should not be ignored. It is up to you to take charge and ask the questions you want.
How familiar are you with inherited gene mutations and cancer?