I just broke my leg, must i rest?

about two weeks ago i broke my fibia and tibia. i had to have surgery, put the rods or screws in. i have this big metal thing thats freaky lookin on my lower leg now. they sent me home with crutches. we asked a dr if it was ok to go out, he was quiet and said just gott keep this up. (leg elevated) but he didnt seem to be the brightest doctor. he was one of the newer guys , an orthepedist for a few years probably. my mom talked to another dr when we had called in. he said " she should not be going out until those rods our out". soooo i hate tv, i HATE staying in. its the SUMMER. i look forward to this summer the whole friggin year. unfortunately im up two flights of stairs, but i go down them on my pretty much.. when i go out, i put my leg up.. my question is, is this stalling my recovery if im leaving the house? im really overdoing it, lke today i went to church, then the pool, then ate at a restaurant..then went to my friends house tonight and watched tv. ( with my leg up) that was obviousally a bit to much i suppose. so is this staloling my recovery or is there just more of a chance of an accident possibly happening like a fal, that would and could obviousally lead to permanent leg problems if i fell on it hard.