Guy problems need help.?

ok im a miner and a guy asked me for my number i thought we were just going to be friends but then a few days later he calls me on hes b-day and asked me if i want to go on a date i didn't really know what to say so i told him i would check with my parents he's been calling me and asking me to come places with him he lives like 3 hour away and is about to leave for the summer i don't want to hurt he's feelings so i was just going to have my dad say we can't go out,but then he said he didn't respect any man and he would beat the crap out of any one who made him mad but he won't hit a girl,i need some help i don't know what to do my dad is a pretty big guy but if he does any thing he could get put in jail,im really freaked,i need someone to answer back soon thanks.