These kinds of things happen all too often, unfortunately. Talk to your boyfriend and ask him how he feels about you, how he feels about your relationship and what he thinks of these insults/rumours against you two. Communication and talking to each other is key to holding a relationship together, especially in difficult times when people are behaving in such a hostile manner towards the two of you. My advice to you would be to ignore what others are saying about you/to you. It's none of their business what you and your partner are doing together, and it's incredibly petty and childish of them to kick up such a fuss. I understand that for me to say this is one thing, and for you to actually do it is another, but if the two of you care for each other and love one another, that's all that matters. Ignore the rumours, they're not true at all and the people who'd believe them are idiots. If anyone gives you trouble or treats you in a poor way, they're idiots and not worth your time either.