Do my referrals need to refer others?

No, your referrals only need to refer others if they too want to earn FriendSpend Rewards.  Referrals going out a total of six generations (including your Direct Referrals as generation one) will build up more FriendSpend Rewards for you.