How do I stop Fellow from adding links inside my calendar invites?

No problem - go to User Settings

Then Notifications

And scroll to the very bottom, where there is a section on the Calendar Integration.
Simply turn this off and you should be all good to go!