Once you have added someone to your story you can easily remove them by going to the Contributors' section in your story's settings and clicking the "remove" button next to their email or twitter handle.
Remember that only the story creator can add or remove contributors.