How do I remove a component that I added?

Once you have added a component, the Add Stuff button "splits" to include an arrow that opens the Manage link. The link opens the Toolbar Options window, where in the My Stuff tab, you can remove, show/hide, and change the position of the components you have added.