If you change your mind and want to remove a book from your favorites, just click the heart icon again either on the bookshelf or on the My Favorites page and it will no longer appear.

Click the Bookshelf icon next to My Favorites to go back to your main bookshelf.