Are you using the RSS feed to go to individual article pages? If so, then it will appear in the main body. If you go to the front page, it should only be in the sidebar.

Next task: can I exclude this category of posts from the feed?

Edit, ten minutes later: Yes, I can. Sideblog posts should still appear when you read story articles, but they won't appear in the main feed.