If you're talking about this sidebar:
...then that's how it's supposed to work in Flarum. To stop the "stickiness", apply the following CSS in your Appearance settings:
.DiscussionPage-nav > ul {
position: unset !important;
}
You can use relative instead of unset I guess. The solution above should work on Chrome. Code above will make the sidebar not sticky.
