I had this button confusing users, too. They thought they should be able to upload images. If anyone needs to hide w/o having a custom extension to do so, I simply hid it with CSS. I don't think this should have any unwanted effects.
#MarkdownToolbar button[title="Add an image"] {
display: none;
}