Downvotes showing on my profile under boost? How do you remove?

Unfortunately I downvoted what I thought was a bot yesterday and now the post is showing up in my profile under boost. It's not the kind of content I want attached to my profile and removing the downvote hasn't done anything.

I think it's a known issue but the boost tab in the profile seems to be a bit buggy and I was wondering if anyone had any ideas?