Weird KDE Panel resizing bug. Thinking of a complete reinstall

Whenever I resize the panel or the any other widget on the panel (e.g calendar widget) it doesn't remember its size. It's really annoying me. I am on Fedora 40, KDE 6.0.4. Nothing seems to fix it, thinking of a complete reinstall. Is anyone of you getting this bug?