It seems OP doesn’t use window decorations so those windows don’t have buttons as well as a titlebar. However the music player is using GTK3/4/Libadwaita which has built-in buttons unless you specifically disable them.