You can remove the "Start" button from the Panel. You get the same menu by right-clicking on the desktop. You can use full width or "normal" width (less wide) for the Panel, put it on any edge of the screen or move it somewhere else on your screen, and autohide it. You could use wbar as a launcher if you like it. There's a lot you can do to make XFce unWindows-like.