@vincent I'm running Safari 18.1 on the Sequoia 18.1 Developer Beta. Under General, I set "Safari opens with a new window" and I set "new window opens with start page." New tab is set the same way.

For me, these settings ​bypass the problem that I think you're describing!