Hi I've owned two turbos in my life both xj650 turbos and have had two rebuilds, without seeing your turbo in action I think it could be the turbo has blown internally and the oil is gathering at the lowest part of the bike ie the turbo, and trying to force itself out via the gaskets etc. Its good that you have checked the oil relief valve beceause that is a known leaking point. Besides difficulty in starting does it blow smoke as well coz that is a bad sign. If it is the turbo you probably have three options. Buy another turbo, rebuild or sell. I once bought a rolling chasis as well from a fellow courier who had the same issues as you and he put his xj650 turbo motor in a xj650 standard frame and changed the oil sump plate over hence bypassing the plumbing involved with the air intake. Also look on the NET and google Yamaha XJ650 Turbo and you should find a couple of guys there who describe their pain and their troubleshooting advice.