According to your profile, I see you have an '06 WRX. Yes, with proper exhaust, I/C, and tune upgrades, it will be a direct bolt-in turbo.
However, I feel that the VF34/39 are a poorly-matched turbo to the 2.5L engine (the TD04 even more so).
The smallest turbo I would go with would be a Blouch TD05H-18G with the upgraded 8cm^2 exhaust housing. I recommend the Blouch because they use the TD06H compressor housing.
If you're going to do a turbo swap, you may as well do it properly:
750cc injectors (tuners preference on brand) and Walbro GSS342.
Quality TMIC (TurboXS, APS, Perrin, Spearco)
Aftermarket UP (EWG preferably) - yes, your OEM one is catless, but an aftermarket one will flow better (read: quicker spool and more power). EWG sounds awesome, and gives you even more benefit.
PnP exhaust manifold / aftermarket headers.
Aftermarket intake - I like the APS 65mm CAI, as the filter is in the fender, and the OEM black plastic scoop directs air right on it. You'll be far enough from stock that your OEM intake will be a restriction. A post-MAF hose (Samco, Perrin, Cobb) is relatively inexpensive. Installing a turbo inlet hose (Perrin, Samco) might be good since you're swapping turbos; "while you're there" type thing.
Aftermarket boost control - solenoid or MBC, tuner preference.
Good custom tune - if you're going to spend the $$ for a turbo swap, get a proper map for it. If you can't get to a tuner due to location (none in a 4-hour radius), an Internet/e-mail tune would suffice.