I dunno, a cheep home deck does have some advantages...
For one, they are much easier to use at home than a discman, with remote control, easier loading, etc.
Also, with a true high voltage high current power supply, it definately SHOULD sound much better than a discman, even if the parts cost is similar.
And i bet the quality of the transports is decent, good enough to be paired with a good DAC later on if you need to upgrade...
Teac has some pretty interesting stuff thats very compact and looks very well built, and isn't too expensive (we tried recommending it to vertigo back in his soundcard days )
But i think used stuff is the way to go, you'll get much more bang for you buck...