He, he.
Yes you do. Although the SB is capable of sending a signal to remotely start-up (and shut-down) a computer over the network when the SB is switched on/off. I think there's currently a slight problem with it but they are working on a fix. Try the Slim Devices Forum for an update on that.
Probably best to allow funds to get a dedicated server just for the SB though - don't cost that much really.
Maybe you should just get one SB3 to play with for a year or two until the whole Audiophile sound, SB modding situation beds in more. It won't cost that much and that original SB3 could be moved to bedroom, study, etc. if you by a new "wiz-bang" SB in the future - Slim Devices support all their devices going way back so a SB3 isn't likely to turn into an expensive paperweight in the near future.
It's been the best fun item I have bought for a long time.