Sounds like a studio monitor controller is the right thing for you (however a bit over your price range - currently about 124 USD):
You can individually turn on/off the input channels,
have volume control,
additionally it can act as an audio interface so you have another digital input via USB,
this one has even 3 outputs which can ...