Check craigslist. I was looking on there earlier and you can find a few rentals listed in USVI. A lot of it is expensive holiday rentals, but there are some listings for locals, too. Not cheap, but not as expensive as one might expect.