buying bike

I have rented a few bikes but I'm thinking it's easier to just buy a cheaper used bicycle or not sure how much a new bike costs. Can you expats recommend good places to buy one that won't break the bank? Also, is it safe to lock the bike up and any experiences with bike theft? I figured if...