You can buy them on an exchange, which means setting up an account, funding it with USD and then trading. OR the easiest way is to buy one on ebay, then it'll just get delivered to your wallet. But be prepared to pay a premium for ebay.
Example: http://www.ebay.com/itm/One-1-Bitcoi...item1e78952560