The problem the bankers have with Bitcoin is they can't suppress the price with counterfeit coins. With gold and silver and the miners they can just create more paper to flood the market with and give the appearance of unlimited supply.

To suppress the bitcoin price they would have to sell bitcoins into the market. To do that they would have to buy bitcoins first which would drive the price higher. So they can't play games like they can with PM's.

This leaves them with hacking, and denial of service attacks to try and disrupt the market.