Bullets for Bandits