You can put the button on a panel and set the color of that panel to a color you like to have as the bordercolor.
Make the button in the designer a few dips smaller on each side.
This setting will display as the left image.
The right image uses an image with a transparant background and the color of the panel comes through it.