How do I make a button slightly transparent?

The custom color tool can also adjust the opacity in the designer:

Note that for buttons you'll want to change the shape to something like Rectangular from Default otherwise the color will get blended with the Android button image.