The pins are tempered and pretty hard, aluminum is soft and the drill will most likely wander into the aluminum because the pin isn't solid, it is split and that split will pull the drill into the aluminum. At the point you are I think a bigger hammer and a good punch is a better solution than drilling.