Do you have springs between the rockers on the shaft or solid tube type spacers. Considering the
oil for a moment, perhaps the reason it becomes more audible after getting warm is that the
oil becomes thinner and thus provides less cushion combined with dimensions increasing from the heat. I say check the bushing in the rockers.