I imagine that's a part of it but also the risk of chargeback is greater with adult content. People get buyers remorse at the exact moment you think they would and reverse the charge

Tried to start a site that wasn't for but did allow adult content and every payment processor closed their shutters on us