Hey pamprdguy,
If you are like most of us and have a fetish from childhood/puberty, packing it in really isn't an option. As has been noted by many people in this group and others you can't get rid of your ABDL fetish, It's part of you no diifferent than your gender and sexual identity. Feelings of guilt, shame and fear are common in our group and that is why we come together as a community to help support each other.
For many of us just because it is called a fetish, it usually is not all sexual for us. For some there is no sexual component at all. We feel comfort, stress relief, and many other positive feelings when we wear diapers or go into little space. What you have to do is learn to accept the true you and not feel ashamed, guilty or fearful. It's probably the hardest part of this or any other fetish.
Don't let yourself feel alone, meet and chat with people online as a start, if you have local munches, attend those, whatever you do don't despair because you are not alone. The chat on dailydiapers is usually quite bust and has many people who will gladly talk to you about how you feel and about your interests.