Drywall paper peeled

I have a question I’m hoping to get some help with, and even more, hoping you will tell me what I want to hear!
I live in a 40+ year old home . It appears that the original contractors who built the house applied wall paper directly to the drywall, instead of priming/painting first. Now when we try getting off the wall paper (which is nearly impossible), it takes with it the top layer of drywall paper, leaving a brown papery surface. My question is, can I paint/mud over that surface? Or do I need to cut out and replace those sections? If I mud over it (creating texture), will it adhere long-term? Thanks in advance!