Treat the damaged areas as small patches. I'm assuming there isn't any preexisting texture.
1- Remove any additional loose primer and spot-prime the damaged areas. Allow to dry.
2- Apply some spackle or drywall mud to the affected areas to hide the damage. If the damage is light it won't take much. Sand smooth after dry.
3- Re-prime the patches and paint.