Treat the damaged areas as small patches. I'm assuming there isn't any preexisting texture.

1- Remove any additional loose primer and spot-prime the damaged areas. Allow to dry.

2- Apply some spackle or drywall mud to the affected areas to hide the damage. If the damage is light it won't take much. Sand smooth after dry.

3- Re-prime the patches and paint.