Can I paint an oil primer and paint over a latex paint on a metal door?

I've already painted the metal door using latex exterior. It isn't bonding well. It looks great but scratched every time it touches anything...like a grocery bag. So. Do I have to strip it and start over or can I paint oil based products on top? Or might it cure if I give it a few more days? Is there a top coat I could use to help it cure?