Should I try to avoid noticing other pretty women when I'm with my girlfriend?

No, whatever you do don't do that. That will box you into a corner you will never get out of. You need to train her so she recognizes when you do that, you are actually complimenting her.