If you don’t know the name of your librarian would it be alright to refer to her as “MS Librarian”?

just say miss. or ma'am. unless you're talking to someone else, then "the librarian" is fine. do whatever you want.

Only if it's a young woman.

Just Ms

What if she identifies as a mr?