I'm guessing that it all depends on exactly how you worded it in the email and what exactly she said or didn't say back.

I'm not sure I would think it was a joke if a guy that I work with asked me to go on a weekend trip with him.

How long since you sent the email?