TNS-12518: TNS:listener could not hand off client connection

Trying to start up XE on a windows machine I kept getting this:

TNS-12518: TNS:listener could not hand off client connection
Cause: The process of handing off a client connection to another process failed.
Action: Turn on listener tracing and re-execute the operation. Verify that the listener and database instance are properly configured for direct handoff. If problem persists, call Oracle Support.

I didn't install the database, if that helps.

Note to self, you should start the service prior to trying to connect.