I am fine with it in a venue where it is appropriate.

Have you tried to take more for what you want? If you're already in an exclusive situation, I sould start with taking his hand or asking. (Provided you're in an envoronment where there are not other people you or he knows.)