How does the problem look like?
I know it might be difficult to implement hot keys, but one VERY USEFUL feature that heroes 3 had was the space bar hotkey which re-triggered the visited building on adventure map.
This was very useful for Monolith Portals when you could get on the other side and if there was a powerful creature, you could return by pressing space bar.
What exactly did you do to trigger it?
On which map it happened?
A screenshot or video would be fantastic.