Spatial Action Maps Augmented with Visit Frequency Maps for Exploration Tasks