I have never had that refresh problem before however it may be that the address is being geocoded too slowly.
As google now charge for geocoding it is sensible to pre-geocode your addresses if posible so they are not checked every time.
So if your addresses are coming from a database then get the lat and lang once and save it into the database table then use those for the map
I did a tutorial on this some time ago, see the "Creating the API call' section of this post