Although you can see the lights from Reykjavik, you'll increase your chances of viewing them outside of the city away from the "light pollution ... like BusTravel Iceland or Reykjavik Excursions ...