We investigated the excitation of surface plasmon polaritons on gold films with the metallized probe tip of a scattering-type scanning near-field optical microscope (s-SNOM). The emission of the polaritons from the tip, illuminated by near-infrared laser radiation, was found to be anisotropic and not circularly symmetric as expected on the basis of literature data. We furthermore identified an additional excitation channel via light that was reflected off the tip and excited the plasmon polaritons at the edge of the metal film. Our results, while obtained for a non-rotationally-symmetric type of probe tip and thus specific for this situation, indicate that when an s-SNOM is employed for the investigation of plasmonic structures, the unintentional excitation of surface waves and anisotropic surface wave propagation must be considered in order to correctly interpret the signatures of plasmon polariton generation and propagation.