Near- and Far-Field Properties of Plasmonic Oligomers under Radially and Azimuthally Polarized Light Excitation