Pretty much. There's no one single definitive mathematical definition of what is and is not an outlier (you can formally make mathematical definitions, but there is more than one way to do so and which one people use is subjective). But by any reasonable definition, 3 and 123 will qualify here, and the others will not.