First, start with some so-called 'descriptive' music, for instance:
Are you seriously suggesting that these well-known and respected pieces are entirely abstract? At the very least they reflect particular physical characteristics - mellowness and relaxation in the Delius and Debussy and vigorous activity in the Holst. At the very least, this is reflected in the types of physical activity involved in creating the music.
However, think again - all these pieces come from a particular period in musical history - all were written with a certain world view in mind. Is this a factor? Are we unusually receptive because they are from a readily recognised historical period and musical style?