Baseball stadiums were originally built with home plate to the west (more or less). That way batters could wouldn't have to battle the setting sun in the evening. So left-handed pitchers' pitches came from the "south". I guess the term has been extended to include left-handed athletes and people in general.