A substance that adversely affects the endocrine (hormone) system leading to negative effects for organisms and/or their offspring.