Gynecomastia isn’t harmful to your physical health, but it may make you self-conscious and affect your self-esteem. Certain medications and medical conditions can also cause it.