But it's rare that a baby is growing too fast; more likely, he's just big for other reasons. ... The only real cause for concern is if your baby is too big as a result of your having gestational diabetes, which your doctor would be able to diagnose with ultrasounds and blood tests.read more >>