But the lowest credit score to buy a house with an FHA loan is 580. Keep in mind, however, that individual lenders may raise the bar higher based on other factors, such as your income or how much of a down payment you're putting down. ... As a generalization, the average credit score to buy a house is 600 or above.read more >>