I can only get 25 down but a house down the street can get 40?

I just dont understand how two houses in the same neighborhood can't both get up to 40 Mbps. Looking at the map, my house is actually CLOSER to the datacenter but I can only get 25 Mbps while down the street they can get 40 Mbps even while they're further away. I need faster internet so this is pretty frustrating. Why is it like this?