State law says can not shoot within 450 ft of an occupied building unless you have the permission of the owner or occupant. Local laws may vary. I'm not sure if this only applies to hunting or any shooting.
So in short assuming your township has no additional restrictions, you need the ok from both neighbors to do it legally. Not to mention having a safe backstop of some sort. Either way if it's for just hunting or any shooting you really should talk to any neighbors that close just to keep good relations. Noise could be an issue for them at that distance, if it's ok with them then great, if not it's best to find a different shooting spot. There might also be such a thing as there might be certain times of day they don't care and others where it might be a problem.