If they call "infield fly" it means at least one umpire believes the play can be made with ordinary effort. If it isn't caught, you have one vote for error already.
I would need something special to happen to score anything but E-6 (like 60 knot wind blow the ball 60' away or something like that).