That's the balancing act all GMs have to consider. Moving up to the top of the board because of need and FOMO can't be your main motivation. We've seen it a bunch recently - Mahomes at 10, Watson at 12, Allen at 7, Lamar at 32, Herbert at 6, Hurts at 53, etc. It's not impossible to find a QB outside of the top 3. Even Fields at 11 and Mac at 15 look like better value than Wilson at 2 and Lance at 3 so far.
I don't think Irsay is a full blown Jerry but my biggest concern would be the pressure he's putting on Ballard to finally fill that void. The scenario of QBs going 1-2-3 and Indy having to settle for whoever's left strictly because the owner wants one is

If that's the hand they're dealing with Ballard may have no choice but to move up and make sure he gets a QB him and his scouts actually like.