So, apologies. Apparently, this was fixed in the Kaladesh rules update, and we just completely missed the change. Here's the sentence that was added to 601.2b to clarify this:
If the value of that variable is defined in the text of the spell by a choice that player would make later in the announcement or resolution of the spell, that player makes that choice at this time instead of that later time.
So X has to be equal to the converted mana cost of one of the cards exiled by a Caller, not just any number you want.
Thanks,
Nathan Long
Magic Rules NetRep