the voltage symbols you see represent ideal voltmeters, reading the voltage over their respective terminals. Va reads the voltage drop over I, the ideal current source, and Vb over the short circuit wire.
The two voltmeters are connected to the exact same two (actually one) circuit nodes, so they will read the exact same value.
So, according to Ohm's law (Eq. 1), $$ V_a = IR = 0 \times \infty = 0 $$
The current source is connected in parallel with the zero-ohm wire. Therefore the resistance that applies here is the parallel combination of the source's internal resistance and the wire. Since 0 ohms in parallel with any other resistance is 0 ohms, in this equation we should have $R=0\ \Omega$.
Then there is no infinity involved and your question is moot.
It may make it easier to understand this circuit if instead of a short-circuit wire, you place a resistor across the source. Then you can use the mathematical tools of limits to find out what happens if the resistor value approaches zero or increases toward infinity.
For example, the short circuit case can be studied as
$$V=\lim_{R\to 0}IR$$
Since $I$ is a finite constant value, this limit is very easy to evaluate.
The case where the resistance goes to infinity (representing an open circuit rather than a short circuit) is more challenging, and can in fact not be solved. It represents a situation where your model is inadequate to describe any real physical situation. Because in reality there is no such thing as an ideal current source or an ideal open circuit (although it is generally the current source that is "less ideal" than the open circuit).
Edit
In comments you asked,
In the ideal state, where internal resistance of the current source is infinite, does Ohm's law still apply?
Ohm's law applies to resistors, and defines what it means when we model something with a resistor.
I think you're forgetting something very basic, like that the internal resistance of a current source is in parallel with the ideal element, not in series. If you have a non ideal current source and a resistive load, the model looks like this:

Here, I1 is the "ideal part" of the current source, and R1 is the source's internal resistance. R2 is the load resistor.
Using the current divider rule, you should see right away that the closer R1 gets to infinity, the more of the current from I1 goes through R2. That is, the closer this is to an ideal current source, delivering exactly the same current to the load regardless of the load resistance.
If you take the limit as R1 goes to infinity, and R2 goes to zero (you make the current source ideal, and the load into a short circuit), then the current through R2 goes to I, the source current. And, by Ohm's law, the voltage between nodes a
and b
goes to zero.
Whether you put the voltmeter measuring the voltage between a
and b
on the left side of your schematic or the right is immaterial. Whether you have one ideal voltmeter or two or three hundred is immaterial as they are ideal voltmeters that don't affect any of the voltages or currents in the circuit.
The point is that making the current source internal resistance higher makes the output voltage closer to $I_{source}\times R_{load}$ (what you would expect from Ohm's law) rather than farther from it.