My doubt is whether there is a point during this process where the
temperature varies and then returns back to the original position, or
is the process isothermal?
There is no single "temperature" of the gas during the free expansion. The same applies to pressure. During the free adiabatic expansion temperature and pressure gradients exist within the gas and these gradients are changing in time.
Although the initial and final equilibrium temperatures are the same, the process is not isothermal (it is not a constant temperature process). The ideal gas law only applies under equilibrium conditions. So for the adiabatic free expansion $P_{f}V_{f}=P_{i}V_{i}$ means $T_{f}=T_{i}$, only for the initial and final states. But it does not necessarily mean the temperature $T$ is constant during the expansion between the equilibrium states.
Let's say you had thermometers randomly located on both sides the chamber. If the gas is initially internally in thermal equilibrium, those thermometers on the gas side would all theoretically read the same (the initial equilibrium temperature of the gas). Those on the vacuum side would theoretically read zero since there is no gas possessing kinetic energy.
Now an opening is created and the gas starts rushing into the vacuum side. All the thermometers will start having different readings reflecting the temperature (and pressure) gradients created during the expansion. So for this scenario, the question for you is which thermometer reading shall be called "the" temperature of the gas during the expansion?.
On the other hand, if one waits long enough the readings of all the thermometers will eventually converge to the equal the initial temperatures measured on the original gas side. Although during the expansion the distribution of the speeds (and thus kinetic energy) of the gas molecules would not follow the Maxwell-Boltzmann distribution that is associated with a specific temperature, the total kinetic energy and thus the internal energy does not change.
Bottom line: The temperature (and pressure) of the gas only has meaning when the gas is in internal equilibrium, i.e., before the expansion occurs and after it ends and the gas is allowed to re-equilibriate (settle down).
Hope this helps.