Power dissipated, different formulas, zero resitatance Power dissipated on an electrical element can be given by: $$P = VI = I^2R = \frac{V^2}{R}.$$
When we have a battery with zero internal resistance, it means that the power it provides (or the power it takes when current flows in the other direction) is given by $VI = I^2R = 0$.
Where is the misconception here?
 A: 
Where is the misconception here?

The misconception is here:

When we have a battery with zero internal resistance, it means that
  the power it provides (or the power it takes when current flows in the
  other direction) is given by $VI=I^2R=0$.

This isn't correct.  The power delivered by the voltage source (battery) to the load is simply the product of the voltage across and the current through the load.
$$P_L = V_L I_L$$
If the voltage source has internal resistance $r$, the power dissipated by that internal resistance is
$$P_r = I^2_Lr$$
Note that this isn't the power the source provides (as you state above) but rather the power that isn't available to the load since it is power that is lost to heating of the voltage source.
If the load is a resistor with resistance $R$, and the voltage source has an open circuit voltage $V$, then the load current $I_L$ is given by
$$I_L  = \frac{V}{R + r}$$
and then
$$P_L = I^2_L R = V^2\frac{R}{(R + r)^2}$$
$$P_r = I^2_L r = V^2\frac{r}{(R + r)^2}$$
In the ideal case that $r = 0$, it follows that
$$P_L = \frac{V^2}{R}$$
$$P_r = 0$$
and so there is zero power dissipated by the source but non-zero power delivered by the source.  For the case that the load is a short circuit $(R = 0)$
$$P_L = 0$$
$$P_r = \frac{V^2}{r}$$
and so there is zero power delivered by the source but non-zero power dissipated by the source.
See that the case that both $R$ and $r$ are zero (ideal voltage source with ideal short circuit load) is not defined (division by zero).
A: for an "ideal" battery with no internal resistance, a short circuit means infinite current. Since there are no infinite currents in the real world, any small resistance in the circuit somewhere will become the load resistance by default and the battery will strive to deliver however much current is needed to drop the source voltage across it. in the case of a gold wedding ring bridging the terminals of a hefty 12 volt battery, the resulting power dissipation in that "load" will be sufficient to deliver 3rd degree burns to the finger encircled by that ring.
A: 
Power dissipated on an electrical element can be given by: $P = VI = I^2R = \frac{V^2}{R}$.

The first part, that $P=VI$, is a general equation that you're using correctly.
However, to get to the $=I^2R$ part, you have to use Ohm's law, $V=IR$.  This applies only to voltage drop due to resistance.
