Yes. The tear is initiated at stress concentrations around the holes, where stress is highest. After initiation, the tear continues to propagate along the line of highest stress.
Stress is a function of force and geometry ($\sigma_{n} = \frac {F}{A_{n}}$). In a piece of paper without holes, the stress is uniform, and the paper tears when stress exceeds the ultimate tensile strength of the paper ($\sigma_{n} \gt \sigma_{UT, paper}$).
Average Stress- the most basic explanation
When holes are present, they effectively reduce the cross sectional area ($A_{eff} = A_{o} - n_{holes}A_{hole}$)* that transmits force. Static equilibrium requires that the stress increases proportional to the reduction in area, visualized below.
$$\therefore \sigma_{eff} = \frac {F}{A_{eff}}$$
Because $\sigma_{eff} \gt \sigma_{n}$, it follows that the paper will tear along cross sections where holes are present. While this correctly calculates the average stress, it assumes the stress between holes is uniform (and equal to the average stress). In reality, the stress profile between holes is not uniform, as discussed in the following.
* Note that 'area' refers to cross sectional area
Stress Concentrations- approximate stress state
Stress concentrations describe the stress state at abrupt changes in geometry, where the stress profile is non-uniform. Analogous to lines of pressure in (laminar) fluid flow around an immersed body, lines of force 'flow' through geometry, becoming concentrated around the holes (where no material exists to transmit force).

A stress concentration factor ($K_{s}$) is applied to the nominal stress to calculate the maximum stress, where $\sigma_{max} = K_{s}\sigma_{n}$. Stress concentration factors depend on geometry and are determined analytically, or by experimental data. From the analytical solution of an infinite plate with a single hole, loaded uniaxially, $K_{s} = 3$. More applicable, from Peterson's Stress Concentration Factors, an infinite plate with a linear hole pattern:
$$\therefore \sigma_{SC} \approx 3 \sigma_{n}$$
Finite Element Method- complete stress state
Complete, accurate solutions are readily obtained by Finite Element Methods (FEM), where analytic solutions are not possible with complex geometry. With assumed dimensions (similar to the posed problem), $K_{s} = 3.75$, determined from the converged solution shown below (where 'brighter' colors indicate higher stress, consistent with the solution given by stress concentration).



$$\therefore \sigma_{FEM} = 3.75 \sigma_{n}$$
All solution methods demonstrate that stress increases in cross sections where holes are present: When stress at any location in the paper exceeds the paper's strength ($\sigma_{max} \gt \sigma_{UT, paper}$), a tear is initiated and follows the line of highest stress- this validates your insight.
There are several other considerations, not discussed, but listed under 'References':
- Paper is not a ductile material- it does not plastically deform
- Paper is not (usually) isotropic- it is orthotropic, where its strength depends on orientation
- Fracture mechanics (founded on the assumption that all materials have defects)- material irregularities act as micro stress concentrations
References:
Mechanical Properties of Paper- Basic
Mechanical Properties of Paper-Advanced
Fracture Mechanics of Paper