When one throws around the term "infinite" and "infinity" one should be aware that one is working in a mathematical framework isomorphic with the mathematics of classical mechanics and electrodynamics.
Our experiments have shown us that when dimensions become smaller than the Heisenberg Uncertainty Principle dimensions, classical models break down. So an infinitely thin plane belongs to the quantum mechanical regime, as atoms which you propose to make it up with belong to that regime.
At the atomic level the bonds that hold a crystal , as an example, together, have to be broken, i.e. the atoms from your knife should interact with the atoms on its path into the crystal , that would take energy so there would be the effort in the insertion of your knife. The thinness helps in a statistical way, as the interactions of a two atom thick knife would be approximately twice as many and therefore approximately twice the effort. (A crystal seperates more easily as its symmetries allow for transfer of energy along orientations that are minimally bound).