I was so surprised by the types of graphs I saw for this that I felt compelled to add an answer. As mentioned in the Wikipedia article I linked to, there are two radii that are of interest in addition to the Schwarzschild radius $r_s$. Those radii are
- the "Innermost Stable Circular Orbit" (ISCO) $ r_{outer} \approx2a^{2}/r_{s}$ and
- the "Innermost Bound Circular Orbit" (IBCO) $r_{inner} \approx 3/2 r_{s}$.
It is clear that the inner radius is clearly defined for the BH, but the outer radius depends on the specific orbital parameters. By definition the Kerr-Spin-parameter $a=J/(mc)$, where $J$ is the angular momentum of the central black hole and $m$ is its mass.* This, along with most info here, assumes the particle orbiting the BH has a small mass by comparison.
Here is one paper's graphs, covered by New Scientist. These patterns reflect the general pattern of zoom-whirl behavior, which might also be called Homoclinic orbits. As far as I can tell, these happen when an orbit traverses the ISCO but does not traverse the IBCO. I take it that (I am assuming that) if an orbit does not traverse the ISCO it has a shape like what I posted in the question, which I think are formally called Keplerian orbits.
Can some of these orbit in the small radius (or "zoom") more than once before making back out to the whirl? As it turns out, yes. An orbit can zoom many times before whirling, up to infinity, as per this paper.
For this orbit of infinite zooms, it would get infinitely close to the IBCO. In fact, that shines a lot of light on the nature of the IBCO as an unstable but balanced orbit point. No orbit can exist closer than the IBCO because it will just spiral inward, like a toilet bowl. In fact, there are two ways to dismiss non-orbits, all initial conditions either orbit, fall into the event horizon eventually, or they escape.
Kerr black holes, two-body problem, and other complications
Obviously we should expect more orbit possibilities if the black hole is spinning. Everything I've cited so far seems to be specific to orbits of small masses (relative to the BH) and non-rotating BHs. A lot of the combinations are apparently still being studied.
Under some conditions, a transition to chaos happens (reference: presentation from the periodic table of BH orbits paper researchers). Exactly what those conditions are is something I'm still unclear on, as a result of me not fully understanding this material.
In the case of a rotating black hole, it would seem that you can even orbit one way, and then stop and start orbiting the other way. Reference: http://www.lsw.uni-heidelberg.de/users/mcamenzi/Kerr_Black_Holes.pdf
I have a hard time imagining how the above picture is consistent with the hyperbolic orbits I see in Wikipedia, as it does not show this direction change at all. Maybe someone else can shed light on the difference and how they can both be true, if that is the case.
Also, if the particle isn't in the plane of the equator of the Kerr black hole, it will move up and down in the direction of the axis of rotation, giving it fully 3D dynamics. Here are some examples.
You can imagine, this is just scratching the surface. Combine that graph with the crazy zoom-whirl graphs, maybe even make it a 2-body problem, and it would make for some pretty fun paths.
In some conditions, the orbit becomes a Homoclinic tangle, which I won't even post a picture of because it just looks like a big knot.
* clarification from further questions in Expression for distance of closest approach in Schwarzschild Geodesics