Wendy Krieger's answer with her allusions to the principle of equipartition of energy principle is one take on your question. Here's another, information-theoretic / Jaynesian (see footnote) take on it.
The Boltzmann constant is simply a unit-dependent dimension-normalising factor that accounts for the fact that on the one hand (i) we have a "traditional" temperature scale in Kelvin, Celsius and so forth defined experimentally in terms of expansions of liquids and gasses in thermometers and then an arbitary assignment (fixed by the temperature unit definition) of scale to an experimentally reproducible temperature interval e.g. 100 units between the freezing and boiling points of water, whereas (ii) on the other hand, in a system comprising statistically independent "particles", the Shannon (information theoretic) entropy of the system is proportional to the total system energy which, in turn, is proportional to (i) the number of particles and (ii) the reciprocal of a certain Lagrange multiplier $\beta^{-1}$ (the latter only true in the "high temperature limit"; see for example my answer here where I show it is not true for low temperatures). $\beta$ is defined with the Boltzmann probability distribution, derived from the Canonical Ensemble, prevails at thermodynamic equilibrium and, in a system of statistically independent particles, one finds that the probability of a particle's being in the $\ell^{th}$ energy state is proportional to $\alpha\,e^{-\beta\,E_\ell}$, where $\alpha,\,\beta$ are simply a Lagrange multipliers explained in the Wiki artcile on the Canonical Ensemble. At low values of $\beta$ (more energetic systems containing more heat), $\beta^{-1}$ is proportional to the mean particle energy.
We define the thermodynamic temperature to be proportional to $\beta^{-1}$ and, experimentally, our traditional temperature measurements are found to agree with this notion if we choose the right "offset" to define zero temperature. The constant $k_B$ simply lets us keep our traditional temperature scales, or something near to them in practical cases, whilst being aware of the statistical mechanical interpretation of $T \propto \beta^{-1}$. In "natural" (Planck) units, $k_B$ is set to unity, by definition.
Not all "particles" though behave "atomically" in a thermodynamic sense: experimentally we find that we must treat them as though they behave as though they are made up of several particles if we are to reconcile statistical mechanics with e.g. observations of heat capacity. This is to do with the number of degrees of freedom, and this number can change with temperature as different modes of vibration are "frozen" in or out. So you are right in the sense that entropy is an extensive property, but it becomes a very messy notion if you insist on interpreting it as per "particle" as we would think of it.
So we simply think of $k_B$ as a scaling constant between "experimental" and "fundamental", information theoretic notions of temperature: the "hotter" something is, the greater the number of bits needed to endcode its state fully. The latter are important of course because microscopically Nature's laws are reversible, so an isolated system's state at any time is mapped bijectively to its state at any other time. Nature "does not forget" how it gets into a certain state, and a necessary condition for this to hold is that a system's information content cannot shrink, which of course is the second law of thermodynamics.
Footnote: Edwin T. Jaynes was a physicist, mathematician and philosopher who thought very deeply about the theoretical groundings of probability theory, inspired by an information theoretic / symmetry (group) theoretic take on thermodynamics and the wish to unite Shannon's information theory with Boltzmann / Gibbs thermodynamics.