Keep in mind that pressure is not force. Also, pressure is not mass per area. Pressure expresses the ratio of differential force exerted normal to a surface per differential area, and is expressed in units of force per area.
A pressure of 100 kPa exerted on a surface means that on 1 cm$^2$ of that surface there is a total force of 10 N normal to the surface of that square centimeter. One must remember, however, that there may be a pressure applied to the other side of that surface resulting in a force in the opposite direction.
Pressure is not a vector, and in our gravitational field, the local pressure at a fixed altitude is roughly constant. The force on a surface due to atmospheric pressure is always normal to the differential surface area, so sometimes the resulting force is up, sometimes down, sometimes sideways.
Differences in and changes in temperature of the atmosphere introduce changes and differences in air density which create horizontal pressure differences. This is what causes wind, resulting in weather systems moving across the globe. But the mean atmospheric pressure remains very close to 101 kPa (1013 mbar) near sea level. Hurricanes/cyclones have central pressures in the 90-98 kPa (900-980 mbar) range, with lower pressure being stronger storms.