The flurry of theoretical and experimental studies following the report of room-temperature superconductivity at ambient pressure in Cu-substituted lead apatite CuPb(PO)O (`LK99') have explored whether and how this system might host strongly correlated physics including superconductivity. While first-principles calculations at low doping () have indicated a Cu- configuration coordinated with oxygen giving rise to isolated, correlated bands, its other structural, electronic, and magnetic properties diverge significantly from those of other known cuprate systems. Here we find that higher densities of ordered Cu substitutions can result in the formation of contiguous edge-sharing Cu-O chains, akin to those found in some members of the cuprate superconductor family. Interestingly, while such quasi-one-dimensional edge-sharing chains are typically ferromagnetically coupled along the chain, we find an antiferromagnetic ground-state magnetic order for our cuprate fragments which is in proximity to a ferromagnetic quantum critical point. This is a result of the elongated Cu-Cu distance in Cu-substituted apatite that leads to larger Cu-O-Cu angles supporting antiferromagnetism, which we demonstrate to be controllable by strain. Finally, our electronic structure calculations confirm the low-dimensional nature of the system and show that the bandwidth is driven by the Cu-O plaquette connectivity, resulting in an intermediate correlated regime.