The implementation of stone columns as a ground improvement technique in soft soil is aimed at enhancing bearing capacity and reducing total and differential settlements. These columns function as vertical drains, expediting consolidation and diminishing settlement. A comprehensive sequence of parametric analyses has been conducted to examine the influence of various parameters on both the load-carrying capacity and settlement behaviour of the ground improved with stone columns. Specifically, the load capacity analyses have considered five essential variables: namely, the diameter of the stone column (D), the spacing of the stone column (S), the angle of internal friction of the column material (ϕc), the effective unit weight of the soil (γ), and the undisturbed undrained shear strength of the soil (cu). Moreover, the settlement analysis has scrutinised two critical variables, the stress concentration ratio (n) and the height of the embankment (H), in order to elucidate their influence on the settlement behaviour of the ground improved with stone columns. It has been observed that increasing the spacing-to-diameter ratio (S/D) from 2 to 3 consistently decreases the overall safe load (Q) on the stone column improved embankment, and this reduction in safe load is more pronounced when using a lower ϕc. On the other hand, when the height of the embankment (H) is increased from 2 to 6.5 m, there is a significant 69% increase in the net settlement of stone column groups. In addition to the parametric analyses, determinate sensitivity analysis has been undertaken to discern a reduced set of parameters that necessitate consideration as random variables in the reliability-based design of stone columns. This meticulous approach ensures a comprehensive understanding of the behaviour of stone column improved ground and yields valuable insights for engineering design and construction practices.