Let \(\mathcal {F}_d(X;G)\) denote the set of number fields of degree d with absolute discriminant no larger than X and Galois group G. This set is known to be finite for any finite permutation group G and \(X \ge 1\). In this paper, we give a lower bound for the cases \(G={\text {GL}}_2(\mathbb {F}_\ell )\) and \({\text {PGL}}_2(\mathbb {F}_\ell )\) for primes \(\ell \ge 13\).