Novikov algebras were introduced in connection with the Poisson brackets of hydrodynamic type and the Hamiltonian operators in formal variational calculus. In this note we prove that the underlying Lie algebras of quadratic Novikov algebras are 2-step nilpotent. Moreover, we give the classification up to dimension $10$.