Nephrolithiasis, also referred to as kidney stone disease, is a major worldwide health issue, and the most common form is calcium oxalate. The application of medicinal herbs in its prevention and treatment has attracted significant interest because of their bioactive constituents with antiurolithic activity. In this review, in vivo studies on rat models of calcium oxalate nephrolithiasis are critically assessed systematically to determine the efficacy of medicinal herbs. The review identifies major herbs, their mechanisms of action, experimental results, and possible clinical uses. Results indicate that most medicinal herbs have nephroprotective, antioxidant, anti-inflammatory, and diuretic effects, which help in decreasing stone formation and recurrence. More studies are required to standardize the dosages and confirm their efficacy in human trials.