Role of Van Hove singularities and effective mass anisotropy in polarization-resolved high harmonic spectroscopy of silicon