Certainly the usual structure with "neglect" is to follow it with an
infinitive rather than a gerund. Note that "to" is part of the infinitive.
The gerund is possible, since "neglect" can be followed by a noun, and a
gerund is a verbal noun.
https://forum.wordreference.com/threads/
negrect-neglect-to-infinitive-or-gerund.1375228/