I tried to get Eraser not to load at startup and of many tries I found that CClener & enhancer) , both free, disabled Eraser on start up through CCleaners startup control. It will disable or delete it at startup
Thanks for the reminder about CCleaner, which some people will find easier to use for this purpose than msconfig.exe.
If one does as you suggest, you will disable the Eraser scheduler, so this is not something to do if you make use of the scheduling facility. Also, if you do use Eraser, either from the program window or from the context menu, Eraser will work normally, but the running process (and taskbar icon) will remain active when you have finished using the program, unless you explicitly close it again.
Personally, I have never found it necessary to make this tweak (except for test purposes), as I have yet to detect that Eraser has any noticeable effect on system performance when its running process is idle.