First "hugs" as this is harder on you than him. DGS whom we care for much of the time is allergic to eggs and peanuts. Our best source has been our doctor. Asking him EXACTLY what is and is not ok for YOUR child will make planning much easier.
For example:
It sounds like the milk allergy casues digestive problems and not the full anaphalatic reaction. If so, can he have trace amounts in cookies etc or not? Is trace eggs ok or not?
Peanuts..can he have made in the same factory or not??
We know that our DGS is ok with tiny amounts of trace eggs in baked products but will have a local reation if he just touches raw egg or has egg whites.
Our dr says "made in the same factory" is ok but not traces of peanuts.
We are never more that a hand from his epi pen.
We also started very early educating him. He now "reads" every lable before he will eat it.
I suggest a long trip to the store by yourself and read EVERYTHING your family buys. You still have have to reread the lable every time as it can change . One size of a hersery bar is safe, the other not!

.
Learn to wipe down anything he might touch that could have peanuts etc, such as a shopping cart, and teach him not to touch any food without asking. DGS knows not to touch the candy in the checkout line.
We choose not to eat anything around DGS that he can not have but that might not work for your family.
He is only one ,but start making it a part of you everyday conversation
Good luck and let us know if we can help any more.