I guess it wasn't a power problem afterall, It seems that I got about 3/12 of the pots interfering with each other. I wonder how to fix that.
I found out that pots are not actually interfering, just two pots or axo pins are not working correctly. Need to dig in deeper. So far 10/12 axo pots working. Still got to get the 12 teensy pots to work.