Well, 4 AAs at 1.5 volts wired in series gives you 6 volts, so they will not be as strong. Check the ratings on the fans you plan to use and match up your power supply accordingly. DC electronics are fairly simple and there is a lot of good info out there for the creative searcher.
HTH,
Adam