I am not sure where you are stuck. But, what I did was collect everything to the stone, gather the food, build the quarry and upgrade the tent to 2 people. Take the large stone and crystal, collect food again from both gardens, build the sorceress house and have her activate the portal. Upgrade the stone mine, from there you go through the portal to the left and start collecting stone and filling holes and collecting stone and food etc. Keep collecting the food and build the lumber mine and the crystal mine. You need 4 crystals to activate the portals. Next portal is by the merrymaker log, build that once and keep the merrymaker at the stone mine.
Keep filling holes, collecting wood, food, stone and crystals and have the sorceress feed the giants.. I never build the second stone mine and eventually added one more person to collect items for a total of 3.