Actually the typical fighting castle wall technique was a foot or two thick layer of stone (usually dressed, but not always) followed by over six or 8 feet of rough stone/rubble fill then an inner layer of fitted stone. Quality was very dependant on the time frame for the construction, the amount of funds available and the perceived level of threat.

Pass no temptation lightly by, for one never knows when it may pass again!