Infrastructure Australia's annual market capacity report has revealed there are only 177,000 workers currently in the system, despite there being enough demand for the equivalent of 405,000 workers.