You're not thinking creatively enough, Stu!
Consider: If a currency slighly deflated in value each year, banking could actually be profitable without charging interest.
But forget profit. I believe all banks should be not-for-profit utilities instead of machines for extracting unearned value from the contributor class.
With an stable, inflation-free currency, a not-for-profit banking system, and a democratic government to loan money to the NFP banks interest-free, all money could easily be lent interest-free.
I'll only briefly note that there's no such thing as a privatized publicly-owned bridge.
But you're right, the Daman Model could successfully fund all income-producing infrastructure projects (hydro dams, trains, old folks homes, housing coops, etc.) All no-fee public infrastructure would still be paid via taxation, ideal with a Georgist land value tax.