In modern capitalism, governments routinely borrow money. They do this to finance budget deficits that occur when governments raise less in taxes than they spend. Governments also borrow to invest in long-term projects of economic development. The swindling occurs when the lenders and borrowers—usually private financiers and career politicians—negotiate loans that serve their own particular interests at the expense of the taxpayers who eventually cover the costs of repaying the government’s loans plus interest on them.
If governments raised enough taxes to cover their desired levels of spending, they would not need to borrow. Taxes imposed on the wealthiest corporations and individuals would be the most equitable strategy. The corporate wealthy protest, of course, threatening that if taxed, they might reduce their contributions to the economy (investing less, etc.).