No hose should be spongy. They should all feel like solid rubber, firm.
Good idea to:
1: Replace that hose, (both upper & lower radiator hoses if they are same age)
2: Check that waterpump impeller
3: Have system flushed (especially if waterpump impeller broke off) Flushing might reveal a blockage.