International Sports Federations fret over lost Olympics income