The government will provide financial support to Australian banks to help stamp out financial crime and help them remain in the Pacific Islands.