Justice Secretary Alex Chalk said the foreign national inmates were costing the purse hundreds of thousands of pounds a year when they could be deported.
The government will explore the option of moving prisoners to foreign countries, provide the estate facilities meet British standards.