Not really: bananas originally come from India and South-East Asia, and Imperial Roman merchant fleets actually traded massively with these regions. The commercial exchange with India was apparently huge, and some Roman writers even complained about it!