I found some articles on this a month or so ago. It seems that there are a lot of people out there who believe that bananas bring bad luck to fisherman .
Here's a few links :
The Story on Bananas and Bad Luck
Superstition, They don't call me lucky for nothin', Richard Alves, The Fish Sniffer
There are a lot of sites with these type of stories.
I had dinner with my aunt from Malaysia last week and asked her about banana plantations and she told me about a superstition . Some people there believe that if you tie a red string to the p-stem of a banana plant and extend it to the bedroom window of someone you don't like they will be visited my something scary. According to this legend if the person is very strong or strong willed the scary thing will find you instead !