I would consider composting it before mixing it into the soil as an amendment (although I have never mixed it in directly so don't really know if it would be a problem) or just using it as a top dressing/mulch layer which is what I usually do with it (not bananas yet, but lots of other plants) and it works great that way.
