I think it will be OK. One of my bananas is too close to a old barn(think that's the correct word). I mean really close - 3ft on a east from the bilding(I plant it there, cause that place is protected from dominating in that area western winds), and
you can see on a photo this is not problem for the plant although even in a longest summer days the plant was in shadow after 4-5 p.m