Is the soil the problem for poor production of tomatoes in Florida?

I'm somewhat new to Florida (Polk Co). I tried to grow a few tomato and pepper plants in the back yard. It was nonproductive. Blossoms but no fruit. My neighbor laughed and said the Florida soil is the problem and tomatoes do not grow here.