Pomegranates

 I'm pretty new to pomegranates... that is growing them.  To the best of my knowledge there is never a time when a ripe fruit is not red inside, or at least pink.  My tree was planted by me maybe 4 or 5 years ago.  The last couple of years it has had a plethora of blossoms, and only a few of them have turned into fruit.  Last year there might have been 6 pomegranates, but none of them ever got to an edible state... never beyond the fruit that is pictured here.  Now there were maybe a dozen this year, but I am having the same issue.  They grew to be what I presume is a good size, and I have left them on the tree to ripen.  They have been at this stage for more than a month, maybe even a couple months.  Based on what I read, these pomegranates are showing signs that tell you they are ripe and should be ready... but there is no difference than when I cut one a month ago.  

I know there has to be so much more to getting a fruit tree to produce than I even have a clue about.  I don't have space to plant multiples that would allow cross pollination, and the soil here is not the best.  I don't like to use chemical fertilizers, but in desperation I have used some fertizlizer spikes... still to no avail.  It is so hard to learn how to water plants here in South Texas.  If you water every day it's too much, if you water once a week it's not enough.  I've tried everything in between, and still not getting better results.  

The blossoms were abundant, but even the few fruit that it did produce never seemed to ripen.  I will leave what fruit is left on the tree there, but I don't expect any of them to get to the "ripened" stage.  

Should I give up on ever getting any fruit and just enjoy a pretty tree?  Fruit trees can be quite beautiful, especially when they are in blossom, but I'm thinking I'm not cut out to be a fruit grower.