Mine is like that around the bottom rear lip. Came that way when we purchased the car used.
Yes, it doesn't seem like there is enough material to do the repair.
So I ignore it as it hasn't gotten any worse.
My wife never likes the hardtop installed (been on the car on two occasions since 2000), so it's not a priority.
You might consult an upholstery shop. It's not a major repair, so they could probably do it right for about $100...