when you pass that point and are still maintaining your altitude, some of them may get cranky.
Not true. If a controller gives a discressionary descent, they don't care where you start your descent.
If they need you to start down, they'll tell you to start down.. Doesn't mean they're being cranky!! Some controllers just sound cranky when they're doing their job.
Giving a discresionary descent is basically doing you a favour. He could have just waited til he wanted you down, and then given you the descent with no descresion. He could have pushed you down right away instead of giving you the discresion. He's trying to restrict you as little as possible.
There's no WAY a controller would get cranky at a pilot who wants to hang it up for a while after being given a discresionary.
On the other hand, if he gave you a descent without Pilot's discresion, and you waited, or tootled down at 100fpm, He could get very cranky. Like was said before, he may have thought he didn't give you P.D. Either way, not your fault.