Creating this post because in last few months observation is that most of the drivers call assigned rider and asking where are they going and if rider says the destination address driver cancels the ride because the don't want to go that way.
For this if drivers are allowed to call riders only when they come in certain arc of the rider's pickup location, or when they reach pickup location, that may resolve the problem a bit.