See widgets/widget-pager.js#L94 - if you don't configure it, it returns nothing, even if your ajax endpoint already returns the data in exactly the format you would need.
In that case you then have to everywhere configure pager_ajaxProcessing: function(data){return data}.
Could that not be the default?