Comment by n-e-i-b on 14/12/2022 at 22:17 UTC*

3 upvotes, 2 direct replies (showing 2)

View submission: Update on COLO switchover -- bug fixes, reindexing and more

Hi

"total_results" is no longer returned in metadata.

There is a "total" field but it's limited to the default ElasticSearch value : 10 000

Edit : I tried to add "&track_total_hits=true" in the url. Seems to work better, but a lot less results than before. But maybe the reindexing is still processing

Replies

Comment by n-e-i-b at 15/12/2022 at 18:06 UTC

2 upvotes, 1 direct replies

It seems that the "since" parameter has a default value of "one month ago"

Setting this parameter to another date and add track_total_hits=true seems to give you the real value

Comment by abelEngineer at 15/12/2022 at 13:34 UTC

1 upvotes, 0 direct replies

Thanks, I was also wondering why total_results was not in the metadata. I didn't know that it used to be. I only just started trying to use PushShift this week. Bad week to start unfortunately.