I don't understand why Gemini Search Engines have gotten into the habbit of not crawling big capsules, like proxies/web-mirrors and journal or news publications. I get the intention behind it, because they can sometimes skew results, or they take a long time, but those things are fixable. If big capsules and proxies skew results, then you change your searching algorithm, not take away people's ability to search that content. If they take a long time to crawl, then just do them at the end after all of the more important content has been crawled. If their contents take too much space, then be more selective on those specific sites about what you store.
2 years ago