. . . . . . . . + .
. : . .. :. .___---------___.
. . . . :.:. _".^ .^ ^. '.. :"-_. .
: . . .:../: . .^ :.:\.
. . :: +. :.:/: . . . . . .:\
. . _ :::/: . ^ . . .:\
. . . - : :.:./. . .:\
. . . ::. ::\( . :)|
. : . : .:.|. ###### .#######::/
. :- : .: ::|.####### ..########:|
. .. . .. :\ ######## :######## :/
.+ :: : -.:\ ######## . ########.:/
.+ . . . . :.:\. ####### #######..:/
:: . . . . ::.:..:.\ . . ..:/
. . .. : -::::.\. | | . .:/
. : . . .-:.":.::.\ ..:/
-. . . . .: .:::.:.\. .:/
. : : ....::_:..:\ ___. :/
. . .:. .. . .: :.:.:\ :/
+ . . : . ::. :.:. .:.|\ .:/|
. + . . ...:: ..| --.:|
. . . . . . ... :..:.."( ..)"
. . : . .: ::/ . .::\
馃憢 Programmer and Theology Major in University.
馃實 Iowa, US
馃棧 Followers 40 路 Following 18 路 Logs 192 路 Docked 2 years ago
So... this is what happens when you deal with multiple languages: Turns out golang's defer acts quite different from Odin's defer. In Odin, defers happen on exit of any block/scope, whereas golang's defers only happen on exit of the function. Since I used a defer in a for loop in golang, none of my gemini client requests for my crawler were closing! Sigh... anyways, it's fixed now.
馃挰 1 Reply 路 1 Thumb 路 1 year ago
AuraGem Search can now parse dates in filenames and gemtext titles. This information is stored during crawling so that it can provide a way to list and order posts based on publication date. For example, this new page shows all posts with a publication date within the last year, ordered from newest to oldest: gemini://auragem.space/searchengine/yearposts
馃挰 1 Reply 路 1 Thumb 路 1 year ago
Trying some things for AuraGem Search: gemini://auragem.space/searchengine/test
馃挰 2 Replies 路 1 Thumb 路 1 year ago
Currently writing a 6-page article for my personal gemlog. It might take a while before I publish it, because there's a lot to discuss.
馃挰 1 Reply 路 2 Thumbs 路 1 year ago
You can inspire change to happen, but you cannot shame change to happen.
馃挰 8 Replies 路 2 Thumbs 路 1 year ago
Where I live we have a bunch of weird laws that are fortunately not enforced: A man with a moustache cannot kiss a woman in public In one city, the fire department must practice fire fighting 15 minutes before attending a fire In another city, a man cannot wink at a women he does not know, within corporate limits of the city. A kiss cannot last longer than 5 minutes One-armed piano players must perform for free Ministers must have a permit to carry liquor across state lines You cannot read a person's palms within city limits of one of the cities.
馃挰 5 Replies 路 3 Thumbs 路 1 year ago
Found an interesting robots.txt :D gemini://gmi.derschwarzestrahler.at/robots.txt
馃挰 0 Replies 路 4 Thumbs 路 1 year ago
Working on a new devlog post, since I'm now almost over being ill.
馃挰 1 Reply 路 1 Thumb 路 1 year ago
This is an interesting read, especially the "bias" section :D It's important to learn from others' mistakes. gemini://gemi.dev/cgi-bin/wp.cgi/view?Google%20Knowledge%20Graph
馃挰 0 Replies 路 0 Thumbs 路 1 year ago
I have been thinking about comparing how we index/organize websites to how books are indexed and organized...
馃挰 6 Replies 路 2 Thumbs 路 1 year ago
So, just got an email about my article on Unix Shell History, from someone who seen it link to it (using @mozz's gemini portal) on the BSD Reddit. Someone else posted it there, 10 hours ago. I literally completely forgot that I wrote that, lol. It's been 2 years since I wrote that article. gemini://auragem.space/~krixano/ShellHistory-Unix.pdf
馃挰 2 Replies 路 2 Thumbs 路 1 year ago
There's always going to be some people who are mad when you challenge established conventions, no matter the field. Sometimes it's justified and sometimes it's not. What's important is how well they engage with what you are saying. If they write random anonymous posts that are vague and merely attack who you are or what you know without engaging with the actual content of what you are saying, then they are not worth considering. Some of the best achievements were by people who were attacked for thinking differently, and the Gemini protocol is one of them.
馃挰 1 Reply 路 5 Thumbs 路 1 year ago
Let my devlog post be a useful lesson. When people condescend you, question your knowledge or skills, or try to make themselves look more important, smarter, or bigger than you - use the energy you get from that to come back fighting with great posts, projects, art, etc.
馃挰 1 Reply 路 4 Thumbs 路 1 year ago
One of the parts of my new devlog post that I really want to stress: This also introduces the argument that the ranking systems are really only important for underspecified queries (broad queries), so the emphasis on the problems with ranking algorithms in unwarranted. This argument hardly makes sense when the majority of searches that people make are broad. I would also argue that broad searches are most used for *discovering* pages, not for getting to a specific page. However, ranking based on popularity prioritizes what it thinks people would want, which is more suited for specific searches using broad queries, at the expense of discovery of broad topics. [1/2]
馃挰 3 Replies 路 2 Thumbs 路 1 year ago
New Devlog Post: Search Engine Ranking Systems Are Being Left Unquestioned gemini://auragem.space/devlog/20220722.gmi
馃挰 5 Replies 路 1 Thumb 路 1 year ago
gemini://gemi.dev/cgi-bin/wp.cgi/view?Link%20farm Gemipedia on Link Farms Since people want to act like Page Ranking algorithms are not broken, I give you the article above. Not only is there link farms that artificially increase a page in search results, there is also a chance for false positives where sites are penalized for looking like a link farm, *and* whole demains have to be unsearcheable because they are removed for being a link farm. Ranking may only be used/visible in "underspecified" search queries, but the majority of all search queries are underspecified, especially if you use FTS of page contents, where even common words can be matched.
馃挰 19 Replies 路 0 Thumbs 路 1 year ago
AuraGem is 1 of the 2 search engines, out of 4 overall, that returns results on binary data. The other one is GUS, but GUS doesn't save binary metadata (let alone page titles) like AuraGem. AuraGem gets metadata from ogg & mp3 files. It is the only search engine that respects the CrawlDelay in robots.txt , afaik AuraGem's crawler is threaded, which makes crawling faster, particularly in cases where extracting metadata information takes a long time. It did all of the above prior to the two new search engines, Kennedy and TLGS. At that time it was called Ponix. Finally, It might be the first gemini search engine to introduce some type of audio-to-text searching. More details coming soon...
馃挰 0 Replies 路 3 Thumbs 路 1 year ago
I don't know why I have to fight off people who want to be extremely defensive about their favorite search engine algorithm. I've made my choice. I've read the papers, I've seen the band-aid fixes that are required to prevent link spam and reduce TKC effect crap, even though these two things only exist *because* of the algorithm looking at links the way it does, which is extremely explicit in the papers themselves. I don't give a crap that these papers call it "authority" or "influence". That's just a cover-up to make it sound fancier than it really is, which is literally popularity - statistics on how many links something has, and how many pages link to it.
馃挰 2 Replies 路 1 Thumb 路 1 year ago
Read this abridged paper on SALSA (an "improved" version of HITS) yesterday, for those people who want to condescend me about rejecting other people's work. It's fine if you want popularity-searching, and it *better* fixes some of HITS's core problems that result in the TKC (Tight Knit Community) effect. It seems to me instead of picking the "best" authority to put at the top, it basically just spreads the top results a bit more between the other top authorities. The authors fully admit that anything below the top 10 results is probably not ordered well, but they justify not caring about that. I definitely won't be using it for AuraGem. https://www.ra.ethz.ch/cdstore/www9/175/175.html
馃挰 11 Replies 路 0 Thumbs 路 1 year ago
I will be working on adding Full-Text Search to AuraGem Search today. This should hopefully significantly improve queries. This only applies to metadata - page contents will still not be cached.
馃挰 1 Reply 路 2 Thumbs 路 1 year ago
One of the biggest criticisms of Google and other big search engines is that they put too much emphasis on popularity. To call this searching by *relevance* is disingenuous, imo, because popularity has nothing to do with the relevance of the search. Instead, these types of algorithms assume that people *want* the most popular or "authoritative" pages. But the biggest mistake is presuming that more authoritative pages are ones that are linked to the most, especially when making this presumption on the internet where false information spreads like wildfire.
馃挰 14 Replies 路 2 Thumbs 路 1 year ago
I'm soon going to write a few articles covering my thought processes behind the choices I've made and ideas I've had for my search engine (AuraGem Search). It will cover why I reject both HITS and PageRank -based systems, and the limitations of Full-Text Search. Should be interesting... This isn't the only search engine I've done, even if I'm still somewhat new at it, and it won't be my last iteration.
馃挰 1 Reply 路 1 Thumb 路 1 year ago
Just got a really cool idea for my YouTube proxy that was inspired by a post by @skyjake . Working on it now....
馃挰 0 Replies 路 2 Thumbs 路 1 year ago
New Devlog on AuraGem Search Engine Updates: gemini://auragem.space/devlog
馃挰 2 Replies 路 3 Thumbs 路 1 year ago
Sometimes there's this tendency to claim that when someone doesn't agree with you, instead they just didn't understand you. Sometimes there's this tendency to skim what someone says and completely misinterpret them. Sometimes a person is incapable of truly understanding someone because of context that they don't have, or problems with non-verbal queues, intonation, etc. And sometimes someone doesn't understand you because your words are vague, confusing, too general, etc. Sometimes not every situation is alike.
馃挰 1 Reply 路 3 Thumbs 路 1 year ago
@acidus Just wanted to say, your Kennedy search engine is really cool! I started my own search engine a year ago, but I've been completely failing keeping it running and maintaining it. It stalled early on because I was getting frustrated with the querying being too slow. I'm just now starting to improve it. I really liked that you added Gemipedia search directly into the search results. I really like that feature. It seems like my search engine is a difference purpose from yours so maybe there's room for two different types of search engines :D
馃挰 20 Replies 路 1 Thumb 路 1 year ago
Blech! Numbers are so inconsistent! Half of them are even and half are odd, and then there's only some that are prime and some that are not. And you can't even use all of them in place of one another. And don't even get me started on decimals and base systems! It's about as inconsistent as languages, with their different types of words that can only be put in very specific places with all these weird rules and exceptions.
馃挰 3 Replies 路 1 Thumb 路 1 year ago
AuraGem progress update so far for July: Access to Qur'an, Christian Bibles, and Jewish Texts (Sefaria Proxy), security.txt, youtube proxy updates, github proxy updates (issues), new Twitch Proxy, Guestbook, AuraGem Music, and brought back up the Search Engine. I've done quite a lot so far this month! What's next: Github Branches, Search Engine improvements, finish fixing up the Sefaria Proxy, more religious texts, and a few new service ideas that I want to try out.
馃挰 0 Replies 路 1 Thumb 路 1 year ago
gemini://republic.circumlunar.space/users/flexibeast/gemlog/2022-07-14.gmi I'm glad at least one other person finds my Sefaria proxy useful :D Also wanted to write that I haven't forgotten about the bugs in the proxy. I'm working on fixing them, I just have 5 million projects I'm working on for gemini, lol.
馃挰 0 Replies 路 0 Thumbs 路 1 year ago
It seems like midnight.pub and smol.pub both might be sending the wrong mimetypes for images and other files. If I continue to run into this problem, I will probably contact the owners of these two capsules.