Trending Tags
  • #realy
  • #YESTR
  • #yestr
  • #yarnstr
  • #yarn
Trending Notes
Global
Trending Profiles
  • mleku
    @mleku
  • Silberengel
    @Silberengel
  • Jay
    @Jay
  • makomichi the wolf of weeb street
    @makomichi
  • The Daniel ⚡️
    @daniel

Nostr View


mleku @mleku - 2d

#realy #devstr #progressreport so, i finally have some kind of indexing happening it's quite incredible how big these full text indexes are, just on the face of the size of the database directory it looks like it takes more space for the index than the data i probably need to try and put some kind of a further limit on how many symbols get an inverted index perhaps, i mean, gotta be some of those records are literally the whole event store for virtually every note because it has the word "the" in it, but how do i do this correctly without getting the problem of either making giant lists of prepositions in every language... well, i'll see i guess i mean, it's kinda worth it if i can implement fast full text searching of notes, even if the storage space is greatly increased... it just is a lot of space anyhow in the process of doing this i ran into a nasty thing in badger where it just kills the process completely, without any feedback. i had to use a go workspace, cloned the badger repo into it and then i was able to insert a panic message and actually get a traceback, and eventually figured out i was using iterators for something that just needed the use of a simple Get call to see if the literal exact key existed.

0
0
3

Showing page 1 of 1 pages