• @MJBrune@beehaw.org
    link
    fedilink
    English
    161 year ago

    How does this show customization of almost anything? Looks like you can only apply one optic at a time and they are very limited in scope. Like I’ve never cared about hacker news. I don’t care to remove the 10k most popular sites, in fact it’s want the opposite. Additionally I’d want to mix and match optics. Also let optics be customable. Like why 10k top sites. Why not top 1k or bottom 3000k. How many are there even? The number means nothing if you don’t understand what you’re left with.

  • Destragras
    link
    fedilink
    12
    edit-2
    1 year ago

    I tried finding information on what indexer they are using. Are they using their own?

    Edit: says this in the readme:

    The commoncrawl organization for crawling the web and making the dataset readily available. Even though we have our own crawler now, commoncrawl has been a huge help in the early stages of development.