#evaluator

Lightcone Commons: what I funded and why

I am an evaluator for Lightcone Commons (LC). LC is a platform for applicants to submit projects, for evaluators to rank them and for funders to choose the funding orders of several evaluators. It is not a foundation, in that it doesn’t have money that it spends how it chooses. And I do not have a permanent position working for Lightcone Commons. I get paid 2% of any money that a funder chooses to direct via my funding order. This pays for my time and also for any research that I pay others to do. That said, what were my general and specific funding preferences? This is a version of what Light

LessWrong · EN

Show HN: A lightweight RAG evaluator with golden-set metrics

Evaluate RAG pipelines against golden sets with retrieval recall, faithfulness, relevance, answer accuracy, and latency metrics. No SaaS or signup required. - infrixo-systems/rag-evaluation-starter

Show HN · EN

Organizations I'd recommend for funding

I was a grant evaluator for Lightcone Commons last round. Funders disbursed about $45mil through the program, and this included funding roughly my first $6.8 million worth of recommendations. There are other projects I would've preferred to fund over what I did fund, but nobody was doing them and so they weren't on offer. Here's a series of projects that I'd fund in the next round, in rough order of priority. The next round is starting now, and is scheduled to end mid-December. I expect rounds to continue at similar speed. I expect similar amounts of funding will route through me in future rou

LessWrong · EN