So I have a fanciful, ¾-formed idea about quantitative ranking of thread quality.
It’s not “objective“, because some of it requires opinion of an expert. It’s also not entire subjective because the heuristics are constrained. If it works, it will produce a numerical score for a thread. Right now, it’s an open-ended score but it could possibly be scaled to thread length or something. I also allow the score to go negative because… some threads are.
This is just a fun Gedankenexperiment, don’t take it too seriously.
So here are some of the proposed rules for scoring. This isn’t intended to be an exhaustive list, just some musings. The idea (for me) is to think about what I value in a thread and have some idea what to include and avoid, with weighting. I think most of us can get any of the scores on the list from day-to-day, positive and negative and I want to work out how to make my participation better. This is just a sort of brainstorming about that.
Do you have ideas?
It’s not “objective“, because some of it requires opinion of an expert. It’s also not entire subjective because the heuristics are constrained. If it works, it will produce a numerical score for a thread. Right now, it’s an open-ended score but it could possibly be scaled to thread length or something. I also allow the score to go negative because… some threads are.
This is just a fun Gedankenexperiment, don’t take it too seriously.
So here are some of the proposed rules for scoring. This isn’t intended to be an exhaustive list, just some musings. The idea (for me) is to think about what I value in a thread and have some idea what to include and avoid, with weighting. I think most of us can get any of the scores on the list from day-to-day, positive and negative and I want to work out how to make my participation better. This is just a sort of brainstorming about that.
Do you have ideas?
Rule | Value |
TS post is written in a way that an expert can solve the problem based on just what is provided. | 10 |
TS post is written in a way that an expert can ask the right questions directly to solve it based on what is provided. | 10 |
Response welcomes new member to AAC. | 2 |
Response solves the problem for the TS without further interaction. | 10 |
Response asks clear questions which eventually lead to a solution. | 3 |
Response provides clear answers that would assist an expert to solve the problem. | 3 |
Response warns of genuine safety issues. | 4 |
Response warns of genuine regulatory issues. | 3 |
Response (not TS) provides information to helping expert that assists in solving the problem. | 5 |
Response thanks members for help. | 5 |
Response provides useful but tangentially related Information. | 2 |
Response makes people laugh (not at someone’s expense) without interrupting help. | 3 |
Response (from sidelines) confuses the TS and disrupts the help. | -3 |
Response demonstrates poster did not read the TS post carefully enough to see all the information provided. | -3 |
Response is a derogatory comment about the TS. | -5 |
Response is a derogatory comment about another member. | -5 |
Response is tangent into a non-working solution. | -4 |
Response is an unhelpful criticism of the method being discussed, even though the current thread is on target to a solution. | -3 |