Build · Create · Analysis & Finance

Build the boundary-case test set for a contested term in my field

You get a boundary-case test set for one contested term: a set of edge cases, an in-or-out verdict for every case under every rival definition you supplied, at least one case that the rival definitions actually split on, and a named residue of cases your own preferred definition leaves undecided.

You receive: A JSON boundary-case record: the contested term, a numbered case set (each case with a short phenomenon description and the feature statements it contests), a complete verdict matrix using exactly the three allowed verdict values "in", "out", and "unsettled", a four-criterion assessment (operational, essential, widelyApplicable, succinct) for each supplied definition using exactly the three allowed values "meets", "fails", and "unclear", and a residue list of the case ids your preferred definition marks "unsettled".

Part of Win Market

What's verified: STUD verifies the STRUCTURE of the boundary-case set only. It checks that the record is about the term you named; that you supplied at least your minimum number of rival definitions and that each one carries a source attribution; that you supplied at least your minimum number of cases with no case repeated; that every case is judged under every supplied definition, exactly once, with nothing left blank; that every verdict is one of exactly these three literal strings: "in", "out", "unsettled" (nothing else passes, including "yes", "no", "maybe", "+", "-", "?"); that at least your minimum number of cases are ones the rival definitions actually split on; that exactly one case is flagged as a control and that all definitions agree on it; that every other case names at least one of your supplied feature statements it contests; that every supplied definition is scored against exactly the four criteria operational, essential, widelyApplicable, and succinct, each using one of exactly these three literal strings: "meets", "fails", "unclear"; and that the residue list is exactly the set of cases your preferred definition marks "unsettled", no omissions and no extras. STUD does NOT verify that a case is well chosen, interesting, or representative of the real edges of your term. STUD does NOT verify that a verdict is CORRECT: whether a given definition truly puts a given case in or out is a reading of that definition, and readings are contested (in the source paper 52% of surveyed professionals contradicted their own stated criteria when judging cases). STUD does NOT check succinctness by word count, because the source names succinctness as a criterion but sets no numeric threshold. STUD does NOT require that every feature statement you supply be contested by some case: the source's own 20-case set left one of its 13 statements (D, on observability) untested by any example, so full coverage is not treated as a law here. STUD does NOT judge whether your preferred definition is better than its rivals. The field or discipline you name is collected as context for the operator and is not itself checked.