Skip to content

Instantly share code, notes, and snippets.

@lmmx

lmmx/token_f1_micro_by_f1.tsv

Last active February 9, 2026 01:50
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save lmmx/93ee1bb4e8e31fe72c7b1e294cd05706 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save lmmx/93ee1bb4e8e31fe72c7b1e294cd05706 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
token_f1_micro_by_f1.tsv
marker precision recall f1-score support
B-literate_list_structure 0.932 0.788 0.854 52
O 0.75 0.819 0.783 37244
B-oral_inclusive_we 0.581 0.921 0.712 266
B-oral_imperative 0.654 0.782 0.712 87
B-oral_rhetorical_question 0.535 0.933 0.68 89
B-literate_conditional 0.595 0.742 0.661 97
B-literate_concessive 0.517 0.818 0.634 55
I-oral_rhetorical_question 0.683 0.554 0.611 840
B-oral_phatic_check 0.467 0.875 0.609 24
B-literate_agentless_passive 0.607 0.598 0.603 351
-literate_technical_abbreviation 0.477 0.788 0.594 66
I-literate_probability 0.536 0.652 0.588 23
-literate_technical_abbreviation 0.447 0.815 0.577 108
I-literate_list_structure 0.706 0.48 0.571 596
I-literate_agentless_passive 0.723 0.472 0.571 839
I-literate_concessive 0.564 0.551 0.557 512
B-oral_vocative 0.42 0.778 0.545 27
I-literate_nominalization 0.476 0.619 0.538 399
I-oral_vocative 0.417 0.686 0.519 51
B-oral_second_person 0.387 0.711 0.501 142
I-oral_temporal_anchor 0.425 0.6 0.498 255
B-literate_epistemic_hedge 0.462 0.536 0.496 179
I-literate_agent_demoted 0.491 0.487 0.489 318
B-literate_contrastive 0.356 0.767 0.486 90
B-literate_nominalization 0.653 0.377 0.478 763
B-literate_agent_demoted 0.347 0.75 0.475 56
I-oral_phatic_check 0.421 0.533 0.471 45
B-oral_phatic_filler 0.396 0.571 0.468 70
I-literate_enumeration 0.539 0.41 0.466 607
B-oral_specific_place 0.333 0.767 0.465 73
B-literate_probability 0.361 0.65 0.464 40
I-oral_imperative 0.346 0.674 0.457 95
B-literate_objectifying_stance 0.333 0.72 0.456 25
I-literate_technical_term 0.6 0.353 0.445 745
I-literate_citation 0.589 0.341 0.432 572
I-literate_objectifying_stance 0.378 0.487 0.426 115
I-oral_dramatic_pause 0.327 0.607 0.425 28
B-literate_enumeration 0.327 0.607 0.425 84
I-oral_inclusive_we 0.37 0.498 0.425 257
B-oral_temporal_anchor 0.324 0.572 0.414 138
B-oral_embodied_action 0.361 0.484 0.413 155
B-literate_concessive_connector 0.365 0.475 0.413 40
I-oral_named_individual 0.32 0.556 0.406 270
B-oral_named_individual 0.298 0.578 0.393 135
B-literate_metadiscourse 0.333 0.434 0.377 76
I-oral_specific_place 0.287 0.531 0.372 96
I-literate_metadiscourse 0.473 0.304 0.37 312
I-literate_epistemic_hedge 0.371 0.351 0.361 259
B-literate_aside 0.272 0.524 0.358 42
I-oral_lexical_repetition 0.324 0.383 0.351 94
B-literate_relative_chain 0.247 0.591 0.348 132
B-literate_additive_formal 0.264 0.511 0.348 45
B-literate_causal_explicit 0.221 0.811 0.347 37
B-literate_categorical_statement 0.272 0.471 0.345 85
B-oral_dramatic_pause 0.286 0.429 0.343 14
I-literate_evidential 0.229 0.604 0.332 106
I-literate_abstract_noun 0.256 0.416 0.317 161
I-literate_aside 0.276 0.37 0.317 289
B-literate_evidential 0.217 0.535 0.309 43
I-literate_additive_formal 0.205 0.6 0.306 25
B-literate_technical_term 0.43 0.234 0.303 342
I-literate_conditional 0.648 0.196 0.3 941
I-oral_sensory_detail 0.279 0.314 0.296 245
B-oral_intensifier_doubling 0.217 0.435 0.29 23
I-oral_phatic_filler 0.235 0.372 0.288 43
B-literate_institutional_subject 0.22 0.4 0.284 60
I-literate_concrete_setting 0.3 0.27 0.284 256
B-oral_discourse_formula 0.333 0.245 0.283 106
I-oral_discourse_formula 0.5 0.197 0.283 238
I-literate_conceptual_metaphor 0.309 0.247 0.275 170
B-literate_citation 0.429 0.2 0.273 60
I-oral_antithesis 0.459 0.195 0.273 375
I-literate_institutional_subject 0.224 0.3 0.256 190
I-oral_embodied_action 0.241 0.271 0.255 170
I-literate_qualified_assertion 0.179 0.413 0.25 46
B-oral_self_correction 0.25 0.25 0.25 20
B-oral_us_them 1.0 0.143 0.25 7
B-literate_temporal_embedding 0.176 0.421 0.249 57
I-oral_second_person 0.258 0.235 0.246 132
B-oral_lexical_repetition 0.169 0.4 0.238 25
I-oral_intensifier_doubling 0.22 0.257 0.237 35
I-oral_self_correction 0.212 0.233 0.222 90
B-oral_antithesis 0.191 0.257 0.22 35
I-literate_concessive_connector 0.25 0.176 0.207 17
B-oral_sensory_detail 0.16 0.284 0.204 81
B-literate_qualified_assertion 0.156 0.278 0.2 18
B-oral_simple_conjunction 0.145 0.312 0.198 32
B-oral_anaphora 0.158 0.25 0.194 24
B-oral_tricolon 0.127 0.304 0.179 23
I-literate_temporal_embedding 0.249 0.14 0.179 400
I-literate_contrastive 0.206 0.144 0.17 180
B-literate_abstract_noun 0.186 0.149 0.165 276
I-oral_tricolon 0.2 0.138 0.163 398
I-literate_cross_reference 0.106 0.303 0.157 33
B-literate_concrete_setting 0.117 0.234 0.156 64
I-literate_categorical_statement 0.247 0.106 0.149 207
B-literate_nested_clauses 0.148 0.14 0.144 86
B-oral_everyday_example 0.19 0.108 0.138 37
I-literate_relative_chain 0.424 0.076 0.129 1333
I-literate_causal_explicit 0.1 0.143 0.118 42
I-oral_anaphora 0.124 0.113 0.118 124
B-literate_cross_reference 0.071 0.25 0.111 8
I-oral_everyday_example 0.157 0.066 0.093 287
B-literate_definitional_move 0.034 0.2 0.059 5
B-literate_conceptual_metaphor 0.035 0.091 0.05 33
I-literate_definitional_move 0.025 0.107 0.04 28
I-oral_us_them 0.0 0.0 0.0 40
I-oral_simple_conjunction 0.0 0.0 0.0 53
I-oral_religious_formula 0.0 0.0 0.0 0
I-oral_proverb 0.0 0.0 0.0 43
I-oral_polysyndeton 0.0 0.0 0.0 137
I-oral_parallelism 0.0 0.0 0.0 253
I-oral_first_person 0.0 0.0 0.0 3
I-oral_epithet 0.0 0.0 0.0 33
I-oral_conflict_frame 0.0 0.0 0.0 71
I-oral_audience_response 0.0 0.0 0.0 15
I-oral_alliteration 0.0 0.0 0.0 42
I-literate_nested_clauses 0.0 0.0 0.0 1569
I-literate_footnote_reference 0.0 0.0 0.0 84
I-literate_direct_address 0.0 0.0 0.0 15
I-literate_causal_chain 0.0 0.0 0.0 46
B-oral_proverb 0.0 0.0 0.0 5
B-oral_polysyndeton 0.0 0.0 0.0 6
B-oral_parallelism 0.0 0.0 0.0 14
B-oral_first_person 0.0 0.0 0.0 4
B-oral_epithet 0.0 0.0 0.0 9
B-oral_conflict_frame 0.0 0.0 0.0 29
B-oral_audience_response 0.0 0.0 0.0 3
B-oral_alliteration 0.0 0.0 0.0 8
B-literate_footnote_reference 0.0 0.0 0.0 23
B-literate_direct_address 0.0 0.0 0.0 6
B-literate_causal_chain 0.0 0.0 0.0 5
-literate_methodological_framing 0.0 0.0 0.0 9
-literate_methodological_framing 0.0 0.0 0.0 35
Raw
token_f1_micro_by_support.tsv
marker precision recall f1-score support
O 0.75 0.819 0.783 37244
I-literate_nested_clauses 0.0 0.0 0.0 1569
I-literate_relative_chain 0.424 0.076 0.129 1333
I-literate_conditional 0.648 0.196 0.3 941
I-oral_rhetorical_question 0.683 0.554 0.611 840
I-literate_agentless_passive 0.723 0.472 0.571 839
B-literate_nominalization 0.653 0.377 0.478 763
I-literate_technical_term 0.6 0.353 0.445 745
I-literate_enumeration 0.539 0.41 0.466 607
I-literate_list_structure 0.706 0.48 0.571 596
I-literate_citation 0.589 0.341 0.432 572
I-literate_concessive 0.564 0.551 0.557 512
I-literate_temporal_embedding 0.249 0.14 0.179 400
I-literate_nominalization 0.476 0.619 0.538 399
I-oral_tricolon 0.2 0.138 0.163 398
I-oral_antithesis 0.459 0.195 0.273 375
B-literate_agentless_passive 0.607 0.598 0.603 351
B-literate_technical_term 0.43 0.234 0.303 342
I-literate_agent_demoted 0.491 0.487 0.489 318
I-literate_metadiscourse 0.473 0.304 0.37 312
I-literate_aside 0.276 0.37 0.317 289
I-oral_everyday_example 0.157 0.066 0.093 287
B-literate_abstract_noun 0.186 0.149 0.165 276
I-oral_named_individual 0.32 0.556 0.406 270
B-oral_inclusive_we 0.581 0.921 0.712 266
I-literate_epistemic_hedge 0.371 0.351 0.361 259
I-oral_inclusive_we 0.37 0.498 0.425 257
I-literate_concrete_setting 0.3 0.27 0.284 256
I-oral_temporal_anchor 0.425 0.6 0.498 255
I-oral_parallelism 0.0 0.0 0.0 253
I-oral_sensory_detail 0.279 0.314 0.296 245
I-oral_discourse_formula 0.5 0.197 0.283 238
I-literate_categorical_statement 0.247 0.106 0.149 207
I-literate_institutional_subject 0.224 0.3 0.256 190
I-literate_contrastive 0.206 0.144 0.17 180
B-literate_epistemic_hedge 0.462 0.536 0.496 179
I-literate_conceptual_metaphor 0.309 0.247 0.275 170
I-oral_embodied_action 0.241 0.271 0.255 170
I-literate_abstract_noun 0.256 0.416 0.317 161
B-oral_embodied_action 0.361 0.484 0.413 155
B-oral_second_person 0.387 0.711 0.501 142
B-oral_temporal_anchor 0.324 0.572 0.414 138
I-oral_polysyndeton 0.0 0.0 0.0 137
B-oral_named_individual 0.298 0.578 0.393 135
B-literate_relative_chain 0.247 0.591 0.348 132
I-oral_second_person 0.258 0.235 0.246 132
I-oral_anaphora 0.124 0.113 0.118 124
I-literate_objectifying_stance 0.378 0.487 0.426 115
-literate_technical_abbreviation 0.447 0.815 0.577 108
I-literate_evidential 0.229 0.604 0.332 106
B-oral_discourse_formula 0.333 0.245 0.283 106
B-literate_conditional 0.595 0.742 0.661 97
I-oral_specific_place 0.287 0.531 0.372 96
I-oral_imperative 0.346 0.674 0.457 95
I-oral_lexical_repetition 0.324 0.383 0.351 94
B-literate_contrastive 0.356 0.767 0.486 90
I-oral_self_correction 0.212 0.233 0.222 90
B-oral_rhetorical_question 0.535 0.933 0.68 89
B-oral_imperative 0.654 0.782 0.712 87
B-literate_nested_clauses 0.148 0.14 0.144 86
B-literate_categorical_statement 0.272 0.471 0.345 85
B-literate_enumeration 0.327 0.607 0.425 84
I-literate_footnote_reference 0.0 0.0 0.0 84
B-oral_sensory_detail 0.16 0.284 0.204 81
B-literate_metadiscourse 0.333 0.434 0.377 76
B-oral_specific_place 0.333 0.767 0.465 73
I-oral_conflict_frame 0.0 0.0 0.0 71
B-oral_phatic_filler 0.396 0.571 0.468 70
-literate_technical_abbreviation 0.477 0.788 0.594 66
B-literate_concrete_setting 0.117 0.234 0.156 64
B-literate_institutional_subject 0.22 0.4 0.284 60
B-literate_citation 0.429 0.2 0.273 60
B-literate_temporal_embedding 0.176 0.421 0.249 57
B-literate_agent_demoted 0.347 0.75 0.475 56
B-literate_concessive 0.517 0.818 0.634 55
I-oral_simple_conjunction 0.0 0.0 0.0 53
B-literate_list_structure 0.932 0.788 0.854 52
I-oral_vocative 0.417 0.686 0.519 51
I-literate_qualified_assertion 0.179 0.413 0.25 46
I-literate_causal_chain 0.0 0.0 0.0 46
I-oral_phatic_check 0.421 0.533 0.471 45
B-literate_additive_formal 0.264 0.511 0.348 45
B-literate_evidential 0.217 0.535 0.309 43
I-oral_phatic_filler 0.235 0.372 0.288 43
I-oral_proverb 0.0 0.0 0.0 43
B-literate_aside 0.272 0.524 0.358 42
I-literate_causal_explicit 0.1 0.143 0.118 42
I-oral_alliteration 0.0 0.0 0.0 42
B-literate_probability 0.361 0.65 0.464 40
B-literate_concessive_connector 0.365 0.475 0.413 40
I-oral_us_them 0.0 0.0 0.0 40
B-literate_causal_explicit 0.221 0.811 0.347 37
B-oral_everyday_example 0.19 0.108 0.138 37
I-oral_intensifier_doubling 0.22 0.257 0.237 35
B-oral_antithesis 0.191 0.257 0.22 35
-literate_methodological_framing 0.0 0.0 0.0 35
I-literate_cross_reference 0.106 0.303 0.157 33
B-literate_conceptual_metaphor 0.035 0.091 0.05 33
I-oral_epithet 0.0 0.0 0.0 33
B-oral_simple_conjunction 0.145 0.312 0.198 32
B-oral_conflict_frame 0.0 0.0 0.0 29
I-oral_dramatic_pause 0.327 0.607 0.425 28
I-literate_definitional_move 0.025 0.107 0.04 28
B-oral_vocative 0.42 0.778 0.545 27
B-literate_objectifying_stance 0.333 0.72 0.456 25
I-literate_additive_formal 0.205 0.6 0.306 25
B-oral_lexical_repetition 0.169 0.4 0.238 25
B-oral_phatic_check 0.467 0.875 0.609 24
B-oral_anaphora 0.158 0.25 0.194 24
I-literate_probability 0.536 0.652 0.588 23
B-oral_intensifier_doubling 0.217 0.435 0.29 23
B-oral_tricolon 0.127 0.304 0.179 23
B-literate_footnote_reference 0.0 0.0 0.0 23
B-oral_self_correction 0.25 0.25 0.25 20
B-literate_qualified_assertion 0.156 0.278 0.2 18
I-literate_concessive_connector 0.25 0.176 0.207 17
I-oral_audience_response 0.0 0.0 0.0 15
I-literate_direct_address 0.0 0.0 0.0 15
B-oral_dramatic_pause 0.286 0.429 0.343 14
B-oral_parallelism 0.0 0.0 0.0 14
B-oral_epithet 0.0 0.0 0.0 9
-literate_methodological_framing 0.0 0.0 0.0 9
B-literate_cross_reference 0.071 0.25 0.111 8
B-oral_alliteration 0.0 0.0 0.0 8
B-oral_us_them 1.0 0.143 0.25 7
B-oral_polysyndeton 0.0 0.0 0.0 6
B-literate_direct_address 0.0 0.0 0.0 6
B-literate_definitional_move 0.034 0.2 0.059 5
B-oral_proverb 0.0 0.0 0.0 5
B-literate_causal_chain 0.0 0.0 0.0 5
B-oral_first_person 0.0 0.0 0.0 4
I-oral_first_person 0.0 0.0 0.0 3
B-oral_audience_response 0.0 0.0 0.0 3
I-oral_religious_formula 0.0 0.0 0.0 0
@lmmx
Copy link
Author

lmmx commented Feb 9, 2026 •
edited
Loading

Screenshot from 2026-02-09 01-50-21 
marker	precision	recall	f1-score	support
I-literate_nested_clauses	0.0	0.0	0.0	1569
I-oral_parallelism	0.0	0.0	0.0	253
I-oral_polysyndeton	0.0	0.0	0.0	137
I-literate_footnote_reference	0.0	0.0	0.0	84
I-oral_conflict_frame	0.0	0.0	0.0	71
I-oral_simple_conjunction	0.0	0.0	0.0	53
I-literate_causal_chain	0.0	0.0	0.0	46
I-oral_proverb	0.0	0.0	0.0	43
I-oral_alliteration	0.0	0.0	0.0	42
I-oral_us_them	0.0	0.0	0.0	40
-literate_methodological_framing	0.0	0.0	0.0	35
I-oral_epithet	0.0	0.0	0.0	33
B-oral_conflict_frame	0.0	0.0	0.0	29
B-literate_footnote_reference	0.0	0.0	0.0	23
I-oral_audience_response	0.0	0.0	0.0	15
I-literate_direct_address	0.0	0.0	0.0	15
B-oral_parallelism	0.0	0.0	0.0	14
B-oral_epithet	0.0	0.0	0.0	9
-literate_methodological_framing	0.0	0.0	0.0	9
B-oral_alliteration	0.0	0.0	0.0	8
B-oral_polysyndeton	0.0	0.0	0.0	6
B-literate_direct_address	0.0	0.0	0.0	6
B-oral_proverb	0.0	0.0	0.0	5
B-literate_causal_chain	0.0	0.0	0.0	5
B-oral_first_person	0.0	0.0	0.0	4
I-oral_first_person	0.0	0.0	0.0	3
B-oral_audience_response	0.0	0.0	0.0	3
I-oral_religious_formula	0.0	0.0	0.0	0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment