Interface administrators, Administrators (Semantic MediaWiki), Curators (Semantic MediaWiki), Editors (Semantic MediaWiki), Suppressors, Administrators
7,785
edits
LLaMA/Model Card: Difference between revisions
no edit summary
No edit summary |
|||
| Line 104: | Line 104: | ||
We present our results on bias in the table below. Note that lower value is better indicating lower bias. | We present our results on bias in the table below. Note that lower value is better indicating lower bias. | ||
No Category FAIR LLM | {| class="wikitable" | ||
1 Gender 70.6 | |- | ||
2 Religion 79 | |+ style="caption-side:bottom"|Table 3 - Summary bias of our model outputtasks | ||
3 Race/Color 57 | |- | ||
4 Sexual orientation 81 | !No | ||
5 Age 70.1 | !Category | ||
6 Nationality 64.2 | !FAIR LLM | ||
7 Disability 66.7 | |- | ||
8 Physical appearance 77.8 | |1 || Gender || 70.6 | ||
9 Socioeconomic status 71.5 | |- | ||
LLaMA Average 66.6 | |2 || Religion || 79 | ||
|- | |||
|3 || Race/Color || 57 | |||
|- | |||
|4 || Sexual orientation || 81 | |||
|- | |||
|5 || Age || 70.1 | |||
|- | |||
|6 || Nationality || 64.2 | |||
|- | |||
|7 || Disability || 66.7 | |||
|- | |||
|8 || Physical appearance || 77.8 | |||
|- | |||
|9 || Socioeconomic status || 71.5 | |||
|- | |||
| || LLaMA Average || 66.6 | |||
|- | |||
|} | |||
==Ethical considerations== | ==Ethical considerations== | ||