Terminology for LLM

Note

Hey guys, this is my personal reading note. I am not sure there might be some mistakes in my understanding. Please feel free to correct me (hsiangjenli@gmail.com) if you find any. Thanks!

1. Byte Pair Encoding (BPE)

2. Zero-shot task transfer

3. reinforcement learning with human feedback (RLHF)

4. Fine-Tuning (FT)

5. Few-Shot (FS)

6. One-Shot (1S)

7. Zero-Shot (0S)

8. Multi-turn conversational ability 多輪對話能力

9. LLM-as-a-judge

10. Position Bias

11. Verbosity Bias

12. Self-Enhancement Bias

13. Limited Reasoning Ability

Reference