• Read What We Still Don’t Know about How A.I. Is Trained by Sue Halpern (The New Yorker, March 28 2023, archived copy). What new information did you learn from it?
• Read Meet Ernie, China’s answer to ChatGPT (The Economist, September 3 2023, archived copy). What are the unique challenges for the creation and application of language models in the Chinese context that that article mentions?
• Pick any open language model such as zephyr-7b-alpha (on Hugging Face), Mistral-7B-Instruct-v0.1 (on Hugging Face), falcon-7b-instruct (on Hugging Face), InternLM 7B (see slides how to access), Samantha 1.11 7B (see slides how to access) and see how its responses to the same input compare to ChatGPT (for InternLM you’d most accurately compare with GPT-3.5 via the API). Besides generation quality, are there other differences you can make out (e.g. concerning content other than English, political leanings, topics the model is willing to engage, …)?
• List any one insight you had listening to Scott Cazan’s description of the commercial project he was doing for Away.
• Come up with two questions about anything related to week 7’s content.