ChatGPT learns to write JLPT 1 in 6 months.

I don't remember if it was the chatgpt model when it first came out or the plus model, but around May or so the Japanese language output was completely ungrammatical.<br><br>I used to live in Japan and studied Japanese for 4 years and for the last 4 years I've been teaching Japanese to middle school students.<br><br>I was interested to see how well ChatGPT understands Japanese so I would regularly test it with very simple, grammatical sentences that I would give my 7th graders to see how it would do.<br><br>I would regularly give it sentences such as...<br><br>Konnichiwa, o genki desu ka?<br><br>It would be confused by "Konnichiwa" and ask me me what it was.<br><br>Then around August it started to be able to understand basic Japanese and sentences, and would give responses like O genki desu which was still not grammatical.<br><br>I was curious so I started asking it to write longer paragraphs for me with basic vocabulary that I would use with my 7th graders.<br><br>In September it seemed like it had improved a LOT, and started producing flawless sentences that seemed grammatical, but not necessarily coherent with my request.<br><br>Around November, the sentences it supplied were not only grammatical, but also coherent with my prompt.<br><br>Then recently I asked it to create a news article with basic vocabulary and more advanced vocabulary as well, it actually used 40 or so kanji characters and all the sentences were coherent and grammatical.<br><br>I was curious so I asked it to write an essay on Fugu fish, which is a notoriously difficult topic and I would only assign to 11th graders in a Japanese class.<br><br>It wrote a perfectly coherent essay with over 80 kanji characters and all the sentences were grammatical.<br><br>I think this is a good indication that its understanding of Japanese went from 0 to possibly JLPT 1 or 2 in just 6 months. <br><br>I have been experimenting with first gen and the plus, and I think the plus is more fluent in Japanese but the first gen has a better understanding of Japanese.<br><br>Anyways, still a little rough around the edges, but I think it's great for sentence structure and syntax or just getting ideas or inspiration for a prompt.<br><br>Idk if that's interesting to anyone but I just wanted to share what I observed.