1. Duration

Monday, October 16th, 2022 - Saturday, October 22th, 2022

2. Learning Record

2.1 Learning the Attention Mechanism

I spent about four days learning the Bahdanau attention. I found that I had totally forgotten the knowledge about RNN and embedding, which hindered me from learning the new code.

Furthermore, there are a variety of variables like num_heads, num_hiddens, and no. of key-value pairs...... The only way to figure them out is to debug them line by line in the jupyter notebook. That was also what I did.

2.2 Paper Work

I made a PowerPoint to illustrate each stage of the process hoping to attract younger teammates to study with me. My supervisor said I could report the next week.

3. Feeling

3.1 Tired

I am learning how to code and review for the National Teacher Certificate Examination at the same time. Preparing for an exam is boring and tiring. Meanwhile, it seemed that I got a cold. It was hard to pay attention.