# Eddie's Learning Record 20

**Published by:** [Eddie's Learning Records](https://paragraph.com/@eddiehe/)
**Published on:** 2022-10-23
**URL:** https://paragraph.com/@eddiehe/eddies-learning-record-20

## Content

1. DurationMonday, October 16th, 2022 - Saturday, October 22th, 2022 2. Learning Record2.1 Learning the Attention MechanismI spent about four days learning the Bahdanau attention. I found that I had totally forgotten the knowledge about RNN and embedding, which hindered me from learning the new code. Furthermore, there are a variety of variables like num_heads, num_hiddens, and no. of key-value pairs...... The only way to figure them out is to debug them line by line in the jupyter notebook. That was also what I did. 2.2 Paper WorkI made a PowerPoint to illustrate each stage of the process hoping to attract younger teammates to study with me. My supervisor said I could report the next week. 3. Feeling3.1 TiredI am learning how to code and review for the National Teacher Certificate Examination at the same time. Preparing for an exam is boring and tiring. Meanwhile, it seemed that I got a cold. It was hard to pay attention.

## Publication Information

- [Eddie's Learning Records](https://paragraph.com/@eddiehe/): Publication homepage
- [All Posts](https://paragraph.com/@eddiehe/): More posts from this publication
- [RSS Feed](https://api.paragraph.com/blogs/rss/@eddiehe): Subscribe to updates
- [Twitter](https://twitter.com/eddiehe99): Follow on Twitter

## Optional

- [Collect as NFT](https://paragraph.com/@eddiehe/eddies-learning-record-20): Support the author by collecting this post
- [View Collectors](https://paragraph.com/@eddiehe/eddies-learning-record-20/collectors): See who has collected this post