NLP

I have put together my notes for the undergraduate NLP class I teach in book form. 

Exploring NLP with Python is available on Amazon

Most chapters have companion videos on my YouTube channel.

Code examples are available on GitHub

Part 1: Foundations
  • Chapter 1: A Brief and Biased Overview of NLP 
  • Chapter 2: Python Basics 
  • Chapter 3: Intro to NLTK
  • Chapter 4: Linguistics 101

Part 2: Words
  • Chapter 5: Words and Counting
  • Chapter 6: POS Tagging
  • Chapter 7: Relationships between Words
  • Chapter 8: N-gram Models

Part 3: Sentences
  • Chapter 9: CFG Grammar
  • Chapter 10: Syntax and Parsing
  • Chapter 11: Annotated Parses

Part 4: Documents
  • Chapter 12: Finding or Building Corpora
  • Chapter 13: Information Extraction
  • Chapter 14: Vector-Space Models
  • Chapter 15: Topic Modeling
  • Chapter 16: Semantics

Part 5: Machine Learning
  • Chapter 17: Machine Learning
  • Chapter 18: NumPy, pandas, Scikit-Learn, Seaborn
  • Chapter 19: Converting Text to Numeric Data
  • Chapter 20: Naive Bayes
  • Chapter 21: Logistic Regression
  • Chapter 22: Neural Networks

Part 6: Deep Learning
  • Chapter 23: Deep Learning 
  • Chapter 24: Deep Learning Variations
  • Chapter 25: Embeddings
  • Chapter 26: Encoders and Decoders

Comments

Post a Comment

Popular posts from this blog

Google is watching

Image
Google is watching you, but you knew that already. Several years ago I saw a pop-up like this: It scared the heck out of me so I just exited out of Chrome. It popped up again today and I hit 'I want to play' and this popped up: Wow. I have heard that this is how Google recruits developers. I don't know if that's true but I exited out of this. Maybe next time . . .
Read more

Your Brain on Code

 Is reading code like solving math problems? or is it more like reading in general? Neither, it turns out. MIT researcher Eveline Fedorenko and team placed coders in a functional magnetic resonance (fMRI) scanner, and showed them code in a programming language in which they were proficient, then asked them questions about the code.   Although coding languages have many things in common with human languages, like meaning units and syntax, the fMRI showed that reading code did not significantly activate the regions of the brain associated with language. These language regions of the brain, including Broca's area, are primarily in the left hemisphere.  Instead, the distributed parts of the brain known as the multiple demand (MD) network were activated across the brain. These regions had previously been shown to be activated for complex mental tasks like solving math problems, or doing crossword puzzles. However, the regions activated for the coders were not identical to...
Read more

Ethics in AI

This article from Quartz came into my phone's news feed this morning. AI conferences are beginning to think about ethics. Finally. Specifically, the premier machine learning conference NIPS requires a broader impact on society statement for presented research. One of the top natural language processing conferences, EMNLP, will now reject papers on ethical grounds. Whether these moves actually keep AI ethical or just push the dirty parts underground remains to be seen. But we all have a voice in keeping each other in check.  When I was a PhD student, our advisor had us sit in on talks by prospective faculty and arranged for the prospect to meet with just the students. I remember one young man boasting of one NLP project after the other, each more horribly intrusive on innocent lives than the last. All of these done in internships with a major computer manufacturer. Finally, when we got to questions, I asked him, "Can you describe any project you have done which makes the world...
Read more