This one plagued me for some time until I decided I needed to figure it out.
1. Type is:unread into search box
2. Select all in the drop down on the top right
3. Click on the link: “Select all conversations that match this search”. This link is just above email list.
4. Select mark as read from more drop down.