I actually expect the score to go up. The first episodes of a show typically are just trying to get the audience to know the characters and background of the story. Not a whole lot usually happens action/plot wise. Once the story is a bit established things can progress much quicker and the show can get more exciting.
Same goes for books. My favorite part of almost all books is the middle and a bit of the end. The beginning of a book is almost always my least favorite. Which makes sense because how am I going to love/like something when I have no idea who the characters are or what in the heck is going on? Books, and shows, always get better for me as they go along and I get more familiar with what is happening.