Dropping frames while watching streams

I used to not drop any frames while watching LoL streams, but now, I'm dropping a ton. I don't think it's an issue with the users' channels because even watching LoLesports drops a lot of frames. I don't really think it's me because I can watch the same thing on YouTube or AzubuTV perfectly fine. Is this a Twitch issue? Is there a way to fix this? It's super annoying