Just by watching series and movies I feel that I build my understanding of the English language.

Of course this is not true, as I grew up in English courses and reading lots of books.

Reading books in english was the KEY for me to find my English voice.

But to what concerns vocabulary, all I remember is a character from a movie saying that particular sentence, and I know what and how to say.

Yeah, the best way is to practice a lot.