A pat to my shoulders and also a WHIRL of confusion in my mind.

Yea, basically the good thing is that I've finally found out the problem
to the slow internet at home.

The problem lies in the computer's network adapter trying HARD to lookup
for DNS server from the router.
And that causes "Looking up.. (host name)" issues in firefox,
or "Connecting to......." for a long period of time in IE.

What I did was I input the DNS address from my router to the network adapter's
configuration. - There solved.
And that is the simplest solution ever.
NO MORE weird LATENCY issues. (refreshing servers in steam sometimes produces 100++ms)

FYI - It's a 2WIRE 2700HG-V router (crap stuff IMO).

Now for the confusing part.
My computer has this sudden performance boost out of nowhere.
Yes - I am saying that cause WoW loaded damn quick for no reason.

Yea - life of a Computer GEEK/NERD, WHATEVER you people can think of.