Hello, straight to the topic that I need some explanations

:
R1 --- R2 ---- hostA
hostA ip 192.168.1.2
R1s serial 192.168.1.17
I used VLSM so dont care about the subnets or whatsover
Extended IP access list RESTRICT_TELNET
10 deny tcp host 192.168.1.2 host 192.168.1.17 eq telnet
20 permit ip any any (2 matches)
For testing purposes I did the following:
Applied this access list under vty 0 4 of R1. I was able then to telnet from HostA -> R1. Then I applied the same access-list for the inbound connections of the R1's serial interface and still I was able to telnet inside. Also I can check that everything passes through the access-list cause I see the counter increasing of the permit ip any any. Why?! This looks a bit tricky, because if I apply this to R2's interfaces I wont be able to telnet to R1.
Then I changed the destination host to "any" and then I wasnt able to telnet inside.
Could somebody give me some light why this is happening?