What are these "occasional attempt to connect"?
"I have also not configured the router to have any specific ports open."
Some ports must be open, even though they may appear stealthed in a port scan, they must open or you couldn't use the internet.
This probably comes down to the software you're running, P2P, game(s)?
Without knowing what inbound traffic your software firewall is detecting it's difficult to offer more help.