Co-op problem

Hello,

I have a little problem with playing co - op with my friend. Always when we try to play together the game fails to launch saying unable to connect or stuff like that. But when I or him try to play with someone else, it works fine. I've made all those thing with opening the ports and so. Any idea what could cause that problem?