Pull harder while slightly rotating. It will come out just takes a little extra effort. Don't worry I doubt you'll break it.
Really though there isn't a reason to take them apart. They are designed to clean 100% of the surfaces when soaked/pushed thru while open.
Last time I took mine apart it took a little fudging to get them to stop leaking. So I wouldn't take them apart again unless absolutely necessary.